Job Postings
Data Engineer
at
The Whitestone Group
Data Engineer
  • Company
    The Whitestone Group
  • Location
    Toronto, Ontario, Canada
  • Type
    Contract
  • Date Posted
    December 27, 2024
**Job Title: Data Ops/Cloud Data Engineer**
**Location:** Toronto (Hybrid, onsite 3 days a week)
**Address:** 87 Sir William Hearst Avenue
**Work Hours:** 7.25 hours per day
**Application Deadline:** Thursday, January 2, 2025, @ 3:00 PM EST

**To Apply:** Please click the link to upload your resume.

**Must Have Requirements:**
- Expert data/database administration experience (e.g., Microsoft Azure SQL database, Synapse database, Oracle, IMS, DB2).
- Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machines, Azure DevOps, Data Lake, Data Lakehouse, and Azure monitoring tools.
- Experience with cloud data platforms, data management, and data exchange tools and technologies.
- Experience with Azure SQL, Oracle, IMS/DB2 data replication (knowledge of).
- Residency in Ontario, Canada.

**Nice to Have:**
- Public sector experience.

**Scope of Services and Deliverables:**
- Participate in the review of project, work request, and maintenance release artifacts (e.g., Use Case, System Requirement Specification).
- Deliver detailed system design documents and supporting documentation conforming to Ministry standards.
- Design, develop, and optimize data/database CI/CD pipelines.
- Create logical and physical data models using Sybase Power Designer.
- Prepare database changes in DACPAC and develop Azure CI/CD release pipelines to promote DACPAC.
- Promote database changes through Development, Integration Testing, QA, UAT, and Production environments.
- Provision data in a cloud environment according to requirements.
- Design, develop data loading, data conversion, and data migration programs.
- Implement data conversion of very large data (VLD) in OLAP and OLTP environments to Cloud SaaS, PaaS, and IaaS environments.
- Design, develop, and implement fact/dimension models, data mapping, data warehouses, data lakes, and data lakehouses.
- Plan, configure, maintain, administer, and tune performance of Oracle, Microsoft Azure SQL database, and Synapse database.
- Support cloud-based heterogeneous data replication solutions.
- Develop complex Oracle PL/SQL programs and SQL server stored procedures to fulfill project and maintenance requirements.
- Optimize performance of PL/SQL programs and SQL server stored procedures.
- Monitor and analyze incidents and provide timely resolution.
- Perform reference data administration as required.
- Build and test database backup/recovery scripts and automation scripts.
- Perform database administration, including patching/upgrade, monitoring, performance tuning, partitioning, capacity planning, and enhancements.
- Document and resolve any database problems/issues.
- Provide effective knowledge transfer to Ministry staff throughout the assignment.

**Experience and Skill Set Requirements:**

**Cloud DataOps (40%):**
- Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machines, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools.
- Experience with cloud data platforms, data management, and data exchange tools and technologies.
- Experience in data pipeline and workflow development, orchestration, deployment, and automation.
- Knowledge of DataOps principles, best practices, and Agile project development and deployment.
- Experience in Continuous Integration/Continuous Development/Deployment (CI/CD) and Data provisioning automation.
- Familiarity with digital products, data analysis, data exchange, data provisioning, and data security.
- Experience with structured, semi-structured, and unstructured data collection, ingestion, provisioning, and exchange.
- Proficiency in DataOps performance monitoring and tuning.

**Database Management (40%):**
- Expert data/database administration experience (e.g., Microsoft Azure SQL database, Synapse database, Oracle, IMS, DB2).
- Extensive experience with SQL Server Stored Procedure, Oracle PL/SQL, and PL/1 development and performance tuning.

**Data Replication Pipelines (20%):**
- Experience with Azure SQL, Oracle, IMS/DB2 data replication.

**To Apply:** Please click the link to upload your resume.