Senior Data Platform Engineer
at
RBC
Senior Data Platform Engineer
Location
Toronto, Ontario, Canada
Date Posted
December 21, 2024
**Job Summary**
**What is the opportunity?**
Join the dynamic Data & Analytics team at RBC Global Asset Management as a Senior Data Platform Engineer. This hands-on role is crucial for the development and implementation of GAM’s Data Platform, focusing on designing, implementing, and maintaining robust data infrastructure that supports data engineering, BI, Machine Learning, and AI capabilities.
**What you will do:**
- Collaborate with the Data Engineering and Analytics team to drive business decisions using data.
- Build scalable data platform infrastructure with cloud-native technologies.
- Take ownership of end-to-end deliverables, ensuring high-quality data solutions.
- Enable deployment of batch and event-driven data pipelines using technologies such as Spark, NiFi, Kafka, and Airflow.
- Configure and manage a SQL-based self-serve compute platform using Starburst Trino.
- Implement data management tools for streamlined data processing.
- Apply DevOps principles to improve the speed and quality of the data development process.
- Ensure data security standards across data pipelines.
- Troubleshoot and resolve data integration and processing issues.
- Conduct proof-of-concepts to implement hybrid cloud data strategies.
- Collaborate with engineers and business stakeholders to iterate and deliver new initiatives.
- Stay informed about emerging technologies in the data engineering domain.
- Lead, mentor, and inspire a team of engineers for high performance.
**What you need:**
- 3-5 years of experience in big data processing using Spark, Python, NiFi, Kafka, and Airflow on both on-premises and cloud data platforms (e.g., Snowflake, Databricks, Azure, AWS, GCP).
- 2-3 years of experience in solution design, data ingestion, and ETL/ELT job scheduling & monitoring.
- 2-3 years of system administration experience, including Docker and Kubernetes platforms.
- Strong knowledge of UNIX-like operating systems and shell scripting.
- Expertise with DevOps tools and automation for developing data flows.
- Proficiency in SQL and at least one programming language (Java, Scala, Python).
**Nice-to-have:**
- Experience with OpenShift, Airflow, S3, Trino, Ranger, and Hive.
- Knowledge of networking, information security, and vulnerability management.
- Experience in creating dashboards using Prometheus and Grafana.
- Familiarity with data science tools and libraries.
**What's in it for you?**
- Comprehensive Total Rewards Program, including bonuses and flexible benefits.
- Supportive leaders focused on your development and growth.
- Opportunities for increased responsibilities.
- Work in a collaborative, progressive, and high-performing team.
**Additional Job Details:**
- **Address:** RBC CENTRE, 155 WELLINGTON ST W, TORONTO
- **City:** TORONTO
- **Country:** Canada
- **Work hours/week:** 37.5
- **Employment Type:** Full time
- **Platform:** WEALTH MANAGEMENT
- **Job Type:** Regular
- **Pay Type:** Salaried
- **Posted Date:** 2024-11-27
- **Application Deadline:** 2024-12-12
**Inclusion and Equal Opportunity Employment**
At RBC, we value diversity and inclusion for innovation and growth. We are committed to building inclusive teams and an equitable workplace for all employees. We strive to provide an accessible candidate experience and support diverse talent.
**Join our Talent Community**
Stay informed about career opportunities at RBC. Sign up to receive customized information on our latest jobs, career tips, and recruitment events. Expand your limits and create a new future together at RBC.