Data Engineer

Vista previa de la oferta

Data Engineer

Technology / Software Development

Requisition ID: 270031 

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

The Data Engineer will play a critical role in designing, building, and supporting scalable, secure, and resilient data solutions across enterprise cloud data platforms. This role will focus on modern data engineering practices, including Azure, Databricks, Unity Catalog, ETL/ELT pipeline development, dbt-based transformation, CI/CD automation, and data platform modernisation.

The successful candidate will work closely with business stakeholders, product teams, data architecture, platform engineering, and application teams to deliver reliable data pipelines and high-quality data products that support reporting, analytics, operational decision-making, and enterprise data initiatives.

Is this role right for you? In this role, you will:

• Design, build, test, deploy, and support scalable data pipelines across Azure and Databricks environments.
• Develop ETL and ELT processes to ingest, transform, validate, and distribute structured, semi-structured, and unstructured data.
• Build and optimise data pipelines using Azure cloud services, Databricks, Spark, Unity Catalog, dbt, and related data engineering tools.
• Work with stakeholders, product managers, architects, and platform teams to understand business requirements and translate them into reliable technical solutions.
• Design ingestion patterns and onboard new data sources into the enterprise cloud data platform.
• Implement data quality, reconciliation, validation, lineage, and observability capabilities to ensure data accuracy, reliability, and traceability.
• Develop reusable data engineering frameworks, patterns, and standards to improve delivery efficiency and operational stability.
• Support data governance and access control through Unity Catalog, platform security standards, and enterprise risk management practices.
• Create and maintain technical design documentation, including logical and physical data flow views, pipeline designs, operational runbooks, and implementation details.
• Drive adoption of DevOps and engineering best practices, including GitHub-based source control, CI/CD pipelines, automated testing, code reviews, and deployment governance.
• Troubleshoot production issues, perform root cause analysis, and continuously improve pipeline performance, reliability, and scalability.
• Collaborate with DevOps, Scrum, product, application, and business teams to deliver data products in an Agile delivery model.
• Contribute to roadmap planning, delivery tracking, technical discussions, and stakeholder communications where required.

Do you have the skills that will enable you to succeed in this role? We'd love to work with you if you have:

Core Data Engineering Experience

• 4+ years of experience working with data warehouses, data lakes, lakehouse platforms, or enterprise data platforms.
• 4+ years of experience designing, developing, and supporting ETL/ELT data pipelines.
• Strong experience working with structured, semi-structured, and unstructured data.
• Hands-on experience with data ingestion, transformation, validation, reconciliation, and distribution patterns.
• Strong understanding of data modelling, SQL development, performance tuning, and pipeline optimisation.
• Experience building resilient, scalable, and maintainable data engineering solutions for enterprise environments.

Azure and Databricks

• Strong hands-on experience with Azure cloud data services, including Azure Data Lake Storage , azure data factory, and related cloud-native data platform components.
• Strong experience with Databricks, Spark, Delta Lake, and lakehouse architecture.
• Practical experience with Unity Catalog for data governance, access control, metadata management, and secure data sharing.
• Experience with Databricks Auto Loader, workflow orchestration, notebook development, job scheduling, and production-grade pipeline deployment.
• Understanding of cloud security, access management, data protection, and enterprise governance standards.

DBT, ETL/ELT, Airflow and Data Transformation

• Hands-on experience with dbt for data transformation, modular SQL development, testing, documentation, and deployment.
• Strong understanding of ELT design patterns, incremental models, reusable transformation logic, and data quality checks.
• Ability to design transformation layers that are maintainable, auditable, and aligned with enterprise data standards.

Programming and Technical Skills

• Strong SQL development skills.
• Strong Python programming and scripting experience for data engineering and automation.
• Working knowledge of Java and/or Scala, especially in Spark or big data processing environments.
• Experience with shell scripting or automation scripting is an asset.
• Strong debugging, problem-solving, and performance tuning skills.

CI/CD and Engineering Practices

• Hands-on experience with GitHub for source control, branching, pull requests, code reviews, and release management.
• Experience building or working with CI/CD pipelines for data engineering delivery.
• Experience with DevOps practices, automated testing, deployment automation, and environment promotion.
• Familiarity with Terraform, infrastructure-as-code, or cloud deployment automation is an asset.
• Experience working in Agile/Scrum delivery teams.

Communication and Collaboration

• Strong communication skills with the ability to explain complex technical concepts to both technical and non-technical stakeholders.
• Ability to translate business requirements into scalable technical solutions.
• Experience leading or actively contributing to technical discussions, design reviews, and implementation planning.
• Collaborative mindset with the ability to work across data, application, platform, DevOps, product, and business teams.
• Demonstrated ownership, accountability, and a track record of successful delivery in enterprise technology environments.

Nice to Have

• Experience in banking, financial services, regulatory, or highly governed enterprise environments.
• Experience with data lineage, metadata management, data quality frameworks, and observability tools.
• Experience with enterprise reporting, analytics, AI/ML enablement, or operational data products.
• Knowledge of application integration patterns, APIs, microservices, or event-driven architecture.
• University degree in Computer Science, Engineering, Data Engineering, Information Technology, or equivalent practical experience.

What's in it for you?

• Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
• Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.  
• Upskilling through online courses, cross-functional development opportunities, and tuition assistance. 
• Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
• Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.
• Community Engagement - No matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs.

Location(s):  Canada : Ontario : Toronto 

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.  

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our  Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.