Cloud DevOps Specialist

Job summary

This role deploys data services and streaming components for a platform operating within a strictly isolated network, and delivers priority data sources as curated datasets for analytical use. The work includes building scheduled and event-driven ingestion and transformation pipelines, applying data quality checks, registering metadata and lineage, and enabling analyst access, using infrastructure-as-code practices and collaborating on data modelling and ontology.

Qualifications

• At least 5 years of experience designing and maintaining data pipelines, data transformations, medallion-layer solutions, or data models.
• Experience designing and building scalable data platforms.
• Experience with at least one of Azure, AWS, or Google Cloud.
• Experience with at least two of Java, Scala, and Python.
• Eligibility for Canadian Secret Clearance.
• Bachelor's degree or college program in computer science or a related field.
• English proficiency for regular stakeholder communication.
• Production experience with the listed qualifications is an asset.
• Experience building real-time analytics applications is an asset.
• Experience with batch and stream processing technologies is an asset.
• Machine learning experience with Spark or similar is an asset.
• Experience with Oracle, Informatica, or open-source technologies such as Spark, Kafka, Presto, Hive, or Cassandra is an asset.
• Cloud Data Solution Architect certification is an asset.

Responsibilities

• Deploy and configure platform data services and streaming components.
• Build scheduled and event-driven ingestion pipelines, including change data capture where required.
• Develop transformation logic and business rules to curate raw data.
• Implement data quality rules and automated pipeline validation.
• Register metadata, lineage, and data access.
• Build end-to-end data solutions aligned with customer business objectives.
• Collaborate with business systems analysts to clarify requirements and optimize pipeline performance.
• Develop solutions using big data and data management tools.
• Write code following quality and risk-reduction practices.
• Report status and help resolve project blockers with project managers and technical leads.

Skills

Certifications

Degrees

Languages

Industry

Security clearance

Relocation