CPTO_121 - Data & ML Platform Engineer (f/h/n)

Job summary

The Platform Engineer is responsible for building and evolving a reliable, observable, and scalable data platform. Key responsibilities include maintaining deployments of Airbyte, Airflow, and Metabase, collaborating with ML/AI Engineers to design necessary compute and storage capabilities, and ensuring data security and compliance through anonymization and data lineage practices.

Benefits

Responsibilities

• Evolve transformation, orchestration, testing frameworks, semantic layer, and observability.
• Maintain and evolve Helm deployments of Airbyte, Airflow, Metabase.
• Document technical choices and operational standards of the platform.
• Collaborate with ML/AI Engineer to design compute and storage capabilities for ML use cases.
• Ensure reproducibility of versioning, training, deployment, and monitoring of models.
• Implement model monitoring and detect data drift and model drift.
• Deploy alerting mechanisms for model tracking in production.
• Establish data anonymization and pseudonymization mechanisms.
• Define and apply data retention, archiving, and deletion rules.
• Structure access controls for data and models.
• Implement data lineage and model lineage.
• Evaluate and benchmark embedded analytics solutions, caching layers, and Data/ML tools.
• Optimize performance and costs in a FinOps approach.

Skills

Relocation