Principal Cloud Engineer (Terraform), London

Job summary

The Principal Terraform Cloud Engineer role focuses on enhancing cloud cost management through data engineering and AI/ML capabilities. Key responsibilities include building and maintaining ELT/ETL pipelines using AWS, Azure, and GCP, developing AI/ML models for cost anomaly detection, and designing microservices and APIs to expose FinOps data. The position requires hands-on experience with tools like Apache Spark, dbt, and Python, along with a strong understanding of cloud billing data.

Qualifications

• Hands-on data engineering experience in production environments
• Applied AI/ML engineering experience
• Software or platform engineering experience building APIs
• Experience working with cloud billing data
• Strong proficiency with Apache Spark, dbt, Airflow
• Experience building modular, production-grade microservices
• Working knowledge of cost and usage data schemas
• Proficiency in the Python ML ecosystem
• Practical experience with LLM APIs
• Experience with data cataloging, lineage, access controls

Responsibilities

• Build, maintain, and improve ELT/ETL pipelines
• Design and implement layered data models and transformation logic
• Develop modular, reusable data transformation components
• Manage production pipelines end-to-end
• Apply data quality and validation frameworks
• Build and maintain reusable data assets
• Design and build modular microservices and APIs
• Contribute new features and capabilities to FinOps platform
• Integrate data and AI services with internal platforms
• Follow software engineering best practices
• Identify opportunities to refactor or modularize existing components
• Develop, train, and evaluate machine learning models
• Implement and maintain MLOps pipelines
• Experiment with and apply generative AI and LLM capabilities
• Collaborate with FinOps analysts to validate model outputs
• Document model design, feature engineering decisions, and evaluation results
• Implement and uphold data governance standards
• Follow and actively contribute to team engineering standards
• Apply extensive and diversified knowledge of data engineering principles
• Lead by example and model behaviors consistent with RISE values

Skills

Certifications

Degrees

Relocation