Data Platform Engineering Lead

Job summary

Lead architect for enterprise-scale cloud-native data platforms in Asset Management.

Qualifications

• Expertise in Databricks, dbt, AWS Cloud, Terraform, Python, DevOps, and Platform Engineering.
• Experience in investment management organizations.

Responsibilities

• Design, implement, and manage enterprise data platforms.
• Define platform engineering strategy aligned with EDO standards.
• Establish reusable platform frameworks and best practices.
• Drive cloud-native modernization initiatives.
• Manage platform lifecycle, scalability, and reliability.
• Lead Databricks platform architecture and administration.
• Design Lakehouse architecture with Delta Lake.
• Manage Databricks Workflows, Delta Live Tables, Unity Catalog, MLflow, and security controls.
• Optimize platform performance and cost efficiency.
• Build governance controls across environments.
• Lead cloud engineering using AWS services.
• Build reusable Terraform modules.
• Automate environment provisioning and standardization.
• Maintain infrastructure version control.
• Ensure compliance through Infrastructure-as-Code.
• Design and implement CI/CD pipelines.
• Automate deployment and release management.
• Enable Infrastructure-as-Code and GitOps methodologies.
• Support engineering teams with self-service capabilities.
• Support API integrations and workflows.

Skills

Relocation