Platform Engineer - Databricks and Cloud

Job summary

The Platform Engineer role is centered on designing and automating cloud infrastructure for large-scale analytics and data engineering workloads. Responsibilities include architecting solutions with AWS services, implementing Infrastructure-as-Code using Terraform, and collaborating with data engineering teams to develop platforms utilizing Databricks and AWS Glue.

Qualifications

• Strong experience designing enterprise-scale AWS cloud architectures
• Expertise in Infrastructure-as-Code (Terraform / AWS CDK)
• Deep understanding of microservices and container-based architectures
• Hands-on experience with Kubernetes (EKS)
• Strong knowledge of CI/CD pipelines and DevOps methodologies
• Proficiency in Python, Bash, or similar scripting languages
• Experience implementing cloud security and compliance control
• Strong networking knowledge (VPC design and security)
• Experience with modern data platforms (Databricks, AWS Glue, Redshift)
• Strong communication and stakeholder management skills
• Ability to lead teams and drive architectural decisions

Responsibilities

• Architect and implement highly available cloud solutions using AWS services
• Define cloud architecture standards and governance
• Drive Infrastructure-as-Code adoption using Terraform or AWS CDK
• Define and manage CI/CD strategies including multi-environment deployments
• Design secure cloud environments covering IAM and network security
• Collaborate with data engineering teams to build platforms using AWS Glue and Databricks
• Implement observability frameworks using tools like CloudWatch and Grafana
• Optimize cloud environments for performance and cost
• Lead client discussions and provide strategic guidance
• Guide engineering teams to follow architectural standards
• Support multi-account cloud strategies using AWS Organizations

Skills

Certifications

Degrees

Relocation