Principal DevOps Engineer

Job summary

Shapes the architecture and operation of a cloud platform, setting infrastructure direction and creating reusable patterns for engineering teams across AWS, with additional GCP and Azure environments. The role operates EKS clusters and an internal AI gateway using LiteLLM and Langfuse, builds Terraform modules, defines service SLOs, leads incident response, maintains US and EU environment parity, and improves observability and cost management.

Benefits

Qualifications

• At least 10 years in infrastructure, SRE, or DevOps, including at least 3 years at staff or principal level setting technical direction.
• Deep AWS expertise, including EKS, RDS, S3, and IAM, plus working knowledge of GCP or Azure.
• Strong Terraform skills and experience building modules adopted by other teams.
• Production Kubernetes experience, including Helm, GitOps workflows, and cluster lifecycle management.
• Experience owning production uptime, including on-call and incident command.
• Ability to evaluate AI opportunities and develop, monitor, and mature AI capabilities.
• Clear written communication and ability to write architecture proposals for varied audiences.
• Preferred: experience with multi-region deployments or EU data residency requirements.
• Preferred: familiarity with Crossplane, kgateway, or similar platform-engineering tools.
• Preferred: experience building internal developer platforms or command-line interfaces.

Responsibilities

• Set and document platform architecture across AWS, GCP, and Azure.
• Define SLOs for core platform services and lead major incident response.
• Operate EKS clusters, including capacity planning, node and pod density, graceful shutdown, and developer access.
• Build and maintain reusable Terraform modules for RDS, S3, and IAM.
• Operate and improve the internal AI gateway using LiteLLM and Langfuse; evaluate and onboard models, and develop cost reporting, guardrails, and request policies.
• Maintain parity between US and EU environments for data residency.
• Design logging and metrics pipelines using OpenSearch, Sumo Logic, and S3 archival.
• Improve resource hygiene through lifecycle policies, orphaned-resource cleanup, and accurate tagging.
• Mentor DevOps and backend engineers, review designs, and develop self-service tools.
• Run proofs of concept and prototype solutions, evaluating costs and delivering effective options.

Skills

Work schedule

Industry

Relocation