Senior DevOps - Data Platform Infrastructure

Job summary

As a Senior Software Developer within the Data Platform's Infrastructure team, you will lead efforts to improve the reliability, cost efficiency, and platform enablement of both Snowflake and Databricks. You will own the operating model for these platforms, the infrastructure as code that deploys them, and the performance and operational practices that keep them healthy.

Qualifications

• Strong experience managing Databricks infrastructure at scale.
• Proven track record delivering reliability and observability for high-scale SaaS, including SLOs, alerts, and incident response.
• Advanced Python and SQL skills.
• Snowflake experience, including warehouse tuning, governance, and Terraform/DDL provisioning.
• Experience designing and operating a hybrid data platform that integrates Databricks and Snowflake.
• Strong Spark skills for tuning, partitioning knowledge, and improving performance of large jobs.
• Knowledge of security and governance best practices on both platforms.
• Delta Lake and lakehouse expertise, including experience with table formats, CDC, compaction, and storage layout optimizations.

Responsibilities

• Lead efforts to improve reliability, cost efficiency, and platform enablement for Snowflake and Databricks.
• Own the operating model, infrastructure as code, and performance practices for data platforms.
• Build and maintain infrastructure as code for the Data Platform, including Terraform modules, CI/CD pipelines, and change management.
• Own Snowflake and Databricks platform operations, governance, and lifecycle, including workspace and account design.
• Define cost management and collaborate with FinOps on forecasting and optimization for both platforms.
• Implement observability and operational readiness with monitoring, alerts, dashboards, runbooks, and on-call practices.
• Coordinate with product teams and vendors to monitor roadmaps and feature sets for Snowflake and Databricks, aligning platform capabilities with product needs.

Skills

Languages

Relocation