Jobs / Cen***
Data Platform Engineer
Cen*** · Walnut Creek, CA, United States
Visa sponsorship details are locked. Unlock company name and apply link with .
Walnut Creek, CA, United StatesExp: 4-7 yrs120,000-150,000 USD/yearlyOnsite
Remuneration
120,000-150,000 USD/yearly
Location
Walnut Creek, CA, United States
Visa sponsorship
Sponsors visa
Job summary
Cen*** is seeking a Data Platform Engineer to design, implement, and operate a modern cloud-based Enterprise Data Platform, focusing on Databricks and CI/CD pipelines.
Qualifications
- Hands-on experience with Databricks in production environment
- Strong experience with CI/CD pipelines and Git-based workflows
- Strong experience with Infrastructure as Code and orchestration tools
- Experience implementing automated tests and quality gates in CI/CD pipelines
- Ability to partner effectively with data engineers, analytics engineers, architects, and security teams
Responsibilities
- Design and implement CI/CD pipelines for data ingestion and transformation projects
- Orchestrate Databricks jobs and workflows end-to-end
- Integrate automated testing into CI/CD
- Implement FinOps best practices for cost monitoring and allocation
- Automate platform operations for Databricks and related services
- Implement and maintain identity and access management for Databricks
- Provide patterns, templates, and reusable modules for onboarding new projects
- Continuously evaluate and improve tooling, pipelines, and platform architecture
- Define the code promotion process to minimize impacts across domains
- Manage end-to-end orchestration using managed Airflow
Skills
AirflowAzureAzure DevOpsBashDatabricksdbtGitGitHubGitHub ActionsGitLabGitLab CIIAMPowerShellPythonTerraform
Degrees
Bachelor’s degree in Computer Science, Information Technology, or related field
Relocation
No