Jobs / All Cares
Senior Databricks DevOps Engineer
All Cares · Tysons, VA, United States
Tysons, VA, United StatesFull timeExp: 8+ yrsOnsite
Remuneration
Medical, dental, and vision insurance; 401(k) with company match; paid time off and federal holidays; professional development, training, and certification reimbursement
Location
Tysons, VA, United States
Visa sponsorship
No visa sponsorship
U.S. citizens
Job summary
The Senior Databricks DevOps Engineer designs and operates secure, reliable, enterprise-scale Lakehouse platforms for data engineering, analytics, and machine learning teams. The role manages cloud workspaces using Terraform, builds CI/CD and environment-promotion workflows, administers Unity Catalog and access controls, optimizes compute and cost, and monitors production operations. It also supports MLOps with MLflow and compliance with applicable frameworks such as FedRAMP, NIST 800-53, FISMA, HIPAA, or SOC 2.
Benefits
Medical insuranceDental insuranceVision insurance401(k) with company matchPaid time offFederal holidaysProfessional developmentTrainingCertification reimbursement
Qualifications
- At least 3 years of hands-on Databricks project experience
- 8+ years of experience in DevOps, cloud infrastructure, or platform engineering
- Strong experience with Terraform and the Databricks Terraform Provider
- Expertise in at least one of Azure, AWS, or GCP, including networking, IAM, and storage
- Experience building CI/CD pipelines for data platforms
- Proficiency in Python, Bash, or PowerShell; familiarity with the Databricks REST API and CLI
- Understanding of Apache Spark, Delta Lake, and Lakehouse architecture
- Hands-on experience administering Unity Catalog and data governance
- Knowledge of Git workflows and branching strategies
- Strong communication skills
Responsibilities
- Design, deploy, and manage Databricks workspaces on AWS, Azure, or GCP using infrastructure as code
- Build and maintain CI/CD pipelines for notebooks, jobs, Delta Live Tables, ML models, and libraries
- Administer Unity Catalog, including governance, access controls, lineage, and audit logging
- Configure and optimize clusters, SQL warehouses, policies, and job compute
- Implement network isolation, secrets management, SCIM provisioning, SSO, and role-based access controls
- Develop monitoring and alerting for platform health, performance, and cost
- Automate development, test, and production environment promotion and enforce release and change-management standards
- Support MLOps workflows using MLflow, Model Registry, and Model Serving
- Troubleshoot platform and pipeline issues and lead production incident root-cause analysis
- Partner with data, security, and architecture teams; mentor engineers and maintain technical documentation
- Support compliance with applicable regulatory requirements
Skills
AWSAzureAzure DevOpsAzure MonitorBashBicepCloudFormationCloudWatchDatabricksDatadogDockerGCPGitGitHubGitHub ActionsGitLabGitLab CIGrafanaIAMJenkinsKubernetesPowerShellPythonRESTSparkTerraform
Certifications
Databricks Certified Data Engineer ProfessionalDatabricks Platform AdministratorAWS DevOps Engineer – ProfessionalHashiCorp Terraform Associate
Degrees
Bachelor's degree in Computer Science, Information Technology, Engineering, or a
Industry
GovernmentRegulated industriesCloud and data platforms
Security clearance
Public TrustSecret
Relocation
No