Medior DevOps Engineer - Databricks

Job summary

Build and operate a cybersecurity data platform that ingests, aggregates, and enriches quality and security findings from multiple tools, helping teams understand security posture and prioritize risks. Develop data pipelines, models, and dashboards using technologies including Python and Databricks, while ensuring data quality, reliability, observability, and collaboration with platform and application engineering teams.

Benefits

Qualifications

• Strong Python programming skills and familiarity with software engineering practices.
• Experience with data engineering concepts, including ingestion, transformation, orchestration, and data serving.
• Familiarity integrating APIs, event streams, databases, and messaging platforms.
• Experience with Databricks, including Delta Lake, Structured Streaming, Unity Catalog, Databricks Workflows, and Medallion Lakehouse patterns.
• Experience operating Databricks in production, including workspace configuration, security, governance, monitoring, cost optimization, and performance tuning.
• Experience with Infrastructure as Code and platform automation using Terraform, Bicep, or similar tools.
• Experience deploying and operating containerized workloads with Docker and Kubernetes, AKS, or equivalent platforms.
• Understanding of platform reliability engineering, including monitoring, alerting, logging, troubleshooting, and incident management.
• Familiarity with GraphQL, schema-first APIs, graph-based data models, or Neo4j is beneficial.
• Interest in or experience with AI and LLM-driven analytics is beneficial.
• Interest in or exposure to security-related data domains is beneficial.

Responsibilities

• Build large-scale pipelines to ingest, aggregate, and enrich findings from multiple tools.
• Deliver prioritized, actionable lists of security and quality findings.
• Design data models that enable analysts to use processed data.
• Ensure data quality and reliability.
• Create insights and dashboards.
• Collaborate with DevOps, application engineering, and platform teams on shared pipelines and contracts.
• Make data flows observable, debuggable, transparent, and measurable.
• Own data from source discovery through insight delivery.

Skills

Degrees

Work schedule

Industry

Relocation