DevOpsHunt
Jobs / Ret***

Senior Platform Engineer (Databricks)

Ret*** · London, ENG, United Kingdom
Visa sponsorship details are locked. Unlock company name and apply link with .
London, ENG, United KingdomHybrid
Remuneration
Not specified
Location
London, ENG, United Kingdom
Visa sponsorship
Sponsors visa

Job summary

The Senior Platform Engineer will design, build, and optimize the Databricks platform to support scalable, secure, and high-performing data solutions for analytics, machine learning, and AI. Key responsibilities include developing and maintaining batch and real-time data pipelines using Databricks, Spark, and Delta Lake, while collaborating with various teams to deliver impactful solutions.

Benefits

25 days annual leave (+ bank holidays)Extra day off for your birthdayPrivate medical insuranceHealthcare cash planMental health supportPaid volunteer daysCar purchase scheme

Qualifications

  • Proven experience building and supporting scalable, production-grade data platforms
  • Strong hands-on expertise with Databricks, Spark, Delta Lake, Python and SQL
  • Good understanding of cloud-based data engineering, ideally within Azure environments
  • Experience working with Infrastructure as Code tools such as Terraform, Bicep or similar
  • Solid understanding of data modelling, ETL/ELT processes, data quality, security and governance
  • Comfortable working with technical and non-technical stakeholders to deliver high-quality solutions

Responsibilities

  • Design, build and enhance the Databricks platform, ensuring it remains secure, scalable and reliable
  • Develop and maintain batch and real-time data pipelines using Databricks, Spark and Delta Lake
  • Contribute to platform architecture, engineering standards and best practices across the data estate
  • Collaborate with Product, Analytics and Data Science teams to deliver solutions that solve real business problems
  • Support platform operations, monitoring and optimisation to ensure high levels of performance and reliability
  • Share knowledge with colleagues and help drive continuous improvement across the engineering team

Skills

AzureBicepDatabricksdbtKafkaPythonSparkTerraform

Certifications

Databricks certifications

Degrees

Computer ScienceData Engineering

Relocation

No