Lead Data & AI Platform Engineer (Remote, United Kingdom)

Job summary

The Lead Data & AI Platform Engineer is tasked with designing and scaling platforms that enhance customer service, workforce optimization, and automation through data and AI. This role involves leading the architecture of the Databricks platform, optimizing data pipelines, and applying machine learning and NLP techniques to improve operational performance and customer outcomes across global markets.

Qualifications

• Hands-on experience with Databricks, Spark/PySpark, Delta Lake, and enterprise-scale data pipelines.
• Experience designing and operating Databricks lakehouse architectures and governed data products.
• Experience building and operating natural-language analytics experiences with Databricks Genie.
• Familiarity with Databricks governance, Unity Catalog, and CI/CD practices.
• Experience building batch and streaming ingestion pipelines from multiple enterprise systems.
• Proficiency in developing AI/ML solutions with Python, including NLP and Generative AI.
• Ability to evaluate AI-generated answers for accuracy and business usefulness.
• Experience building analytics solutions that provide insights for business users.

Responsibilities

• Lead architecture and evolution of the Databricks platform for customer operations and AI use cases.
• Design, build, and optimize scalable Databricks pipelines for trusted data products.
• Establish data architecture, modeling, quality, governance, and reliability standards using Databricks.
• Continuously improve Databricks Genie spaces with curated data domains and trusted metrics.
• Analyze operational data using Databricks AI capabilities to surface trends and insights.
• Collaborate with cross-functional teams to develop scalable data and intelligence solutions.
• Provide technical leadership through design reviews, coding, and platform optimization.
• Coach and mentor engineers and data scientists in data engineering and AI capabilities.

Skills

Relocation