Jobs / Tesco
Senior Data Platform Engineer
Tesco · Welwyn Garden City, ENG, United Kingdom
Welwyn Garden City, ENG, United KingdomRemote
Remuneration
Not specified
Location
Welwyn Garden City, ENG, United Kingdom
Visa sponsorship
Not specified
Job summary
The Senior Data Platform Engineer will build and maintain a robust data platform for advanced analytics, machine learning, and GenAI solutions to enhance security defenses. This role involves collaborating with data teams, contributing to architecture, and mentoring junior members. Key responsibilities include designing data architectures, implementing data integration and transformation frameworks, and applying automation and DevOps practices.
Benefits
Annual bonus scheme up to 20% of base salaryHoliday starting at 25 days plus a personal day (plus Bank holidays)Private medical insurance26 weeks maternity and adoption leave at full pay (12 months service required)13 weeks Statutory Maternity Pay or Statutory Adoption Pay6 weeks fully paid paternity leaveFree 24/7 virtual GP serviceEmployee Assistance Programme (EAP)Access to experts for mental wellbeing support
Qualifications
- Solid programming experience with Python and proficiency in SQL.
- Experience building data platforms on cloud services like Databricks on Azure or GCP BigQuery.
- Experience with big data technologies like Spark and Flink.
- Solid grasp of Kubernetes, CI/CD, and Terraform.
- Working knowledge of ETL and ELT frameworks.
- Working knowledge of orchestration tools like Airflow and dbt.
- Ability to provide clear input, guide, and empower junior team members.
- Familiarity with machine learning and AI tools is desirable.
- Knowledge of cybersecurity principles and practices.
Responsibilities
- Build and maintain a robust data platform for advanced analytics, machine learning, and GenAI solutions to strengthen security defenses.
- Collaborate with cross-functional data teams to ensure the platform is scalable, secure, and aligned with cybersecurity goals.
- Contribute to data platform architecture and mentor junior team members to deliver high-quality data services.
- Design, build, and manage real-time, near real-time, and batch data architectures supporting threat detection, incident response, and reporting.
- Implement and manage automated frameworks for integrating data from security sources into the security data lake.
- Implement data transformation frameworks to move data between raw, trusted, and curated data layers.
- Produce high-quality code, conduct thorough peer reviews, and provide constructive feedback to improve codebase quality.
- Implement automation and DevOps practices to streamline deployment, configuration, and management of data platform components.
- Collaborate with various departments and effectively communicate technical concepts and solutions.
Skills
AirflowAzureBigQueryDatabricksdbtGCPKubernetesPythonSparkTerraform
Languages
PythonSQL
Relocation
No