Jobs / Preply
Senior ML Platform Engineer (GenAI Platform)
Preply · London, ENG, United Kingdom
London, ENG, United KingdomExp: 5+ yrsRemote
Remuneration
Competitive financial package + equity + leave allowance + health insurance + paid on-call rotation
Location
London, ENG, United Kingdom
Visa sponsorship
Not specified
Job summary
Builds and evolves shared platform systems that enable product teams to develop, evaluate, deploy, and operate production GenAI workloads safely and at scale. The work includes a unified model gateway, traffic and cost controls, evaluation, observability, prompt lifecycle tooling, and security guardrails, while partnering with Applied Science, Data, Product, Security, and Engineering teams.
Benefits
A generous monthly allowance for lessons on Preply.comLearning & Development budgetTime off for your self-developmentEquityLeave allowanceHealth insuranceAccess to free mental health support platformsAccess to Gympass-partnered wellness and gym centers throughout London
Qualifications
- Proven track record (5+ years) designing, building and operating backend services or ML infrastructure handling production traffic.
- Strong Python skills and experience building developer-facing APIs/SDKs or shared libraries
- Practical experience with GenAI systems, including vector retrieval, external provider APIs, and common issues.
- Sound knowledge of distributed systems, including high availability, concurrency, caching and rate limiting.
- Experience with at least one major public cloud, its services and infrastructure (preferably AWS).
- Hands-on experience with distributed tracing, system telemetry, SLOs, and incident triage.
- Strong communication skills and at least C1 English level, plus willingness to join a paid on-call rotation.
Responsibilities
- Architect unified gateway with automated routing, quota controls, and resilient fallback systems across model vendors.
- Drive system efficiency and low latency via dynamic traffic management, response caching, token budgeting, and cost allocation controls.
- Establish robust evaluation mechanisms to guarantee high precision, stability, and safety in model outputs.
- Deliver system observability, providing deep tracing, performance telemetry, cost analytics, continuous monitoring, and alerting across GenAI lifecycles.
- Standardize prompt engineering workflows with automated versioning, automated testing, governance, and CI/CD integrations for production delivery.
- Embed platform guardrails alongside Security and Privacy experts to enforce policies, and safe production defaults automatically.
- Maintain sustainable incident response, blameless postmortems, and comprehensive monitoring for GenAI stacks.
Skills
AWSDatabricksPython
Languages
English (at least C1)
Work schedule
Paid on-call rotation
Industry
Ed-TechEducation
Relocation
No