Jobs / Avenga
Observability Platform Engineer
Avenga · London, ENG, United Kingdom
London, ENG, United KingdomExp: 5+ yrsOnsite
Remuneration
Not specified
Location
London, ENG, United Kingdom
Visa sponsorship
Not specified
Job summary
Design, build, and operate a telemetry and monitoring platform for a large-scale distributed environment. Develop OpenTelemetry and Apache Kafka pipelines, run Prometheus monitoring and Alertmanager/PagerDuty alerting, and enable historical telemetry analytics with Apache Iceberg, Amazon Athena, S3, and AWS Glue. Partner with engineering teams to improve instrumentation, define reliability objectives, and strengthen incident response.
Qualifications
- At least five years of experience in DevOps, SRE, platform, or observability engineering.
- Hands-on experience with OpenTelemetry Collector configuration, instrumentation, and OTLP.
- Strong knowledge of Prometheus and PromQL, including recording rules, alerting rules, and exporters.
- Practical experience with Alertmanager and PagerDuty for alert routing, escalation, and on-call management.
- Experience with Apache Kafka, including topics, partitions, consumer groups, Kafka Connect, and performance tuning.
- Experience with Apache Iceberg or similar open table formats such as Delta Lake or Apache Hudi.
- Experience querying and optimizing data in Amazon Athena, with knowledge of Amazon S3 and AWS Glue.
- Understanding of distributed systems, microservices, and cloud-native architectures.
- Scripting or programming skills in Python, Go, or Bash.
- Strong troubleshooting skills and an automation-first mindset.
- Intermediate English proficiency or higher.
Responsibilities
- Design and maintain OpenTelemetry pipelines for metrics, logs, and traces, including SDKs, auto-instrumentation, and Collector configurations.
- Build and operate Kafka streaming pipelines to ingest, transform, and route telemetry.
- Run and scale Prometheus, including exporters, service discovery, recording rules, and long-term storage.
- Configure alert routing, grouping, inhibition, escalation policies, and on-call schedules with Alertmanager and PagerDuty.
- Build and maintain Apache Iceberg tables for historical telemetry and operational analytics, including partitioning, schema evolution, compaction, and retention.
- Enable self-service querying and reporting with Amazon Athena, Amazon S3, and AWS Glue Data Catalog.
- Partner with engineering teams to improve instrumentation and define SLIs, SLOs, and error budgets.
- Reduce alert noise and improve MTTD and MTTR through better signals, runbooks, and automation.
- Contribute to incident response and post-incident reviews, applying lessons to sustained improvements.
Skills
AthenaAWSBashCortexAWS GlueGoGrafanaHelmKafkaKafka ConnectKubernetesLokiMimirAmazon MSKOpenTelemetryPagerDutyPrometheusPythonS3SparkTempoTerraformThanos
Languages
English
Relocation
No