Observability Engineer

Job summary

The Observability Engineer role focuses on enhancing monitoring and observability solutions for Local and Central Government applications. Key responsibilities include configuring monitoring agents, managing platform maintenance, designing monitoring solutions, and collaborating with stakeholders to improve service effectiveness using tools like Splunk and Datadog.

Qualifications

• Proven experience in an Observability Engineer, Monitoring Specialist, SRE, or Platform Engineer role.
• Strong knowledge of monitoring, logging, and alerting across industry standard tools like Splunk, Datadog or similar.
• Hands-on experience instrumenting applications with metrics, logs, and traces.
• Strong understanding of infrastructure (on-prem and/or cloud).
• Networking basics.
• Database technologies.
• API integrations.
• Ability to analyse complex systems and communicate clear, actionable recommendations.
• Experience with automation (PowerShell, Python, Terraform).

Responsibilities

• Configure agents, collectors, and monitoring probes.
• Manage upgrades, patches, and platform maintenance.
• Maintain platform availability and performance.
• Continuously evaluate alerting thresholds, dashboards, log retention policies, and data quality.
• Design monitoring solutions for modern technology and application implementation.
• Refine monitoring standards and onboarding processes.
• Create application, database and server monitors based on new requirements from products or customers.
• Provide inputs to refine monitoring thresholds and improve existing policy standard.
• Ensure monitoring meets security and compliance requirements.
• Ensure new implementation integrates with existing ISM tools, reporting dashboards, etc.
• Drive continual service improvement initiatives.
• Review monitoring effectiveness.
• Identify monitoring gaps.
• Recommend new observability capabilities.
• Engage with application owners, infrastructure teams, and service managers to understand operational needs.
• Support knowledge transfer and create documentation to upskill teams on observability usage and maintenance.

Skills

Security clearance

Relocation