Jobs / Siemens
Senior Agentic AI DevOps Engineer
Siemens · Kitchener, ON, Canada
Kitchener, ON, CanadaExp: 4+ yrs110,000-160,000 CAD/yearlyHybrid
Remuneration
$110,000–$160,000 CAD, plus eligibility for an annual discretionary bonus of 10% and health and wellness benefits
Location
Kitchener, ON, Canada
Visa sponsorship
Not specified
Job summary
Operate and scale a developer platform for agentic AI, enabling teams to build trustworthy, measurable systems for industrial operations software. The role covers Kubernetes and GPU infrastructure, CI/CD and Terraform automation, and LLM operations such as prompt versioning, A/B testing, and agent evaluation. It also ensures platform reliability, observability, governance, and cost efficiency, including support for NVIDIA NeMo and NIM inference workloads.
Benefits
Annual discretionary bonus eligibility of 10%Health and wellness benefitsGlobal mobility
Qualifications
- Master’s degree or equivalent experience in Computer Science, Robotics, Artificial Intelligence, Software Engineering, Automation Engineering, or a related field.
- At least 4 years of hands-on DevOps and/or backend engineering experience.
- Strong production experience with Kubernetes, including networking and operations.
- Knowledge of Linux administration, containers, images, and container registries.
- Hands-on Terraform experience and understanding of Infrastructure as Code.
- Experience designing, implementing, and operating CI/CD pipelines.
- Experience with Kubernetes monitoring and observability.
- Knowledge of IAM and RBAC concepts.
- Experience with AWS services and cloud-native deployment.
- At least one DevOps project focused on LLM operations or agentic AI operations.
- General knowledge of commercial and open-source LLMs, their trade-offs, and prompt engineering.
- Experience with LangChain, LangGraph, or similar agent orchestration frameworks.
- Experience with LangSmith, Langfuse, or similar agent observability and evaluation tools.
Responsibilities
- Deploy, operate, maintain, and support the Agentic AI Developer Platform.
- Build and operate Kubernetes infrastructure, including networking, scaling, and GPU scheduling for agent workloads and NVIDIA NeMo and NIM inference.
- Design and operate CI/CD pipelines and deployment automation for agents, services, prompts, and skills.
- Manage prompt templates, versioning, A/B testing, agent-flow evaluation, and skill primitives.
- Implement monitoring, tracing, and observability for agentic systems and platform infrastructure.
- Use Terraform to provision governed infrastructure and enable developer self-service.
- Establish IAM, RBAC, governance, and compliance for AI workloads.
- Optimize compute, storage, and inference costs while maintaining performance and reliability.
- Maintain platform uptime and scalability, troubleshoot production issues, and improve platform architecture and operations.
- Collaborate with platform architects, product, data science, and security teams.
Skills
AWSIAMKafkaKubernetesLinuxTerraformDockerGrafanaJavaOpenTelemetryPrometheusPython
Degrees
Master’s degree or equivalent experience in Computer Science, Robotics, Artifici
Industry
Industrial operations softwareManufacturing
Relocation
No