Senior DevOps Engineer – GenAI Platform & Azure Cloud (100%)

Job summary

The Senior DevOps Engineer helps design, build, and operate a modern GenAI platform on Azure, collaborating with data scientists, business engineers, and DevOps specialists. Responsibilities include managing cloud and Kubernetes resources as infrastructure as code, automating LLMOps build and release pipelines, implementing monitoring and alerting, supporting client integrations, and developing platform features. The platform uses services such as Azure OpenAI, AI Search, Document Intelligence, AKS, and Langfuse, with tools and languages including Terraform, Helm, GitLab, Python, and Java.

Qualifications

• Strong experience with DevOps toolchains, including Git, GitLab, Docker, and Terraform.
• In-depth knowledge of Azure services, including API Management, AKS, Azure Functions, OpenAI, AI Search, Document Intelligence, Foundry, and Storage Accounts.
• Experience with monitoring tools such as Prometheus, Grafana, and Azure Monitor, as well as logging and alerting systems.
• Project experience with GenAI technologies, including RAG and Agentic AI, and experience optimizing GenAI solutions is preferred.
• Ability to develop architecture concepts and present them to IT security and domain architecture stakeholders.
• Understanding of authentication and authorization using Azure Entra ID, RBAC, and OAuth.
• Software development experience with Python and/or Java.
• Good German and English language skills.

Responsibilities

• Configure and manage Azure cloud resources and Kubernetes applications as infrastructure as code using Terraform, Helm, and GitLab.
• Automate build, test, and release processes for GenAI applications across development, test, and production environments.
• Develop technical concepts for new platform requirements and contribute to ongoing platform evolution and optimization.
• Implement monitoring and alerting using tools such as Grafana and Azure Dashboard.
• Support client applications with technical guidance, onboarding, integrations, and operational issues.
• Monitor system performance, availability, and logs to detect and resolve problems.
• Develop platform capabilities for authorization checks, logging, monitoring, routing, and guardrail validation using Java, Python, XML, and C# APIM policies.
• Coordinate platform designs with enterprise and regulatory requirements, IT security, and domain architecture.

Skills

Languages

Work schedule

Industry

Contract length

Relocation