AI DevOps Engineer (all genders)

Job summary

AEB is seeking an AI DevOps Engineer to simplify and accelerate IT systems for customers, focusing on software for foreign trade, customs, export control, and logistics. The role involves operating and developing a self-hosted LiteLLM Gateway, integrating Azure AI Foundry, and automating applications using CI/CD practices and Infrastructure as Code. The position emphasizes the operation and enablement of an AI platform rather than model training or data science.

Benefits

Qualifications

• Enthusiasm for IT, AI, and scalable technical solutions that create real value.
• Experience with AI platforms and tools like AI Foundry, LiteLLM, Open WebUI, or n8n.
• IaC practice (ideally modular, reusable components).
• Experience operating containerized platforms (Kubernetes) and building CI/CD.
• LLMOps experience, e.g., with RAG systems, inference workloads, drift/quality monitoring, guardrails/policies, and cost metrics.

Responsibilities

• Operate and develop self-hosted LiteLLM Gateway as central access to LLMs (including key, budget, and policy mechanisms).
• Integrate Azure AI Foundry into the platform concept (access, observability, governance) for product operation of agents and models.
• Automate and operate applications using CI/CD practices and Infrastructure as Code (e.g., GitLab CI, Helm/ArgoCD).
• Establish observability (metrics/logs/tracing), SLOs, and incident processes for AI services.
• Support internal users with templates, runbooks, and self-service for platform usage.
• Develop the AI Platform further, including MCP Server, coding tools, and agent registry.

Skills

Travel

Industry

Relocation