ML Ops Engineer:in / Agent Ops Engineer:in

Job summary

DB Engineering & Consulting GmbH is seeking an ML Ops Engineer/Agent Ops Engineer in Berlin to manage the administration, quality assurance, monitoring, and optimization of AI agents and large language models.

Qualifications

• Several years of experience in operating LLM-based systems in production.
• Extensive knowledge in Python and/or TypeScript.
• Practical experience with CI/CD pipelines and Azure platform.
• Experience in administration and use of LLM observability and evaluation platforms.
• Ideally experienced with LangChain, Azure Monitor, agent frameworks, and Kubernetes.

Responsibilities

• Manage administration, quality assurance, monitoring, and optimization of AI agents and large language models.
• Support transitions to new LLM versions.
• Administer and utilize observability, evaluation, CI/CD, and deployment structures for AI agents.
• Facilitate knowledge transfer of operational and quality standards.
• Ensure compliance with established architectural standards and analyze deviations.
• Stay updated on new technologies and tools in LLMOps.
• Create and maintain reusable templates and self-service tools.

Skills

Degrees

Languages

Relocation