AI Platform Engineer (all genders)

Job summary

Develop and operate a sovereign LLM platform, implement customer-specific knowledge connections, and ensure cost control and data protection.

Responsibilities

• Develop and operate the sovereign LLM platform including OpenAI-compatible gateway, model serving, and GPU infrastructure
• Implement customer-specific knowledge connections with vector databases, embeddings, and reranking
• Ensure cost control, tenant separation, data protection, and guardrails
• Establish monitoring and observability for performance, quality, and usage of AI services
• Operate and further develop the container-based platform based on Docker, Coolify, and Kubernetes
• Automate deployments and manage CI/CD processes for in-house developments
• Maintain Linux, cloud, and database infrastructure ensuring stability, security, and availability
• Build and further develop monitoring, logging, and alerting solutions
• Actively shape the architecture of platform and AI services
• Establish infrastructure as code and standardized deployment processes
• Ensure data protection compliant and tenant-safe operating models
• Document solutions, share knowledge within the team, and evaluate new technologies in platform engineering and AI

Skills

Relocation