AI Platform Engineer (all genders)

Job summary

Develop and operate a sovereign LLM platform, ensuring cost control, data protection, and monitoring. Automate deployments, manage infrastructure, and shape the architecture of platform and AI services.

Responsibilities

• Develop and operate a sovereign LLM platform including OpenAI-compatible gateway, model serving, and GPU infrastructure
• Implement custom knowledge connections (RAG) with vector databases, embeddings, and reranking
• Ensure cost control, tenant separation, data protection, and guardrails
• Establish monitoring and observability for performance, quality, and usage of AI services
• Operate and further develop the container-based platform based on Docker, Coolify, and Kubernetes
• Automate deployments and manage CI/CD processes for in-house developments
• Manage Linux, cloud, and database infrastructure ensuring stability, security, and availability
• Build and further develop monitoring, logging, and alerting solutions
• Actively shape the architecture of platform and AI services
• Establish infrastructure as code and standardized deployment processes
• Ensure data protection compliant and tenant-safe operating models
• Document solutions, share knowledge within the team, and evaluate new technologies in platform engineering and AI

Skills

Relocation