AI Platform Engineer (all genders)

Job summary

The AI Platform Engineer role focuses on developing and operating a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure. Key responsibilities include implementing custom knowledge connections with vector databases, ensuring data protection and cost control, and managing CI/CD processes for in-house developments using technologies like Docker, Kubernetes, and Azure.

Responsibilities

• Develop and operate a sovereign LLM platform including OpenAI-compatible gateway and GPU infrastructure
• Implement custom knowledge connections with vector databases and embeddings
• Ensure cost control, data protection, and compliance
• Establish monitoring and observability for AI services
• Develop and maintain a container-based platform using Docker and Kubernetes
• Automate deployments and manage CI/CD processes
• Maintain Linux, cloud, and database infrastructure for stability and security
• Build and enhance monitoring, logging, and alerting solutions
• Actively shape the architecture of platform and AI services
• Establish Infrastructure as Code and standardized deployment processes
• Ensure data protection compliant operational models
• Document solutions and share knowledge within the team

Skills

Relocation