Senior AI Platform Engineer – LLM Gateway

Job summary

The Senior AI Platform Engineer will help implement and evolve a corporate LLM Gateway for a strategic generative AI project in the banking sector. The role involves integrating cloud platforms and systems, and deploying LLM inference APIs in production using AWS, Python, API gateways, and infrastructure-as-code practices. It also supports platform security, CI/CD, and observability.

Qualifications

• More than 6 years of experience in platform engineering, cloud, systems integration, or API management
• At least 1 year of experience with AI Gateways
• Experience with production LLM inference APIs
• Strong knowledge of AWS and Python
• Experience with API gateways, OAuth2/OIDC, JWT, and secrets management
• Experience with Terraform or other Infrastructure as Code tools
• Knowledge of CI/CD and observability
• AWS Bedrock, AgentCore, OpenAI, Kubernetes, Amazon EKS, and banking experience are valued

Responsibilities

• Help implement and evolve a corporate LLM Gateway platform
• Deploy and support LLM inference APIs in production
• Integrate cloud platforms, systems, and API management capabilities
• Contribute to infrastructure automation, CI/CD, and observability

Skills

Industry

Relocation