Lead Software Engineer - AWS - Lead AI/ML Platform Engineer

Job summary

As a Software Engineer in the Firmwide AI/ML Deployment Platform team, you will design and develop cloud-native solutions that support model deployment across the organization. You will work closely with data scientists and engineers to deliver features that streamline production workflows. Your contributions will help scale our platform to meet the needs of diverse internal clients, ensuring reliability and innovation.

Qualifications

• Knowledge of AWS services and cloud-based infrastructure
• Experience building resilient software platforms
• Proficiency in architecting software solutions at scale
• Ability to design solutions with strategic insight
• Familiarity with monitoring tools, especially for AI/ML model monitoring
• Proficiency in Golang
• Experience with AWS Sagemaker for model training and deployment
• Familiarity with Kubernetes and managing deployments to EKS
• Knowledge of networking concepts such as Virtual Private Clouds and DNS
• Experience working with LLMs
• Experience with Terraform or other Infrastructure as Code tools
• Experience in API development and design

Responsibilities

• Build and deploy infrastructure solutions for seamless integration of control plane and client accounts
• Develop and implement APIs for platform functionalities such as automated retraining, scheduling, endpoint deployments, and autoscaling
• Design robust features to support a growing internal customer base, including multi-region and disaster recovery capabilities
• Architect and implement model monitoring solutions, with emphasis on LLM monitoring and automated issue correction
• Engage with clients to identify strategic solutions and provide deployment and debugging support
• Assist in implementing platform capabilities aligned with product requirements
• Deploy infrastructure and develop managed environments for platform operations

Skills

Languages

Industry

Relocation