Lead Software Engineer - AIML Data Platform (Data, Python, Containers/Kubernetes)

Job summary

The Lead Software Engineer role involves enhancing and delivering AI and Machine Learning Data Platforms, focusing on developing secure, high-quality production code and engineering high-volume data platforms using technologies like Spark, Ray, and Kafka. Key responsibilities include productionizing ML models, driving team adoption of AI-assisted engineering practices, and providing technical leadership across data projects while ensuring adherence to security and performance standards.

Qualifications

• Formal training or certification on software engineering concepts
• Hands-on practical experience delivering system design, application development, testing, and operational stability
• Demonstrable strength in a cloud-based, cloud-native engineering environment
• Advanced Python, with additional programming languages such as Java, Kotlin, or Scala a plus
• Deep distributed-systems fundamentals
• Production experience across data engineering and streaming platforms
• Practical ML engineering across inference, evaluation, monitoring, and deployment
• Real LLM delivery beyond prototypes
• Demonstrated experience leading effective use of approved AI-assisted software development tools
• Strong understanding of responsible AI use in engineering workflows
• Proficient in all aspects of the Software Development Life Cycle
• Advanced understanding of agile methodologies
• A proven record of leading technical delivery across teams

Responsibilities

• Executes creative software solutions across batch, streaming, ML, and LLM workloads
• Develops secure and high-quality production code
• Engineers high-volume data platforms
• Productionizes ML across repeatable training, evaluation, deployment, monitoring, and lifecycle management
• Builds LLM systems that hold up in production
• Drives team adoption of enterprise-authorized AI-assisted engineering practices
• Champions responsible AI use
• Leads evaluation sessions with external vendors, startups, and internal teams
• Identifies opportunities to eliminate or automate remediation of recurring issues
• Provides technical leadership on data projects

Skills

Industry

Relocation