Software Engineer 1 - (Python, Kubernetes, AWS)

Job summary

The Software Engineer 1 role is centered on developing and maintaining AI infrastructure to enhance customer capabilities, ensuring access to high-quality LLMs across the inference software stack. Responsibilities include procuring and testing inference models, creating in-house services for consistent high-quality inference, and collaborating with teams to integrate LLM-powered tools. Key technologies include Python, Kubernetes, and AWS.

Qualifications

• Experience with Python and/or other modern programming languages
• Familiarity with Argo CD and/or other CI/CD frameworks
• Experience with Kubernetes/Helm
• Familiarity with AWS or other cloud service providers

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to our user base
• Develop in-house services and techniques to guarantee continual high-quality inference service for our customer
• Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage
• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer
• Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs

Skills

Degrees

Security clearance

Relocation