Jobs / OnePlan Solutions
Quality Assurance Automation Engineer - AI
OnePlan Solutions · AB, Canada
AB, CanadaExp: 2-4 yrsRemote
Remuneration
Not specified
Location
AB, Canada
Visa sponsorship
Not specified
Job summary
As a QA Automation Engineer - AI at OnePlan, you will ensure the quality and performance of AI-powered features by designing and maintaining automation frameworks. This role involves collaborating with various teams to validate AI outputs and championing quality practices throughout the development lifecycle.
Benefits
Comprehensive health, dental, and vision benefitsAdditional insurance optionsEmployer RRSP and 401K matching programs
Qualifications
- Proficiency with automation tools and frameworks
- Experience testing AI/ML-integrated features
- Strong analytical and critical-thinking skills
- Hands-on experience with LLM evaluation techniques
- Familiarity with Microsoft Azure AI services
- Experience with data-driven testing approaches
- Understanding of responsible AI principles
- Proficiency in JavaScript for scripting test utilities
Responsibilities
- Design, build, and maintain automation frameworks for testing AI features
- Develop and execute test strategies for validating AI model outputs
- Perform functional, regression, performance, and scalability testing on AI-driven features
- Collaborate with AI engineers, data scientists, product managers, and UX designers
- Identify, document, and track defects in AI behavior
- Champion quality and responsible AI practices throughout the development lifecycle
- Build and maintain CI/CD-integrated automation pipelines
- Participate in team stand-ups, sprint planning, retrospectives, and continuous improvement activities
Skills
AzureAzure DevOpsGitHubGitHub ActionsJavaScriptJiraREST
Degrees
Bachelor’s degree in Computer ScienceEngineeringOr a related technical field
Relocation
No