Software Quality Engineer - AI Agent

Orion Innovation is a premier, award-winning, global business and technology services firm. Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity. We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Position Summary

We are seeking a highly skilled and innovative Software Quality Automation Engineer to join our team. The ideal candidate is passionate about building and maintaining scalable test automation frameworks using modern programming languages and automation libraries.

In this role, you will collaborate with a distributed engineering team to develop and enhance our client’s omni-channel communication platform, integrating cutting-edge AI capabilities. If you thrive in a fast-paced environment, enjoy solving complex technical challenges, and are eager to drive automation excellence, we’d love to hear from you!

Key Responsibilities

• Test Infrastructure & Automation:
• Design, build, and maintain data-driven test automation tools and frameworks using clean coding practices and functional programming methodologies.
• Support and enhance the test infrastructure for software systems and components.
• Integrate with CI/CD pipelines to establish a continuous build and test cycle.
• Set up and configure test environments to ensure reliable and scalable testing.
• Quality Assurance & Risk Analysis:
• Perform system analysis, risk assessment, and develop strong test strategies by reviewing product designs, technical specifications, and collaborating with product managers and developers.
• Conduct root cause analysis and debugging of product defects to improve software reliability.
• Process Improvement & Collaboration:
• Evangelize new testing methodologies, best practices, and tools to maximize test coverage through automation.
• Report, document, and communicate test failures effectively with development teams.
• Work closely with developers throughout the SDLC to embed quality into the development process.
  

Qualifications

• 3+ years of experience developing test automation frameworks and harnesses using programming/scripting languages.
• BS in Computer Science or equivalent practical experience.
  
  
  

Knowledge, Skills & Abilities

• Strong working knowledge of JavaScript/TypeScript.
• Extensive REST API testing & automation experience.
• Hands-on experience with Jest & Selenium.
• Proficient in SQL & relational databases.
• Deep understanding of QA methodologies, test planning, and system integration.
• Solid understanding of testing strategies for AI-driven systems and crafting AI evaluations, with a clear grasp of how testing approaches differ between traditional software and AI-based products (e.g., handling non-determinism, evaluating model accuracy, bias, explainability, etc.).
• Hands-on experience in testing and automating AI-powered products/features, including the ability to create and execute Python scripts (or similar) to evaluate AI performance and behavior.
  
  
  

Why Join Us?

• Work on innovative AI-driven communication solutions.
• Collaborate with a talented, globally distributed team.
• Opportunities for growth and skill development in automation & AI testing.
  
  
  

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC And Its Subsidiaries And Its Affiliates (collectively, “Orion,” “we” Or “us”) Are Committed To Protecting Your Privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) Explains

• What information we collect during our application and recruitment process and why we collect it;
• How we handle that information; and
• How to access and update that information.
  
  
  

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.