AI Automation Test Analyst

Exciting opportunity for AI Automation Test Analyst with expertise on Experience testing AI models for fairness, robustness, and performance.

#6 months contract

#Excellent rates

#Hybrid Working arrangements

About the Role

We are seeking an experienced Senior Test Analyst to join a high-performing delivery team within the Digital Design and Innovation Branch. This role is responsible for designing, building, and executing robust test automation frameworks across UI, API, and end-to-end testing, with a strong focus on enterprise-scale Salesforce platforms.

Key Responsibilities

• Design, develop, and maintain automation frameworks for UI, API, and E2E testing
• Deliver full-stack automation testing across complex digital applications
• Execute test automation for Salesforce CRM platforms
• Collaborate closely with developers, business analysts, and product teams
• Collaborate closely with technology delivery teams to provide end-to-end test automation capability, ensuring the delivery of high-quality, reliable, and scalable digital solutions
• Ensure high-quality releases through effective defect tracking and test management
• Contribute to continuous improvement of automation practices and tools
• Support the Manager, QA Automation in advancing testing capabilities and maturity across the Digital Design and Innovation Branch.
• Verify and validate that the developed solutions meet acceptance criteria and quality standards, including usability, performance, and reliability across web applications, internal systems, and digital platforms.

Preferred Qualifications and Experience

Hands on experience on automation testing experience

• Strong coding ability, able to write production-quality test code in Java, or JavaScript/TypeScript
• Strong hands-on experience with Selenium Java, Node.js, Playwright, Typescript
• Hands on experience with AI testing tools
• Solid understanding of machine learning concepts, data validation and AI ethical practices.
• Strong analytical abilities to interpret complex test data and excellent communication to translate AI insights into actionable quality goals.
• Proven experience in full-stack testing within the education domain
• Strong Experience in Salesforce test automation
• Expertise in UI, API, and End-to-End automation framework setup
• Hands-on experience with Postman, SoapUI,
• Proficient in Jira for test management and defect tracking
• Expertise in bitbucket & Azure DevOps CICD pipeline
• CI/CD pipeline experience, specifically with bitbucket and Azure DevOps.
• Ability to configure jobs, pipelines, and integrate test execution into build workflows
• Strong communication skills, able to articulate technical issues to the non-technical stakeholders in easy-to-understand ways
• Skilled in using JIRA/Xray Test Management Tool

Desirable Qualifications and Experience

• Experience with Prompt Engineering or Retrieval-Augmented Generation (RAG).
• Familiarity with LLM-based automated evaluation frameworks
• Familiarity with Playwright MCP
• Experience testing AI models for fairness, robustness, and performance.

What’s on Offer

• 6‑month contract with potential for extension
• Opportunity to work on meaningful digital transformation initiatives
• Hybrid working environment
• Supportive, collaborative team culture

How to Apply

If you’re an experienced AI Tester available for your next contract, Please send your CV to [email protected] .we’d love to hear from you. Apply now with your resume, or contact us for a confidential discussion.