AI Quality Engineer

AI Quality Engineer — Banking (Urdu & Arabic only)

We are hiring an experienced AI Quality Engineer to ensure our AI systems are reliable, safe, and production-ready for banking and financial services. The role requires strong engineering skills, domain knowledge in banking, and fluency in Urdu and Arabic.

Key Responsibilities

• Design AI evaluation frameworks, experiments, and benchmarks tailored to banking use-cases.
• Perform API, UI, and end-to-end testing of AI-driven applications and integrations.
• Build scalable automation suites and testing pipelines using Python and automation tools.
• Conduct AI safety assessments, guardrail validations, and prompt-injection testing.
• Apply LLM-as-a-judge methodologies and benchmark model performance with robust metrics.
• Prepare high-quality fine-tuning and evaluation datasets; implement and maintain data pipelines.
  
  

Required Qualifications

• 5+ years in Software Engineering, Automation, or Machine Learning roles.
• Strong Python programming skills and hands-on experience building automation/test frameworks.
• Practical experience with LLMs (OpenAI, Claude, Gemini, or open-source models).
• Proven experience in the Banking/Financial Services domain and familiarity with domain-specific risks and regulations.
• Knowledge of AI evaluation metrics, data pipelines, and model benchmarking practices.
• Fluency in Urdu and Arabic is required.
  
  

Preferred Skills

• Experience with MLOps, dataset preparation, and fine-tuning workflows.
• Familiarity with security, privacy, and regulatory considerations for banking AI.
• Experience integrating test automation into CI/CD pipelines.
  
  

Why Join Us

Make a measurable impact on critical banking products by shaping the quality and safety of AI systems. Work with modern LLMs and scalable engineering practices in a collaborative team.

How to Apply

Please submit your resume and a brief summary of relevant projects demonstrating your AI quality and banking domain expertise.

Skills: qe,gemini,automation,sdet