-
SuperAnnotate

QA Engineer/Code Evaluator – AI Chatbot Response Evaluations (PHP)

SuperAnnotate
Turkey · Contract · Mid-Senior

Role Overview:

We are seeking a detail-oriented QA Specialist with strong PHP experience to audit evaluation work performed by Data Annotators assessing AI-generated code. You will review ratings for instruction-following, factual correctness, and functional validation. Your work will help maintain high-quality standards in AI training datasets.


Responsibilities:

  • Audit annotator evaluations of AI-generated PHP code responses.
  • Ensure annotators follow guidelines accurately in assessing instruction-following and code correctness.
  • Test proof-of-work code snippets submitted by annotators to verify output, functionality, and security.
  • Identify logical flaws, incomplete evaluations, or misapplied rubric criteria.
  • Deliver structured and helpful feedback to improve evaluation quality.
  • Collaborate with QA leads to ensure consistency in review processes.


Required Qualifications:

  • 7+ years of professional experience with PHP development or technical QA.
  • Strong understanding of PHP syntax, logic, and server-side scripting practices.
  • Experience with web debugging, backend testing, and functional validation.
  • Familiarity with frameworks like Laravel, Symfony, or plain PHP scripting.
  • Strong documentation and written communication skills.
  • English proficiency at B2, C1, C2, or Native level.


Preferred Qualifications:

  • Experience with annotation QA or model training workflows.
  • Familiarity with AI-generated code evaluation, RLHF, or prompt-based testing.
  • Understanding of security best practices and PHP error handling.


Contract Type: Freelance/Contract/Part-Time


Why Join Us?

Become part of an innovative team at the forefront of AI technology. Your QA expertise will play an essential role in creating accurate, reliable, and safe AI solutions.Fully remote with flexible hours and milestone-based structure. Competitive compensation based on project deliverables.


If you are an experienced QA specialist or code reviewer with strong skills and a keen eye for detail in evaluating AI-generated content, we encourage you to apply.


#PHP #QA #AI #CodeReview #LLM #RemoteJobs #BackendDevelopment #TechHiring

Key Skills

Ranked by relevance

ai php symfony laravel server
Login to Apply
Posted
Apr 09, 2025
Type
Contract
Level
Mid-Senior
Location
Türkiye

Industries

Software Development Data Infrastructure Analytics IT Services IT Consulting

Categories

Quality Assurance Engineering Information Technology

Related Jobs

3 roles aligned with this opportunity

View all jobs
View Job Details
SuperAnnotate
Related

QA Engineer/Code Evaluator – AI Chatbot Response Evaluations (PHP)

2025-04-09

Contract
Mid-Senior
Romania
Software Development
Quality Assurance
View Job Details
SuperAnnotate
Related

WebUI developer for LLM Data Training

2025-05-15

Contract
Mid-Senior
Ukraine
Information Services
Engineering
View Job Details
SuperAnnotate
Related

Website Annotation & Frontend Developer (English-Speaking) – Project-Based Opportunity

2025-02-06

Part-time
Not Applicable
Norway
Technology
Engineering