AI Evaluation & Annotation Specialist (Entry-Mid Level) - Italian (US)

Job Description

Job Title: AI Evaluation & Annotation Specialists

Location: Remote

Description: This is a hands-on, production-based role focused on training and improving Large Language Models (LLMs) by reviewing AI-generated responses, providing corrections, and evaluating quality based on structured guidelines. No engineering background is required, but strong problem-solving, language analysis, and structured task completion skills are essential.

What You'll Do

• Review and rate AI-generated responses for clarity, correctness, and relevance.
• Annotate and label content according to project-specific guidelines.
• Follow and consistently apply detailed written instructions.
• Generate or evaluate prompts.
• Collaborate with QA Leads for feedback and improvement.
• Report completed work daily and meet productivity and quality standards.
  
  

What Makes You a Strong Fit

• Detail-oriented with a focus on accuracy.
• Ability to follow and consistently apply instructions.
• Comfortable working independently with minimal supervision.
• Strong reading comprehension and critical thinking skills.
• Clear communication and professional response to feedback.
• Experience in annotation, evaluation, translation, linguistics, or QA is helpful but not required.
  
  

Schedule & Work Expectations

• Role aligned with specific QA and project schedules.
• Availability during a specified shift window (PST, e.g., 9:00 AM to 6:00 PM).
• Standard expectation: One consecutive 8-hour shift or two 4-hour shifts (both within the allowed schedule).
• Only logged, approved hours are paid.
• No paid holidays / no paid time off model.
  
  

Location Restrictions:

Applicants cannot reside in: Argentina, Bolivia, Brazil, Canada, Chile, China, Colombia, Cuba, Ecuador, Iran, Iraq, North Korea, Mexico, Panama, Russia, Sudan, Syria, Ukraine (Crimea, Luhansk, Donetsk), United Kingdom, Venezuela.

Why Join

• Work with a global team.
• Entry point into the AI and language technology industry.
• Exposure to real-world AI model training.
• Skill development in annotation, QA/evaluation, and structured AI tasks.
• Opportunity for growth in AI data work, linguistic evaluation, QA, or model training roles.
  
  

Compensation Range

Rate: $10.00 USD to $14.00 USD per hour (varies by language and experience level).

Requirements

• Assessment: A short, unpaid skills-based assessment is mandatory.
• Fluency in Italian, with strong written and verbal communication skills.
• Bachelor's degree in Linguistics, Computer Science, or a related field; or equivalent experience.
• Experience or interest in AI, Machine Learning, or data annotation preferred.
• Strong attention to detail and ability to work with complex data sets.
• Familiarity with translation and localization processes is an advantage.
• Ability to work independently and collaboratively in a fast-paced environment.
• Proficient in using Artificial Intelligence and data annotation tools, with a willingness to learn new technologies.