-
View all jobs
Position: LLM - AI Quality Analyst Personalization - Italian
Type: Hourly contract
Compensation: $11 - $15/hour
Location: Remote
Commitment: 30 40 hours/week
Role Responsibilities
Type: Hourly contract
Compensation: $11 - $15/hour
Location: Remote
Commitment: 30 40 hours/week
Role Responsibilities
- Evaluate AI model responses for personalization quality including grounding, integration, and helpfulness
- Design and execute multi-turn prompts based on personal context to test AI capabilities
- Analyze responses for hallucinations, incorrect personalization, and flawed inferences
- Perform side-by-side (SxS) comparison of model outputs to determine quality and effectiveness
- Write clear and structured rationales for response evaluations and rankings
- Provide detailed feedback and annotations to improve AI model performance
- Maintain strict data hygiene and ensure accurate documentation of evaluations
- Strong proficiency in Italian with excellent reading and writing skills
- Experience in data annotation, AI evaluation, content moderation, or similar roles
- Strong analytical thinking with the ability to evaluate nuanced AI responses
- Ability to design creative multi-turn prompts based on personal context
- Excellent written communication and attention to detail
- Full-time availability with flexibility and ability to overlap with PST time zone
- Bachelor s degree or equivalent experience in a relevant analytical field
- Apply/Easy Apply and check email for application form
- Fill Google form
- Assessment Link (After shortlisting)
- Screener
- 1/3 assessments mandatory
- Language vetting
Key Skills
Ranked by relevance
ai
Related Jobs
3 roles aligned with this opportunity
View Job Details
Related
Chief Operating Officer
2026-05-27
Full-time
Not Applicable
Switzerland
Internet Marketplace Platforms
Management
View Job Details
Related
Full-Stack Software Developer (Angular, .NET, MS SQL Server, CI/CD) - Wealth & Investment Platform
2026-05-28
Full-time
Not Applicable
Ireland
Software Development
Management
View Job Details
Related
Data Annotator | Remote
2026-05-27
Contract
Associate
Australia
Online Audio
Management
Login to Apply
- Posted
- Jun 05, 2026
- Type
- Contract
- Level
- Associate
- Location
- Switzerland
- Company
- Crossing Hurdles
Industries
Information Services
Translation
Localization
Writing
Editing
Categories
Management
Manufacturing
Related Jobs
3 roles aligned with this opportunity
View Job Details
Related
Chief Operating Officer
2026-05-27
Full-time
Not Applicable
Switzerland
Internet Marketplace Platforms
Management
View Job Details
Related
Full-Stack Software Developer (Angular, .NET, MS SQL Server, CI/CD) - Wealth & Investment Platform
2026-05-28
Full-time
Not Applicable
Ireland
Software Development
Management
View Job Details
Related
Data Annotator | Remote
2026-05-27
Contract
Associate
Australia
Online Audio
Management