Data Labelling Analyst

Job Title: Data Labelling Analyst

Location: Dublin

Job Overview

We are currently hiring a detail-oriented and experienced Content Moderation & Quality Assurance Specialist to join our team on a contract basis. This role offers a unique opportunity to contribute to the development and continuous improvement of advanced AI-driven content moderation systems.

The successful candidate will play a critical role in training AI models, ensuring the accuracy and consistency of moderation decisions, developing quality benchmarks, and collaborating closely with external vendor partners. This position is well suited to someone who is passionate about quality, data integrity, and the responsible management of online content.

Please note: this role involves regular exposure to potentially sensitive or disturbing material, including graphic imagery, explicit language, and other objectionable content.

Key Responsibilities

• Quality Assurance: Review and assess AI-driven content moderation decisions to ensure accuracy, consistency, and compliance with established policies and guidelines.
• Golden Set Development: Create, maintain, and refine golden datasets to benchmark AI and vendor performance against defined quality standards.
• Vendor Calibration: Partner with vendor sites to identify performance gaps, deliver structured feedback, and implement calibration initiatives.
• Vendor Management: Build and maintain strong working relationships with external partners, providing performance insights, guidance, and ongoing support.
• Process Improvement: Identify opportunities to enhance moderation workflows, tools, and AI processes, collaborating with internal stakeholders to implement improvements.
• Data & Insights: Analyse performance metrics and trends to inform quality strategies and drive continuous improvement.
• Stakeholder Communication: Work closely with operations, policy, and leadership teams to ensure alignment on quality objectives and outcomes.
• Training & Development: Stay current with evolving policies, tools, and industry best practices through ongoing training.
• Sensitive Content Review: Handle and assess complex or sensitive content responsibly, applying sound judgement and policy knowledge.
• Operational Insight: Evaluate the broader societal impact of online speech and behaviour, testing assumptions and hypotheses within an operational context.

Required Experience & Skills

• Minimum of 4 years’ experience in content moderation, quality assurance, or a related field
• Strong understanding of content moderation policies, processes, and governance
• Excellent analytical, problem-solving, and communication skills
• High attention to detail with the ability to perform accurately in a fast-paced environment
• Ability to work both independently and collaboratively within cross-functional teams
• Experience working with external vendors or partners is highly desirable
• Familiarity with data analysis and reporting tools is an advantage

Nice to Have

• Hands-on experience with content moderation platforms or tools
• Knowledge of industry standards and best practices in moderation and QA
• Relevant certification in content moderation or a related discipline
• Experience reviewing AI-generated conversations
• Background in online customer support or chatbot environments

Working Conditions

• Office-based role
• Fast-paced environment with competing priorities and deadlines
• Regular exposure to graphic, explicit, or otherwise objectionable content

To hear more about this position or to discuss your suitability to please reach out to Nisha for a confidential chat on 01 632 5046 or email your CV to [email protected] Your CV will not be sent to any third party without your consent.

By applying here you agree to RECRUITERS storing your CV in our secure applicant tracking system (ATS; Bullhorn). As your consultants, we are dedicated to helping you find a new job in your field of expertise and, equally, to keeping your personal information secure at all times. Your CV will not be sent to any third party without your consent.