Company Intro

At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains—from doctors and lawyers to physicists and engineers—and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages. We are a well-funded startup with an enviable portfolio of clients including Anthropic, Amazon, Microsoft, poolside, Recraft, and Shopify.

Recently, we secured strategic investment led by Bezos Expeditions with participation from Mikhail Parakhin, CTO of Shopify and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA, UK, the Netherlands, Israel, Czech Republic, Serbia, and more. We are headquartered in Amsterdam.

We’re hiring a Product Manager to own the end‑to‑end health of a two‑sided talent network -supply (freelancers) and demand (client teams). You’ll build the flows, policies, and incentives that improve time‑to‑match, fulfillment, and GMV, while keeping data and IP safe.

What you’ll do

• Define roadmap: segment buyer personas (data business, enterprise AI, research, startup eng teams) and supply cohorts (domain experts, annotators, prompt/eval engineers); plan category and geography expansion.
• Acquire & vet supply: design onboarding with identity/KYC, NDAs, work eligibility capture, skills taxonomy, language coverage, portfolio samples, and skills assessments (e.g., labeling guidelines, evaluation rubrics, safety policy comprehension).
• Matching & routing: build ranking that blends skills, availability, historical quality, language/domain fit, and rate; support team/“pod” assembly and bench management; reduce time‑to‑first‑offer for new experts.
• Payments & compliance: launch milestone escrow, invoicing, global payouts (e.g., split payments, tax forms), and rate cards; codify policy for IP assignment, data privacy, and sensitive content handling.
• Operate & iterate: instrument funnels, run A/B tests on matching, paywalls, and pricing; write crisp PRDs and experiment readouts; partner with Ops to balance utilization and margin.

Success looks like (example KPIs)

• Demand: ↑ GMV, fill rate, project launch rate, search‑to‑hire conversion, client NPS.
• Supply: ↑ expert activation → first earnings, retention, rehire rate, share of top‑badge experts; ↓ time‑to‑first‑match.
• Unit economics: healthy take rate, contribution margin per project, and efficient CAC for both sides.

Qualifications

• 5+ years of product management, including 2+ years on a labor/experts marketplace (e.g., staffing, services, or freelance networks).
• Strong analytical chops: funnel/retention/cohort analysis, experimentation; comfortable with SQL and partnering with Data Science.
• Working knowledge of LLM data operations (annotation guidelines, RLHF/preference data, red‑teaming, evaluations, multilingual workflows) and relevant formats/tools.
• Excellent product execution and stakeholder communication; you can turn ambiguous problems into a sequenced roadmap and ship iteratively.

Nice to have

• Background in talent ranking/matching, reputation systems, or workforce quality programs (badging, certifications).
• Knowledge of global payouts/tax/compliance (e.g., escrow, contractor classification).
• Experience integrating labeling/evaluation tools, storage (S3/GCS), and queues; familiarity with SDKs/CLI/REST design.
• Multilingual or domain expertise (e.g., legal/medical/finance) to reason about specialist work.

Example projects you might lead in your first 6–12 months

• Launch a Vetted Experts Program with skills tests, references, and tiered badges; improve new‑expert time‑to‑earnings by 40%.
• Implement milestone escrow + dispute resolution; cut refund rate while improving expert trust.
• Build supply/demand heatmaps and auto‑routing that improves fill rate in priority languages/domains.

Add LLM‑assisted QA and sampling dashboards; drive measurable gains in IAA and gold‑task pass rates.

What we can offer

• You’ll have the opportunity to work on highly innovative, projects at the leading edge of AI development, and work with a genuinely dedicated and dynamic team of experts;
• You’ll also be working on projects with customers that are AI industry leaders and household names;
• Personal and career development: we support employee’s ambition for professional development and encourage them to implement their ideas in their projects;
• Flexibility: we offer remote or hybrid employment. You will also design with your manager a workday that works best for you;
• Paid parental leave and sick leave;
• 25 vacation days per year.