Technical Expert | Remote
Crossing HurdlesCanada7 days ago
ContractRemote FriendlyInformation Technology, Research
Track This Job
Add this job to your tracking list to:
- Monitor application status and updates
- Change status (Applied, Interview, Offer, etc.)
- Add personal notes and comments
- Set reminders for follow-ups
- Track your entire application journey
Save This Job
Add this job to your saved collection to:
- Access easily from your saved jobs dashboard
- Review job details later without searching again
- Compare with other saved opportunities
- Keep a collection of interesting positions
- Receive notifications about saved jobs before they expire
AI-Powered Job Summary
Get a concise overview of key job requirements, responsibilities, and qualifications in seconds.
Pro Tip: Use this feature to quickly decide if a job matches your skills before reading the full description.
Position: PhD Rater
Type: Part-Time
Compensation: $50–$100/hour
Location: Remote
Commitment: 30+ hours/week (primarily weekdays)
Role Responsibilities
- Design challenging, real-world STEM benchmark problems in domains such as data science, machine learning, finance, and software engineering.
- Implement tasks within an agentic development environment using Python.
- Create reproducible problem setups with clear specifications and executable tests.
- Evaluate and analyze AI model behavior, including reasoning traces and agent workflows.
- Diagnose reasoning failures, logic gaps, and problem-solving limitations in AI systems.
- Contribute to improving benchmark quality and evaluation frameworks for frontier AI models.
Requirements
- Active or recently graduated PhD.
- Deep expertise in data science, machine learning, finance, and/or Python-based software development.
- Strong research background in advanced STEM topics.
- Ability to commit reliably for 30+ hours per week.
- Demonstrated technical output such as high-quality open-source contributions or research work.
- Ability to analyze agent behavior traces and diagnose failures beyond surface-level errors.
Application Process
- Upload resume
- Interview
- Submit form
Key Skills
Ranked by relevanceReady to apply?
Join Crossing Hurdles and take your career to the next level!
Application takes less than 5 minutes