Software Engineer – LLM Code Quality Evaluator | Remote

Position: Software Engineering Expert

Type: Hourly contract

Compensation: $50–$150 per hour

Location: Remote

Commitment: Part-time availability with flexibility for increased hours

Role Responsibilities

• Review and refine AI-generated prompts, responses, and code
• Validate algorithms and software concepts for technical accuracy
• Provide structured, actionable feedback on solution quality and clarity
• Tag and organize content by topic, difficulty, or language
• Support benchmarking efforts to evaluate and compare model capabilities

Requirements

• Strong experience in software engineering, technical research, or educational content development
• Strong experience with debugging, testing, and validating code
• Proficiency in one or more programming languages such as Python, JavaScript, Java, or C++
• Ability to assess technical accuracy and communicate improvements clearly
• High attention to detail and comfort with technical documentation

Application Process (Takes 20 Mins)

• Upload resume
• Interview
• Submit form