Python AI / Code Raters

About the Role

We are seeking highly skilled Python AI / Code Raters to evaluate and improve AI-generated code and technical outputs. This role involves assessing programming accuracy, machine learning reasoning, and software engineering best practices to help refine next-generation AI systems.

This opportunity is ideal for experienced software engineers, ML/AI practitioners, and technical reviewers who have strong analytical skills and enjoy code review, annotation, and quality evaluation.

Key Responsibilities

Model Quality Assessment

• Evaluate AI-generated outputs related to programming, ML/AI concepts, and technical reasoning
• Identify bugs, inefficiencies, security issues, and deviations from best practices
• Ensure outputs comply with defined technical and quality guidelines

Code Annotation & Labeling

• Annotate code snippets, algorithms, and technical documentation
• Follow project-specific annotation frameworks and instructions

Review & Feedback

• Provide clear, structured, and actionable feedback to improve model performance
• Identify edge cases, correctness issues, and quality gaps

Comparative Analysis

• Compare multiple AI-generated responses and rank them based on correctness, readability, efficiency, and coding standards

Data Validation

• Validate, clean, and correct datasets used for AI training and evaluation

Collaboration

• Work closely with data scientists and engineers to refine evaluation guidelines
• Help resolve ambiguities and contribute to overall quality strategy

Required Qualifications

Technical Background

• Strong foundation in software engineering, computer science, ML/AI, or a related technical field
• 5–10 years of professional experience in relevant roles

Programming Skills

• Python (mandatory)
• At least one additional language: JavaScript, TypeScript, Node.js, C, C++, Shell
• Bonus: Rust, Go, Ruby, Swift, PHP, Kotlin

Web Technologies

• API integration and web scraping
• HTML, CSS, JavaScript
• Web application development using frameworks such as Flask
• Familiarity with frontend (React) and backend (Node.js) development

Machine Learning & AI

• Machine learning fundamentals including model training and evaluation
• Deep learning frameworks: TensorFlow, PyTorch, Keras, JAX
• Natural Language Processing and transformer-based architectures
• Reinforcement learning techniques (PPO, DQN, A2C, Q-learning)
• Computer vision concepts including OCR, image processing, and deepfake detection
• Game AI fundamentals

Data Science & Engineering

• Data analysis and visualization using Pandas, NumPy, Matplotlib, Seaborn
• Database systems: SQL, NoSQL, SQLite

Algorithms & Software Engineering

• Strong understanding of algorithms and optimization techniques
• Version control using Git and GitHub
• Clean code principles, debugging, and design patterns

Soft Skills

• High attention to detail and ability to follow complex instructions
• Strong analytical and problem-solving skills
• Excellent written communication for technical feedback
• Proactive mindset and willingness to challenge assumptions to improve outcomes

Preferred Qualifications

• Experience evaluating AI or LLM-generated code
• Professional or academic code review experience
• Prior experience in data annotation or quality assurance roles
• Familiarity with multiple programming paradigms (object-oriented, functional)

How to Apply

Interested candidates may apply or share their profile with details on:

• Python and programming experience
• AI/ML exposure
• Code review or model evaluation experience

E- [email protected]

This role offers an opportunity to work on advanced AI systems while contributing to meaningful improvements in model quality and reliability.