About the Project This project focuses on the technical review and validation of coding tasks used to train AI models. Coding challenges are generated automatically by AI, and your role is to evaluate quality of the challenge. The core questions you will be answering on every task: Are the requirements well defined? Are the associated tests correctly validating the requirements? Tests are treated as the mechanism of truth in this context. Mistakes here propagate at scale into AI systems — error criticality is high. Languages Tasks in this project involve code written across multiple languages. You will be expected to review and evaluate tasks in any of the following: Python JavaScript / TypeScript Go Rust Java

Responsibilities

Evaluate whether the coding task itself is clearly and correctly defined Validate whether tests accurately reflect whether the problem has been solved Determine whether a solution that passes the tests genuinely solves the underlying problem Apply strict technical criteria and quality standards consistently across tasks Required Profile This role is designed for mid/senior-level software engineers with real professional experience. Technical requirements Proven professional experience in software development (production environments) Experience reviewing and evaluating code written by other engineers Solid understanding of automated testing — how tests validate (or fail to validate) behavior Experience contributing to or working with open source projects High attention to detail and strong technical judgment Comfortable working fully in English (reading and writing) Nice to have Experience with test-driven development (TDD) or test design Familiarity with large or complex codebases Project Details This is expert, task-based technical work focused on analysis, validation, and judgment — not code production.

Compensation

USD 60-80 per hour. ~5-10 hours per week. Ready to participate? Start your paid interview now About Terac Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets. Learn more at terac.com or on YouTube at @jointerac.