Note: The job is a remote job and is open to candidates in USA. Prolific is a leading company in the AI space, focused on building a substantial pool of quality human data. They are seeking Computer Science Specialists to join their Expert Network to assist in training and evaluating cutting-edge AI models by reviewing research papers and AI-generated content.

Responsibilities

• AI Evaluation & Ranking: comparing multiple AI-generated responses to technical prompts and ranking them based on accuracy, logic, and safety
• Scientific Review: reviewing CS research papers alongside AI-generated summaries and graphical abstracts to ensure scientific integrity
• Fact-Checking: identifying inaccuracies where the AI has misinterpreted technical data, formulas, or research findings
• RLHF (Reinforcement Learning from Human Feedback): providing the human "ground truth" to help models align with professional standards in software engineering and data science
• Code & Logic Verification: auditing AI-generated code snippets or architectural diagrams for structural and functional correctness

Skills

• At minimum, a BSc (Bachelor of Science) in Computer Science or a closely related technical field
• Ability to interpret research papers, understand complex algorithms, and review code logic
• High level of cognitive competency with a sharp eye for technical hallucinations or logical flaws
• A valid LinkedIn profile to verify your degree and background during the screening process
• A PayPal account to receive payment from our clients

Benefits

• Competitive pay rates
• Flexible hours
• The ability to work from home

Company Overview