Note: The job is a remote job and is open to candidates in USA. Prolific is a leading company in the AI space, focused on building a vast pool of quality human data. They are seeking Data Scientists and Data Analysts to join their Expert Network to help train and evaluate cutting-edge AI models using real technical expertise.

Responsibilities

• Evaluate LLM Responses: review AI-generated data insights and statistical analysis for accuracy, clarity, and completeness
• Fact-Check Technical Claims: use authoritative references to validate mathematical proofs, statistical formulas, and data-driven conclusions
• Validate Code & Outputs: execute data-related scripts (e.g., Python/R) to ensure they produce correct results and handle edge cases properly
• Annotate Model Performance: identify strengths and weaknesses in how a model reasons through data problems or builds predictive models
• Ensure Alignment: verify that model responses follow specific system guidelines and maintain a high standard of professional technical behavior

Skills

• Education: a BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field
• Professional Experience: real-world experience in data analysis, predictive modeling, or machine learning engineering
• Technical Rigor: the ability to solve complex statistical problems and interpret high-level data visualizations independently
• Analytical Mindset: strong attention to detail with the ability to identify subtle logical fallacies in statistical reasoning or data interpretations
• LLM Fluency: significant experience using LLMs to assist with data workflows, with a clear understanding of where these models typically hallucinate or fail
• Communication: the ability to explain complex mathematical concepts or data insights clearly and concisely
• A PayPal account to receive payment from our clients
• Programming: proficiency in Python (Pandas, NumPy, Scikit-learn) or R
• Data Querying: advanced SQL for complex data extraction and manipulation
• Visualization: experience with tools like Tableau, PowerBI, or Matplotlib/Seaborn
• Modeling: deep understanding of Machine Learning frameworks (PyTorch, TensorFlow) and statistical modeling techniques

Benefits

• Paid study participants
• Competitive pay rates
• Flexible hours
• Ability to work from home

Company Overview

Company H1B Sponsorship