All roles

Open role

AI Trainer & Evaluator

Remote · Poland Full-time

Job Title: AI Trainer & Evaluator Job Type: Contractor Location: Remote Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. Key Responsibilities:

  • Evaluate and score AI-generated responses using well-defined rubrics and metrics across diverse subject areas.
  • Annotate and categorize data sets to improve AI model accuracy and reliability.
  • Apply keen attention to detail in reviewing content for relevance, coherence, and factual accuracy.
  • Provide clear, actionable feedback on AI performance to inform ongoing model improvements.
  • Collaborate with the customer's team to interpret guidelines and contribute to rubric refinement.
  • Document findings and maintain meticulous records of annotations and evaluations.
  • Engage in critical reading and analysis of complex subject matter ranging from business and finance to marketing, healthcare, and legal domains.

Required Skills and Qualifications:

  • Exceptional attention to detail and accuracy in data annotation and content evaluation.
  • Strong critical reading and analytical skills with the ability to interpret and apply rubrics.
  • Proficiency in written and verbal communication; ability to articulate nuanced feedback clearly.
  • Bachelor’s degree required.
  • Experience in evaluating or scoring large volumes of content against detailed criteria.
  • Experience with AI training, machine learning data annotation, or related tasks is highly valued.
  • Ability to work independently and collaboratively in a fully remote environment.

Preferred Qualifications:

  • Background in business, finance, legal, marketing, healthcare, or research fields.
  • Prior experience in AI training, human-in-the-loop systems, or quality assurance of AI-generated content.
  • Familiarity with industry-standard annotation tools or AI evaluation platforms.

More open positions

Computer & Information Systems Specialist - AI Trainer

Work from home Full-time role

AI Training Generalist (No Prior Experience Needed) - Freelance AI Trainer Project

Work from home Full-time role

Developer - AI Trainer

Work from home Full-time role

English (U.S. Native) AI Trainer & Evaluator (Remote, Hourly Contractor)

Work from home Full-time role

[Remote] AI Training Experts - Maryland, US

Work from home Full-time role

Workday HRIS Analyst - Remote, must be based in PST or MT

Work from home Full-time role

Vice President, Head of Alternatives – Sammons Financial Group Asset Management

Work from home Full-time role

Clinical Trial Manager

Work from home Full-time role

Medical Cannabis Program Manager (SOS Temporary)

Work from home Full-time role

Data Scientist - Latin America - Remote

Work from home Full-time role

Remote Legal Transcriptionist

Work from home Full-time role

Sr Specialist, SAP Change Engagement

Work from home Full-time role

TikTok Content Creator

Work from home Full-time role

Analista de Garantia da Qualidade II - Automações

Work from home Full-time role

Virtual Interview Scheduler – Remote US Shift (English Required)

Work from home Full-time role

Telephony Analyst

Work from home Full-time role

Part Time Contract Recruiter (Early Childhood Education)

Work from home Full-time role

Account Executive

Work from home Full-time role

Crimson Water Research Program Director - Enterprise, AL - 529724

Work from home Full-time role

Data Engineer – GCP

Work from home Full-time role

Vendor Manager-Remote

Work from home Full-time role