All roles

Open role

Audio Generalist Evaluator Expert

Remote · Norway Full-time

Mercor is seeking detail-oriented writing experts to contribute to a high-impact audio AI research project with a leading lab. Freelancers will author prompt–golden answer pairs that train and evaluate advanced language models. This is a short-term, flexible opportunity for professionals with strong academic backgrounds and a knack for instructional clarity. Ideal for those who enjoy distilling complex concepts into well-crafted text.

  • * *

###

Job Details:

- Design and Optimize Prompts: Create detailed audio prompts with multiple constraints and instructions. - Define and Document Evaluation Standards: Establish high-level expectations for correct responses in general audio consumer contexts, and develop comprehensive rubric. - Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations. - Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks. ###

Minimum Qualifications:

- BS or BA from a reputable institution completed or in progress - Strong writing and critical thinking skills. - Ability to work independently and meet deadlines. - Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies / general interests. ###

Preferred Qualifications:

- 2+ years of experience in teaching or research. ###

Application & Onboarding Process:

- Complete an AI-led interview, this should take around 15 minutes. - Complete a 45-minute written assessment that will guide you through writing rubrics. - If selected, you will be invited to work on the project. ###

More Details About This Role:

- Expect to contribute at least

20 hours per week

. - Expect a commitment of around 1 month. - You’ll be working in a structured project environment with clear goals and tools.

More open positions

Lead Evaluator, Early Learning (Part-Time)

Work from home Full-time role

Product Owner (RangeOS) Remote / Telecommute Jobs

Work from home Full-time role

Product Manager | Fully Remote US

Work from home Full-time role

Senior Product Manager, Supplemental ELA (Remote, US)New Remote - US

Work from home Full-time role

Website Product Owner

Work from home Full-time role

Remote Data Entry Associate – Part‑Time, No Experience Required – Flexible Home‑Based Role at careerzynith

Work from home Full-time role

Experienced Accounts Receivable Data Entry Specialist – Remote Opportunity with careerzynith

Work from home Full-time role

Provider Services Lead Analyst - Cigna Healthcare - Remote

Work from home Full-time role

Quantitative Analyst; Fully Remote

Work from home Full-time role

Hiring Now: FULL TIME Join Concentrix Work From Home: Remote

Work from home Full-time role

Referral Support Specialist

Work from home Full-time role

Bilingual Customer Advocate

Work from home Full-time role

Experienced Customer Experience Champion – ThriveCart's Customer Support Team

Work from home Full-time role

[Remote] Specialist, Content Developer (Social Studies)

Work from home Full-time role

Senior Auditor (Licensed CPA)

Work from home Full-time role

[Remote] Product Designer

Work from home Full-time role

Senior Software Engineer, Windows/Desktop Applications - Nashville, TN, USA

Work from home Full-time role

[Remote] Senior Manager, Product Planning - Air Job Details | BCD

Work from home Full-time role

Experienced Chat Support Representative - Work from Home Opportunity at careerzynith

Work from home Full-time role

Senior Technical Product Manager (Agentforce), Remote

Work from home Full-time role

Lead Digital Health Strategist- Midwest

Work from home Full-time role