All roles

Open role

Rubrics Evaluator (Professional experience)

Remote · Portugal Full-time

##

Role Overview

Mercor is seeking experienced enterprise professionals to contribute to an AI evaluation and benchmarking project with a leading AI lab. Contributors will help assess the quality of AI-generated responses, reasoning, and decision-making across complex business and operational scenarios. This opportunity is ideal for professionals with strong analytical judgment and experience navigating enterprise environments such as consulting, finance, law, operations, manufacturing, engineering, or related domains. ##

Key Responsibilities

- Evaluate AI-generated outputs using structured rubrics and scoring frameworks - Assess qualitative and quantitative reasoning across enterprise-focused scenarios - Review business, operational, legal, financial, or strategic analyses for accuracy and clarity - Identify gaps, inconsistencies, or weak reasoning in AI-generated content - Provide written justification and feedback to support evaluation decision ##

Ideal Qualifications

- Professional degree in a relevant field such as business, law, finance, engineering, operations, or a related discipline - 4+ years of experience in an enterprise environment - Background in areas such as consulting, finance, legal operations, manufacturing, operations, engineering, or corporate strategy - Strong quantitative and qualitative reasoning skills - Availability through Tuesday, May 19th - Excellent written communication and attention to detail - Comfortable evaluating complex business and operational scenarios independently ##

Application Process

- Make sure your Mercor profile reflects your latest work experience - Selected applicants may complete a short evaluation exercise - Qualified contributors will be contacted with next steps and project details Apply To this Job

More open positions

Application Evaluator

Work from home Full-time role

Part-Time Evaluator, Data Analytics- Remote

Work from home Full-time role

Part-Time Hotel Phone Sales Evaluator

Work from home Full-time role

AI Map Evaluator (English)

Work from home Full-time role

Program Evaluator

Work from home Full-time role

Value Based Coder II

Work from home Full-time role

ABA Technician at Home/Part time - Larned, KS

Work from home Full-time role

Remote Nurse Practitioner (NP/APRN) – Personal Injury Evaluations - Arizona

Work from home Full-time role

[Remote] Staff Software Engineer – AI Platforms & Infrastructure

Work from home Full-time role

Remote Customer Experience & Travel Concierge Agent – Commission-Based Opportunity with Full Training, Flexible Hours, and Industry Credentials

Work from home Full-time role

Closer (REMOTE)

Work from home Full-time role

Specifying Spanish Bilingual Representative (Remote)

Work from home Full-time role

[Remote] Sr. DevOps Engineer

Work from home Full-time role

Analyst, Visa Crypto Solutions

Work from home Full-time role

Content Creator Job in Digital Brand Campaign, Real Veterinarian, Female, Age 18+ - Real Veterinarian

Work from home Full-time role

Remote - Insurance Sales Representative (P&C)

Work from home Full-time role

Senior Software Engineer (Platform & Infrastructure)

Work from home Full-time role

Reverse Mortgage Originator Development Program

Work from home Full-time role

Arquitecto de Infraestructura (Remoto)(Exp en Banca) K526

Work from home Full-time role

Ed-Tech Specialist - LMS Expert

Work from home Full-time role

IRB and Data Privacy Contractor

Work from home Full-time role