Note: The job is a remote job and is open to candidates in USA. Rex.zone is hiring a Remote, Full-Time AI Training Specialist to support production AI training pipelines. The role involves creating high-quality training data and evaluation signals across NLP and computer vision, including various evaluation tasks and content safety labeling.

Responsibilities

• Produce labeled datasets for NLP tasks such as named entity recognition, text classification, summarization, and instruction-following
• Perform RLHF tasks: preference comparisons, rubric-based ratings, and consistency checks
• Run LLM evaluation and prompt evaluation for accuracy, helpfulness, harmlessness, and policy compliance
• Conduct QA evaluation, audits, and adjudication to improve training data quality and reduce label noise
• Apply annotation guidelines compliance, document edge cases, and propose clarifications to playbooks
• Support computer vision annotation (bounding boxes, polygons, segmentation, keypoints) when needed
• Perform content safety labeling (hate, harassment, self-harm, sexual content, violence) aligned to policy
• Collaborate with project leads on inter-annotator agreement, drift, throughput, and quality metrics

Skills

• Experience with data labeling, QA evaluation, RLHF, or LLM evaluation in production/high-throughput environments
• Strong written English for rubric-based judgment and prompt evaluation
• Familiarity with NLP concepts (NER, classification) and/or computer vision annotation
• Ability to follow precise guidelines and handle sensitive content for safety labeling

Company Overview

• RemoExperts is a global platform where skilled professionals and tutors contribute to AI training across video, image, audio, text, code, math, and more. It was founded in 2025, and is headquartered in Palo Alto, California, US, with a workforce of 201-500 employees. Its website is https://www.remoexperts.com.

Apply To This Job