Open role
[Remote] AI Research Evaluation Specialist – Critical Analysis
Note: The job is a remote job and is open to candidates in USA. LinguaSenseAI is seeking an AI Research Evaluation Specialist to contribute to their AI research efforts. The role involves evaluating AI-generated responses and providing structured feedback to ensure quality assessments.
Responsibilities
- Evaluate AI-generated responses
- Provide structured written feedback
- Apply detailed evaluation guidelines to assess response quality
- Contribute to AI research through accurate and consistent evaluations
Skills
- Strong analytical and written communication skills
- Ability to work independently and follow detailed task guidelines
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning
- Ability to write clear, precise, and well-evidenced written rationales beyond surface-level observations
- Consistent and honest judgment with the ability to provide critical assessments when warranted
- Strict attention to detail and accurate application of structured evaluation guidelines
- Ability to work entirely without AI writing tools
Company Overview