Position: LLM – AI Quality Analyst (Personalization) – VietnameseType: Short-Term ContractLocation: RemoteCommitment: Full-time (30–40 hours/week, 4-hour overlap with PST)Engagement Length: 2 monthsStart Date: ImmediateRole ResponsibilitiesDesign multi-turn conversational prompts (1–5 turns) using personal contextEvaluate personalized AI responses for grounding, integration, and helpfulnessAssess correct usage of personal data and identify flawed inferences or hallucinationsReview integration quality to ensure personalization feels natural and not over-narratedConduct side-by-side (SxS) evaluation and ranking of model responsesIdentify personalization errors, reasoning gaps, and grounding issuesWrite clear, structured rationales referencing specific conversation turnsExtract and verify “Debug Info” to confirm correct data source utilizationMaintain strict data hygiene by deleting evaluation conversationsRequirementsVietnamese proficiency (reading and writing)Strong experience in data annotation, AI quality evaluation, content moderation, or related rolesStrong analytical skills for evaluating nuanced and ambiguous AI outputsExperience with creative prompt engineering and multi-turn conversationsUnderstanding of personalization concepts and AI response evaluationHigh attention to detail for SxS comparisonsExcellent written communication and feedback documentation skillsBS/BA degree or equivalent experience in a relevant fieldWillingness to use a primary personal Google account with enabled personal data sourcesSelf-motivated and able to work independently in a remote setupDesktop/laptop with reliable internet connection#J-18808-Ljbffr Remote Skills: Analysis Skills, Artificial Intelligence (AI), Debugging Skills, Detail Oriented, Documentation, Laptop PC, Training Data Sets, Writing Skills About the Company: Crossing Hurdles