Note: The job is a remote job and is open to candidates in USA. Productive Playhouse is a global data company specializing in language and data services. They are seeking detail-oriented Australian English speakers to participate in an AI LLM evaluation project, which involves interacting with AI chatbots and rating the interactions.

Responsibilities

• Speak to AI (using voice mode on the mobile app), using the predefined starting prompt, pursuing the pre-defined conversation goal
• Rate the interaction on your laptop
• Follow the provided instructions to achieve the task goals
• Voice mode interactions and evaluations must be performed with accuracy, completeness, and attention to quality

Skills

• Proficient (C2 CEFR) in English used in Australia (en_au)
• Strong comprehension of English (read and write)
• All participants must have, or be willing to create, an Upwork account
• A Gmail account is required for project communication and access
• You must use your own smartphone and be able to install (free) chatbot apps
• You must use your own laptop
• Candidates should be comfortable and prepared to meet varying conditions (such as quiet or noisy settings, indoors or outdoors)

Company Overview