All roles

Open role

[Remote] Prompt Engineer (Model Behavior & Evaluation)

Remote · Thailand Full-time

Note: The job is a remote job and is open to candidates in USA. Yuna Health is dedicated to transforming access to mental health support through empathetic conversational AI. The Prompt Engineer will be responsible for defining and evaluating AI conversation behaviors, collaborating with clinicians, and continuously improving the quality and alignment of conversations at scale.

Responsibilities

  • Own conversational behavior across a multi-agent, multi-model conversational system
  • Collaborate with clinicians to design and operate evaluation frameworks for conversational quality, empathy, usefulness, and alignment
  • Diagnose failures by analyzing real conversation traces, agent routing, memory usage, and system context
  • Use product data and qualitative review to prioritize high-impact improvements
  • Evaluate and select models across providers (e.g., OpenAI, Claude, Gemini, Vertex AI) based on task, cost, latency, and qualitative output Skills
  • Demonstrated experience owning model or agent behavior in production
  • Hands-on experience designing or operating evaluation systems (qualitative + quantitative)
  • Ability to define what “good” means and defend it with evidence, not vibes
  • Comfort working hands-on with tools like LangGraph, LangSmith, or comparable tracing and evaluation frameworks
  • High data literacy: able to reason from logs, traces, metrics, and analytics to isolate root causes
  • Clear communicator who can collaborate across product, clinical, and engineering teams in ambiguous problem spaces
  • Working knowledge of Python; ability to read, debug, and collaborate within agent logic and evaluation code
  • Familiarity with alignment concepts (e.g. human values, safety tradeoffs, refusal behavior)
  • Proficient with SQL, amplitude, and excel
  • Background in psychology, linguistics, neuroscience, education, or adjacent fields Benefits
  • Competitive salary (based on experience) + equity options
  • Remote-first culture with flexibility
  • A fast-growing, talented, and empathetic team dedicated to transforming mental health care
  • An opportunity to use AI for good
  • Level of ownership to make measurable impact, building cutting-edge AI systems that improve lives every day Company Overview
  • Our mission at Yuna is to radically transform the way mental health support is accessed and delivered. It was founded in undefined, and is headquartered in San Francisco, California, USA, with a workforce of 11-50 employees. Its website is

More open positions

Senior AI​/Computer vision engineer; AgeTech scale

Work from home Full-time role

AI/ML Engineer (Part-Time, Hybrid NLP + Classification)

Work from home Full-time role

ML Engineer - NLP

Work from home Full-time role

Front End Developer (HTML, CSS, JavaScript) | Remote - Sunnyvale, CA

Work from home Full-time role

Frontend Engineer, Dotcom

Work from home Full-time role

Regional Sales Manager, Surgical Wound Care - Central/Southwest

Work from home Full-time role

Senior Technical Sourcer – Motorsports & Performance Recruiting - Supporting Ford - (Remote, US)

Work from home Full-time role

Content Manager, Essential Elements Music Class (EEMC)

Work from home Full-time role

Drug Safety Physician

Work from home Full-time role

Architectural Services Project Manager - Chicago, IL

Work from home Full-time role

LPN / LVN - Remote Nurse (FT)

Work from home Full-time role

Junior Account Manager - Hospitality (Remote - US/EST Hours)

Work from home Full-time role

Head of SAP - Sales (w/m/d)

Work from home Full-time role

Content Moderator Jobs | Remote Entry Level | Help Create a Safe Online Space | Earn $25-$35/hr

Work from home Full-time role

Account Executive, SMB Sales - New Orleans

Work from home Full-time role

Licensed Property & Casualty Insurance Agent - Remote USA

Work from home Full-time role

Legal Assistant (Workers Compensation)

Work from home Full-time role

Medical Coding Auditor job at Fathom AI in US National

Work from home Full-time role

Graphic Designer

Work from home Full-time role

Remote Online Data Entry Specialist – Customer Service Operations Support at careerzynith

Work from home Full-time role

Licensed CNA

Work from home Full-time role