Note: The job is a remote job and is open to candidates in USA. OneDigital is a forward-thinking company that is revolutionizing client services through innovative technology. They are seeking an AI Quality Assurance Analyst to ensure the reliability and accuracy of AI-powered applications, collaborating closely with engineers and product managers to maintain high quality standards.

Responsibilities

• Design and execute test plans for AI-powered applications across both output quality and functional behavior
• Evaluate AI responses for accuracy, consistency, hallucination, and edge case handling
• Test application workflows, UI behavior, and integrations across internal and client-facing tools
• Identify, document, and track defects using standard issue tracking tools (e.g., Jira or equivalent)
• Partner with AI Builders and Product Managers to define acceptance criteria and quality standards for AI features
• Develop and maintain repeatable test cases and QA documentation as AI applications evolve
• Conduct regression testing as applications are updated or new features are released
• Collaborate with the Principal Engineer and product team to surface quality risks early in the build process
• Contribute to defining what “good” looks like for AI output quality at OneDigital, helping shape internal QA standards for LLM-based applications
• Support testing across multiple business lines including Employee Benefits, Retirement, Wealth, and P&C

Skills

• Strong ability to evaluate AI-generated outputs for quality, accuracy, and appropriateness
• Experience writing and executing test cases and documenting defects clearly
• Comfort working in no-code and low-code environments
• Strong written communication skills, with the ability to describe issues precisely and concisely
• Curiosity and adaptability in a fast-moving, emerging technology space
• Ability to work independently and manage multiple testing workstreams at once
• Bachelor's degree or equivalent experience
• Prior experience in a QA role within a software, SaaS, or technology-adjacent environment
• Familiarity with issue tracking tools (e.g., Jira, Linear, or similar)
• Understanding of AI governance, data privacy, and responsible AI considerations
• Experience in a QA, testing, or quality-focused role, with some exposure to AI or LLM based products preferred
• Familiarity with prompt-driven systems and an intuition for how language models can fail or produce unexpected results
• Exposure to AI or LLM-based tools, either professionally or through independent exploration

Benefits

• Variable compensation, commission, and/or annual bonus based on your individual performance and/or the company’s performance
• Health, wellbeing, retirement, and other financial benefits
• Paid time off
• Overtime pay for non-exempt employees
• Robust learning and development programs
• Reimbursement of job-related expenses per the company policy
• Employee perks and discounts

Company Overview

Company H1B Sponsorship