Job Description
About the Role
We are looking for a skilled and detail-oriented Quality Assurance Engineer with hands-on experience in AI/LLM testing, prompt evaluation, and test automation. In this role, you will be responsible for ensuring the quality, reliability, and performance of our AI-powered products and services. You will work closely with engineering and product teams to design robust testing strategies for large language models and ensure seamless end-to-end user experiences.
Key Responsibilities
Design, develop, and execute comprehensive test plans for LLM-based applications and AI systems
Perform prompt testing and evaluation to assess model accuracy, consistency, and safety
Build and maintain automated test frameworks for regression, functional, and E2E testing
Develop metrics and benchmarks to evaluate LLM outputs including relevance, coherence, and factual accuracy
Identify, document, and track defects through resolution, ensuring high-quality releases
Collabor...
We are looking for a skilled and detail-oriented Quality Assurance Engineer with hands-on experience in AI/LLM testing, prompt evaluation, and test automation. In this role, you will be responsible for ensuring the quality, reliability, and performance of our AI-powered products and services. You will work closely with engineering and product teams to design robust testing strategies for large language models and ensure seamless end-to-end user experiences.
Key Responsibilities
Design, develop, and execute comprehensive test plans for LLM-based applications and AI systems
Perform prompt testing and evaluation to assess model accuracy, consistency, and safety
Build and maintain automated test frameworks for regression, functional, and E2E testing
Develop metrics and benchmarks to evaluate LLM outputs including relevance, coherence, and factual accuracy
Identify, document, and track defects through resolution, ensuring high-quality releases
Collabor...
Ready to Apply?
Take the next step in your AI career. Submit your application to Euthyna today.
Submit Application