Senior AI QA Engineer

Job Title: Senior AI QA Test Engineer – Agentic GenAI

We are seeking a Senior AI - QA Test Engineer with extensive experience in AI/ML Quality Engineering, specializing in Agentic GenAI systems, evaluation frameworks, observability, and reliability testing. You will ensure the quality and consistent performance of our enterprise-scale AI ecosystem across Snowflake, AWS, and Azure.

Responsibilities

· Design and implement QA strategies for LLM, RAG, and Agentic AI pipelines.

· Develop automated test suites for agentic workflows, LLM applications, APIs, and vector-search systems.

· Validate retrieval workflows, reasoning behavior, grounding quality, and reduce hallucination tendencies.

· Build evaluation pipelines with robust metrics and regression frameworks (covering grounding, hallucination risks, and retrieval evaluation).

· Implement AI observability: telemetry, drift monitoring, quality dashboards.

· Integrate automate...