Job Description
Job Description
Job Description-
AI Evaluation & Test Engineer Job Summary We are looking for an AI Evaluation & Test Engineer to ensure that our generative AI models and applications are safe, accurate, trustworthy, and deliver elegant user experience. The test engineer will act as a customer of our AI systems, obsessing over quality, usability, and customer‑centric system behavior. This role is ideal for product‑minded engineering professionals passionate about shaping the behavior of AI systems in real‑world scenarios.
Key Responsibilities
Job Description-
AI Evaluation & Test Engineer Job Summary We are looking for an AI Evaluation & Test Engineer to ensure that our generative AI models and applications are safe, accurate, trustworthy, and deliver elegant user experience. The test engineer will act as a customer of our AI systems, obsessing over quality, usability, and customer‑centric system behavior. This role is ideal for product‑minded engineering professionals passionate about shaping the behavior of AI systems in real‑world scenarios.
Key Responsibilities
- Build and maintain AI evaluation pipelines to test and measure model behavior and system performance.
- Define AI quality metrics including factuality, faithfulness, grounding precision/recall, toxicity, latency, and cost.
- Develop automation for AI evaluation and regression testing at scale.
- Establish release gates in CI/CD alig...
Ready to Apply?
Take the next step in your AI career. Submit your application to HuntingCube today.
Submit Application