Job Description
Job Summary:
We are looking for an AI Evaluation & Test Engineer to join our growing team to ensure that our generative AI models and applications are safe, accurate, trustworthy, and deliver an elegant user experience. You will serve as the first customer of our AI systems. This role is ideal for product-minded engineers who obsess over product quality and customer-centricity, and are passionate about shaping the behavior of AI systems in the real world.
Key Responsibilities:
- Build and maintain AI evaluation pipelines to test, measure, and evaluate the behavior and performance of AI systems.
- Implement traces, spans, and session tracking for observability and identify error propagation in multi-step pipelines.
- Define AI quality metrics and KPIs around factuality, faithfulness, toxicity, grounding precision/recall, latency, cost, etc., with clear acceptance bars.
- Implement evaluation and testing automation to enable end-to-end system and regression testing at s...
We are looking for an AI Evaluation & Test Engineer to join our growing team to ensure that our generative AI models and applications are safe, accurate, trustworthy, and deliver an elegant user experience. You will serve as the first customer of our AI systems. This role is ideal for product-minded engineers who obsess over product quality and customer-centricity, and are passionate about shaping the behavior of AI systems in the real world.
Key Responsibilities:
- Build and maintain AI evaluation pipelines to test, measure, and evaluate the behavior and performance of AI systems.
- Implement traces, spans, and session tracking for observability and identify error propagation in multi-step pipelines.
- Define AI quality metrics and KPIs around factuality, faithfulness, toxicity, grounding precision/recall, latency, cost, etc., with clear acceptance bars.
- Implement evaluation and testing automation to enable end-to-end system and regression testing at s...
Ready to Apply?
Take the next step in your AI career. Submit your application to BharatGen today.
Submit Application