Job Description
Job Title: LLM – Business Analyst
Experience: 5+ Years
Role Overview
We are seeking a detail-oriented Business Analyst to support Large Language Model (LLM) evaluation and annotation workflows. This role focuses on assessing quality, accuracy, and structured reasoning in model outputs. The ideal candidate is comfortable working with digital tools, performing side-by-side evaluations, and providing clear, evidence-based justifications through fact-checking.
This is an evaluation and quality-focused role—no model training or coding expertise is required.
Key Responsibilities
- Perform side-by-side (SxS) evaluations on GHD outputs, assessing quality, accuracy, relevance, and reasoning
- Conduct fact-checking to validate information and identify inaccuracies or inconsistencies
- Provide
Ready to Apply?
Take the next step in your AI career. Submit your application to Sourcebae today.
Submit Application