Job Description
Key Responsibilities
Understand the business problem, POC objectives, and evaluation metrics.
Profile and clean sample datasets for experimentation (lightweight data prep).
Build and test simple pipelines for data ingestion, prompt construction, and output evaluation.
Design experiments to test different model configurations, prompts, or retrieval strategies.
Analyse Gen AI outputs for quality, accuracy, and alignment with requirements.
Identify common failure modes (hallucination, bias, irrelevant answers, factual errors).
Provide insights and recommendations to improve model performance in quick iterations.
Support SMEs in defining ground truth benchmarks for evaluation.
Collaborate with developers on integrating models into the POC workflow.
Show more Show less
Understand the business problem, POC objectives, and evaluation metrics.
Profile and clean sample datasets for experimentation (lightweight data prep).
Build and test simple pipelines for data ingestion, prompt construction, and output evaluation.
Design experiments to test different model configurations, prompts, or retrieval strategies.
Analyse Gen AI outputs for quality, accuracy, and alignment with requirements.
Identify common failure modes (hallucination, bias, irrelevant answers, factual errors).
Provide insights and recommendations to improve model performance in quick iterations.
Support SMEs in defining ground truth benchmarks for evaluation.
Collaborate with developers on integrating models into the POC workflow.
Show more Show less
Ready to Apply?
Take the next step in your AI career. Submit your application to Yondu, Inc. today.
Submit Application