AI/LLM Evaluator (Work from Home) (Rolling Intake)

Responsibilities

• Creating training data sets for AI models that will help improve their accuracy, fluency, coherence, and/or voice
• Annotating data to help AI models align with human values
• Analyzing and improving the grammar, syntax, and sentence structure of both expert-generated training data and AI model-generated text to ensure it adheres to linguistic rules and conventions
• Collaborating closely with cross-functional teams, including data scientists, researchers, and software engineers to refine and iterate data sets
• Contributing to evolving specifications for AI model training and data recipes
• Navigating a dynamic environment and adapting to shifting guidelines and flexible priorities
• Achieving target KPIs, including daily job count and average handle time per job, within specified data production windows