Job Description

About the job


Position: AI Evaluation Specialist

Type: Contract

Pay Rate: $25 - $35/hour

Location: Remote

Working Hours Commitment: 10-40 hrs/week


Key Responsibilities:


  • Design and implement self-contained evaluation tasks, including prompts, supporting files, and detailed grading rubrics to assess AI performance on practical computer-based workflows.
  • Define clear, unambiguous written criteria for what constitutes successful and unsuccessful task completion across diverse administrative and workflow scenarios.
  • Meticulously observe and document AI agent behaviors, producing crisp, precise summaries and reports in high-quality English.
  • Iterate and refine evaluation tasks and rubrics based on feedback and team collaboration...

Ready to Apply?

Take the next step in your AI career. Submit your application to Dataway Project ID today.

Submit Application