AI Quality Analyst

Overview

Agility PR Solutions provides today’s communicators with powerful and intuitive media outreach, monitoring, and measurement solutions. We are a remote-first company with teams across Canada, the US, the UK, the Philippines, and India. We focus on helping teams realize their potential, investing in learning and development, and offering competitive pay and benefits.

Our approach to AI & Engineering: we use AI to scale high-quality work, not to replace human judgment. Our internal AI agents support teams, and we pair automation with thoughtful human evaluation.

What You’ll Do

• Review and evaluate outputs produced by internal AI agents across a range of use cases.
• Assess whether AI-generated responses are accurate, consistent, and supported by sources or logic.
• Identify patterns in errors or hallucinations and document findings clearly and consistently, including what was corrected and observed trends.
• Provide s...