Product Manager - AI Observability/Evaluation Platform

We are looking for a Product Manager to join the ML/AI Platform team at Spotify.The team helps various groups build, deliver, and run ML and AI-enabled experiences at scale. We want a Product Manager to oversee AI Observability and Evaluation. These platform tools assist teams in tracking LLM behavior during production, quickly resolving issues, measuring performance, and consistently refining our AI products.This is an internal platform role with highly technical customers (ML engineers, backend engineers, data scientists). You will partner closely with engineering leaders to define the paved road for instrumenting, monitoring, and operating AI workloads end-to-end.

What You'll Do

Own the product roadmap for Spotify’s AI observability capabilities across instrumentation, data contracts, and debugging workflows.

Collaborate with stakeholders to develop the roadmap for Spotify’s AI/Agentic evaluation capabilities via LLM-as-judges and other approaches.