Job Description
The LLM & AI Automation Analyst is responsible for managing, monitoring, and continuously improving LLM-powered systems, AI agents, and automations, including chatbot applications.
This role sits at the intersection of AI, data, automation, and operations. You will ensure AI systems deliver accurate, reliable, and context-aware outputs by maintaining knowledge bases, refining prompts, monitoring performance, and building automations and reports. This role is ideal for someone who enjoys analytical thinking, process optimization, and working with evolving AI systems.
Responsibilities include, but are not limited to:
- Maintain and improve LLM-powered agents, including chatbot workflows, prompts, and response logic
- Design, test, and refine prompts to improve accuracy, consistency, and behavior
Validate agent outputs across edge cases and real-world scenarios
Curate, organize, and validate structured kn...
Ready to Apply?
Take the next step in your AI career. Submit your application to Online Helpers today.
Submit Application