AI Inference Specialist at Chai

Become a pivotal force at Chai as an AI Inference Specialist. Focus on refining and optimizing LLM inference systems within a dynamic team.
In this Senior AI Engineer role, you'll leverage your 3+ years of experience to oversee the optimization of Chai’s LLM inference engine. You'll thrive in a high-performance culture, making significant contributions that impact the company’s ambitious growth. Work alongside talented peers dedicated to innovation.
Key Responsibilities:
• Lead the optimization of AI inference systems for performance
• Drive cost-effective solutions for LLM scalability
• Collaborate effectively within a driven engineering team
• Own decision-making processes for impactful outcomes
• Commit to ongoing learning and technical advancement
Requirements:
• 3+ years in software engineering roles
• Strong knowledge of vLLM and AI optimization
• Bachelor or Master’s degree from a leading university
• Proficiency in Python, Redis, and Kubernet...