Senior Machine Learning Engineer

Job Summary
Responsible for leading the transition of our Generative AI initiatives from experimental proofs-of-concept to resilient, enterprise-scale production systems. This role is pivotal in establishing the architectural standards and operational rigor required to maintain high-performing, secure, and cost-effective LLM applications within our cloud and on-premise environment.
How will you contribute?
1. LLM Experimentation & Evaluation Frameworks
- Architect and maintain systematic environments for prompt versioning, hyperparameter tuning, and model comparison.
- Establish automated evaluation pipelines utilizing metrics such as faithfulness, relevancy, and toxicity to benchmark model iterations.
- Implement Human-in-the-loop (HITL) workflows to validate automated metrics against domain-specific banking requirements.
2. Architectural Oversight & Integration
- Define and govern the end-to-end architecture for LLM-based systems, specifically focusing on Retr...