Job Description

We are seeking a highly skilled and motivated Senior PyTorch Internals Engineer to join our team and lead the charge in optimizing and porting PyTorch to novel hardware architectures. This role is crucial for porting of large language models (LLMs) on our next-generation platforms.

The ideal candidate will possess deep expertise in PyTorch internals, hardware architecture, and distributed training, particularly for LLMs. You will be responsible for understanding and modifying PyTorch's core components, optimizing performance for new hardware, and implementing efficient multi-chip training strategies.


Responsibilities:

  • PyTorch Internals Expertise: 
  • Dive deep into PyTorch's architecture, including its execution engine, autograd system, and memory management.
  • Analyze and optimize PyTorch's performance bottlenecks.
  • Hardware Porting: 
  • Port PyTorch to new hardware architecture using accelerators.
  • Col...

    • Ready to Apply?

    Take the next step in your AI career. Submit your application to Ambarella today.

    Submit Application