Job Description

Overview

Microsoft is leading the AI strategy with an ambitious mission to democratize AI, make it an essential ingredient for delivering breakthrough customer experiences and to ensure the benefits of AI reach every person and organization on the planet, safely and responsibly.

We are looking for a Principal Software Engineer at Microsoft, Hyderabad, who is passionate about designing, architecting and running highly reliable and available platform to support model inferencing at the scale of billions of requests per day. You will also have an opportunity to work on high throughput/ low latency scenarios and drive performance optimization capabilities.

You will be joining the Azure Open AI Inference team that builds and runs the model-serving platform for large OpenAI generative models. This team is at the forefront of delivering this innovation with massive scale powering every Azure OpenAI customer and scenario in the industry, both 3P and ...

Ready to Apply?

Take the next step in your AI career. Submit your application to Microsoft today.

Submit Application