-
View all jobs
Microsoft’s bold vision of Azure Machine Learning (ML) is to democratize ML and make it available to every enterprise, developer and data scientist. Do you want to join a team that builds the platform to run all internal and external ML workloads? We are already serving billions of requests per day on the most cutting-edge scenarios and models across the industry
You will be joining the Inference team that builds the model-serving platform for large models including the OpenAI generative models. We host models at the scale of Bing and Office and solve exciting problems on the intersection of AI and Cloud
We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities.
Responsibilities
Responsibilities
We’re looking for a Software Engineer who is passionate about building services that bring state-of-the-art OpenAI models to customers.
Embody our Culture and Value
Qualifications
Required and Preferred:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
You will be joining the Inference team that builds the model-serving platform for large models including the OpenAI generative models. We host models at the scale of Bing and Office and solve exciting problems on the intersection of AI and Cloud
We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities.
Responsibilities
Responsibilities
We’re looking for a Software Engineer who is passionate about building services that bring state-of-the-art OpenAI models to customers.
- Implement and deliver Azure Inferencing services meeting Azure Standards and the enterprise promise.
- Participate in the lifecycle of service delivery and service monitoring, find new and innovative ways to detect defects and improve livesite quality.
- Build development tools to simplify processes and empower every engineer on the team.
- Enable customers to leverage various machine learning scenarios to drive tangible business impact.
Embody our Culture and Value
Qualifications
Required and Preferred:
- B Tech or M Tech in computer science, engineering, mathematics or a related field, or equivalent industry experience.
- 1+ years of software development experience.
- Work experience of running a real time service with high throughput and low latency requirements is a plus
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
Key Skills
Ranked by relevance
machine learning
cloud
ai
Related Jobs
3 roles aligned with this opportunity
View Job Details
Related
Software Development Engineer - Kubernetes Service Mesh
2026-05-28
Full-time
Not Applicable
Ireland
Software Development
Engineering
View Job Details
Related
Software Engineer II
2026-05-28
Full-time
Not Applicable
Ireland
Software Development
Engineering
View Job Details
Related
Data Scientist (m/w/d)
2026-05-28
Full-time
Entry
Germany
Software Development
Engineering
Login to Apply
- Posted
- Feb 14, 2025
- Type
- Full-time
- Level
- Not Applicable
- Location
- Hyderabad
- Company
- Microsoft
Industries
Software Development
Categories
Engineering
Information Technology
Related Jobs
3 roles aligned with this opportunity
View Job Details
Related
Software Development Engineer - Kubernetes Service Mesh
2026-05-28
Full-time
Not Applicable
Ireland
Software Development
Engineering
View Job Details
Related
Software Engineer II
2026-05-28
Full-time
Not Applicable
Ireland
Software Development
Engineering
View Job Details
Related
Data Scientist (m/w/d)
2026-05-28
Full-time
Entry
Germany
Software Development
Engineering