-
Microsoft

Software Engineer

Microsoft
India · Full-time · Not Applicable

Microsoft’s bold vision of Azure Machine Learning (ML) is to democratize ML and make it available to every enterprise, developer and data scientist. Do you want to join a team that builds the platform to run all internal and external ML workloads? We are already serving billions of requests per day on the most cutting-edge scenarios and models across the industry

You will be joining the Inference team that builds the model-serving platform for large models including the OpenAI generative models. We host models at the scale of Bing and Office and solve exciting problems on the intersection of AI and Cloud

We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities.

Responsibilities

Responsibilities

We’re looking for a Software Engineer who is passionate about building services that bring state-of-the-art OpenAI models to customers.

  • Implement and deliver Azure Inferencing services meeting Azure Standards and the enterprise promise.
  • Participate in the lifecycle of service delivery and service monitoring, find new and innovative ways to detect defects and improve livesite quality.
  • Build development tools to simplify processes and empower every engineer on the team.
  • Enable customers to leverage various machine learning scenarios to drive tangible business impact.

Other

Embody our Culture and Value

Qualifications

Required and Preferred:

  • B Tech or M Tech in computer science, engineering, mathematics or a related field, or equivalent industry experience.
  • 1+ years of software development experience.
  • Work experience of running a real time service with high throughput and low latency requirements is a plus

#AIPLATFORM# #IDC

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Key Skills

Ranked by relevance

machine learning cloud ai
Login to Apply
Posted
Feb 14, 2025
Type
Full-time
Level
Not Applicable
Location
Hyderabad
Company
Microsoft

Industries

Software Development

Categories

Engineering Information Technology

Related Jobs

3 roles aligned with this opportunity

View all jobs
View Job Details
Workday
Related

Software Development Engineer - Kubernetes Service Mesh

2026-05-28

Full-time
Not Applicable
Ireland
Software Development
Engineering
View Job Details
Guidewire Software
Related

Software Engineer II

2026-05-28

Full-time
Not Applicable
Ireland
Software Development
Engineering
View Job Details
AltaSigma
Related

Data Scientist (m/w/d)

2026-05-28

Full-time
Entry
Germany
Software Development
Engineering