AI/ML Engineer

As an AI/ML Engineer, you will be responsible for designing, developing, and deploying machine learning models within a Databricks environment, leveraging Azure OpenAI Large Language Models (LLMs). You will have hands-on experience with Databricks and its derivative frameworks. Your role will involve building the initial version of the model monitoring framework within Databricks and integrating selected metrics to ensure accurate and real-time monitoring of model performance.

You will collaborate with data scientists, data engineers, and other stakeholders to build scalable and efficient machine learning solutions that drive business value. Proficiency in Agile project methodologies and the ability to multi-task effectively between projects are essential. You will also be responsible for estimating work content, achieving planned timelines, and communicating proposed designs and progress to customers, team leads, and team members.

Key Responsibilities

• Develop and implement machine learning models using Azure OpenAI LLMs within the Databricks platform.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
• Optimize and fine-tune models for performance, scalability, and accuracy.
• Integrate machine learning models into existing data pipelines and workflows.
• Conduct data preprocessing, feature engineering, and model evaluation.
• Monitor and maintain deployed models to ensure they perform as expected in production.
• Gather requirements and analyze the LLM validation process.
• Design and architect solutions for validating LLM performance and migrating to newer LLMs.
• Develop and implement processes for switching to newer LLMs, ensuring minimal disruption to existing workflows.
• Test and validate running older and newer LLMs side by side.
• Document and transfer knowledge covering the framework’s design, implementation, and usage.
• Plan and develop extensions to the framework.
• Stay up-to-date with the latest advancements in machine learning and AI technologies.
  
  

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
• Proven experience in machine learning, natural language processing, and working with large datasets.
• Proficiency in Python and familiarity with machine learning libraries such as TensorFlow, PyTorch, or scikit-learn.
• Strong understanding of Databricks.
• Proficiency in Azure OpenAI LLMs and their applications.
• Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
  
  

Next steps

If you feel this opportunity suits you, or Cognizant is the type of organization you would like to join, we want to have a conversation with you! Please apply directly with us.

For a complete list of open opportunities with Cognizant, visit http://www.cognizant.com/careers

Cognizant is committed to providing Equal Employment Opportunities. Successful candidates will be required to undergo a background check.