Senior AI/ML Developer

Job Title: Senior AI/ML Developer (with Azure experience)

Job Location:Toronto, ON (5 days onsite/week)

Job Type: Contract

Requirements

We’re looking for a skilled Python Engineer to join our team in building and scaling LLM-powered applications. You’ll be working with modern agentic AI frameworks, designing APIs, and integrating with cloud services – primarily on Azure.

• 4+ years of experience as a Python AI Engineer.
• Strong experience with FastAPI, SQLAlchemy, and PyTest.
• Experience with agentic AI frameworks (e.g., Haystack, LangGraph, CrewAI).
• Familiarity with LLM-based systems and integration patterns.
• Working experience of Docker, Kubernetes, and Git.
• Hands-on experience with Azure cloud services (especially Azure AI, Azure Functions, etc.).
• Familiarity with PostgreSQL.
• ReactJS
• Experience with Retrieval-Augmented Generation (RAG), including vector databases and embeddings.
• Experience with Langfuse or similar LLM evaluation/monitoring tools.
• Experience with CI/CD workflows and observability tools.
• Interest in emerging LLM/agentic tooling and frameworks.
• Solid understanding of natural language processing techniques, with experience in deploying NLP systems and working with prompt libraries.
• Expertise in data analysis and analytics.
• Proven track record of driving innovation and solving complex technical problems using AI and machine learning.
• Good communication skills, with the ability to convey complex technical concepts to both technical and non-technical stakeholders.
• Experience working collaboratively within cross-functional teams.
• Understanding of data privacy and security standards, ensuring systems are compliant with industry regulations and best practices.
• Passion for continuous learning and staying updated with the latest trends and advancements in AI/ML technologies.
• Nice to have: Experience with multi-agent architectures.
• Nice to have: Experience with MCP protocol.

Job responsibilities

• Collaborate with PO, BA, stakeholders to understand the specific needs and requirements of the business process.
• Translate business needs into technical specifications.
• Collaborate with frontend engineers, Data Scientists, and DevOps to deliver scalable LLM solutions.
• Develop and maintain backend services using FastAPI.
• Work with agentic AI frameworks like Haystack to build AI pipelines and components.
• Design and implement robust database models using SQLAlchemy with PostgreSQL.
• Write and maintain unit and integration tests using PyTest.
• Deploy services using Docker and Kubernetes.
• Utilize Azure services (e.g., Azure AI) for hosting, inference, and other cloud-native features.
• Use Langfuse or similar tools for LLM performance monitoring and evaluation and implement improvements as necessary.
• Develop and refine the prompt library to facilitate seamless user interaction and request handling.
• Ensure the AI models integrate effectively with existing applications and workflows.
• Conduct thorough testing of AI models to ensure they meet quality, performance, and accuracy standards.
• Provide ongoing support and troubleshooting to address any system issues.
• Monitor and adapt AI systems to accommodate changes in the business process or user requirements.
• Create comprehensive documentation for developed solutions.