Software Engineer – Python & LLM Systems

We are looking for a Senior Developer for an important U.S.-based client.

Project: Acceleration of platform alignment and deployment repeatability to support large, complex customer engagements and regulated environments, with an emphasis on improving release velocity, architectural consistency, and time-to-market.

What You’ll Do

Design, develop, and maintain AI-powered services and internal tools using Python 3.
Build, manage, and optimize projects using the Poetry build system.
Develop and maintain CI/CD pipelines using CloudBees/Jenkins.
Integrate and operate Large Language Model (LLM) frameworks such as LiteLLM and LangFuse (or equivalent tools).
Design and implement AI agents using CrewAI, OpenAI agent frameworks, or similar platforms.
Manage and maintain configuration across environments to ensure system consistency and reliability.
Collaborate with cross-functional teams to translate business and technical requirements into scalable AI solutions.
Implement testing, monitoring, and deployment best practices for AI systems.
Participate in agile ceremonies and contribute to continuous improvement initiatives.
Document technical solutions and share knowledge across teams.

🔹 Must Have

Strong experience with Python 3 in production environments.
Hands-on experience with Poetry or similar Python dependency management tools.
Experience building and maintaining CI/CD pipelines using CloudBees, Jenkins, or similar tools.
Experience working with LLM frameworks such as LiteLLM, LangFuse, or equivalent.
Experience developing or integrating AI agent frameworks (CrewAI, OpenAI Agents, or similar).
Solid understanding of configuration management practices.
Strong verbal and written English communication skills.
Ability to collaborate effectively in cross-functional teams.
Proactive mindset: comfortable asking questions and contributing ideas.

🔹 Nice to Have

Experience deploying AI systems in cloud environments (AWS, GCP, or Azure).
Knowledge of MLOps or AI infrastructure best practices.
Experience with observability tools for AI/ML systems.
Familiarity with containerization (Docker, Kubernetes).
Experience working in regulated or enterprise environments.
Exposure to prompt engineering and model optimization techniques.

🔹 Minimum Qualifications

Bachelor’s degree in Computer Science or related field, or equivalent practical experience.
1–2 years of professional experience in software development or AI-related roles.
Proven experience developing applications using Python.
Basic understanding of CI/CD pipelines and automated deployment practices.
Experience working in collaborative, agile development environments.
Demonstrated ability to learn and adapt to new technologies quickly.

#Concentrix

Software Engineer – Python & LLM Systems

Key Skills

Related Jobs

DevOps Engineer

AI Software Engineer (m/f/d) - Berlin

DevOps Engineer (all genders)

Related Jobs

DevOps Engineer

AI Software Engineer (m/f/d) - Berlin

DevOps Engineer (all genders)

Cookie Settings