Senior AI/ML Engineer

About CNTXT

We’re revolutionizing enterprise analytics by making data insights accessible to everyone. Our AI-powered platform connects to databases, documents, and SaaS applications, enabling business users to ask questions and receive instant, interactive answers. We're building the future where every employee can be their own data analyst.

The Role

We're seeking a Senior AI/ML Engineer to architect and build the intelligent core of our product. You'll design sophisticated agentic workflows that can understand complex business questions, orchestrate multi-step analysis across diverse data sources, and deliver reliable insights at enterprise scale. This is a foundational role where you'll define how AI agents collaborate to transform raw data into actionable business intelligence.

What You'll Build

Agentic Workflow Orchestration

• Design and implement multi-agent systems using modern frameworks (e.g. CrewAI, AutoGen, SmolAgents, LangChain, etc.)
• Build agents that can plan, execute, and validate complex analytical workflows
• Create agent coordination patterns for tasks
• Implement agent memory and context management for conversational analytics

Natural Language to Analytics Pipeline

• Develop sophisticated prompt engineering for business query understanding
• Build query parsing and intent recognition for complex analytical requests
• Create semantic mapping between business language and technical data operations
• Implement context-aware follow-up and refinement capabilities

Model Integration & Inference

• Integrate open-source models from Hugging Face for specialized tasks (NER, classification, reasoning)
• Implement efficient model serving using LiteLLM, vLLM, or similar frameworks
• Design model routing and fallback strategies for reliability and cost optimization
• Build custom fine-tuning pipelines for domain-specific analytics tasks

Large-Scale Data Analysis Integration

• Connect agentic workflows with enterprise data infrastructure (databases, warehouses, APIs)
• Implement streaming analysis for real-time insights and alerting
• Build statistical analysis and predictive modeling capabilities within agent workflows
• Create document processing agents for PDF, Excel, and unstructured data analysis

Evaluation & Quality Assurance

• Design comprehensive evaluation frameworks for agent performance and accuracy
• Build automated testing suites for analytical correctness and reliability
• Implement confidence scoring and uncertainty quantification for AI outputs
• Create feedback loops for continuous model improvement

What You Bring

AI/ML Engineering Excellence

• 5+ years building production AI/ML systems with strong focus on LLMs and agentic frameworks
• Expert-level Python programming with deep understanding of async/concurrent programming
• Hands-on experience with agentic frameworks (e.g. CrewAI, AutoGen, LangGraph, SmolAgents)
• Proficiency with model serving frameworks (LiteLLM, vLLM, Ollama, or similar)

LLM & Model Integration

• Extensive experience with Hugging Face ecosystem (transformers, datasets, model hub)
• Advanced prompt engineering skills with understanding of reasoning patterns
• Experience fine-tuning and adapting open-source models for specific domains
• Knowledge of model optimization techniques (quantization, pruning, efficient attention)

Enterprise AI Development

• Built AI systems that handle large-scale data processing and analysis
• Experience with RAG architectures and vector databases for knowledge retrieval
• Understanding of AI safety, hallucination detection, and output validation
• Experience with A/B testing and evaluation of AI system performance

Data Science & Analytics

• Strong foundation in statistics, data analysis, and business intelligence concepts
• Experience building automated analysis pipelines and reporting systems
• Understanding of SQL, data warehousing, and analytical query patterns
• Knowledge of time series analysis, anomaly detection, and predictive modeling

Technical Requirements

Core AI/ML Stack

• Languages: Expert Python, familiar with Rust/Go for performance-critical components
• LLM Frameworks: LangChain, LlamaIndex, CrewAI, AutoGen
• Model Serving: LiteLLM, vLLM, TGI, OpenAI-compatible APIs
• ML Libraries: PyTorch, Transformers, scikit-learn, pandas, numpy
• Vector Databases: Pinecone, Weaviate, ChromaDB, Qdrant, or FAISS

Evaluation & Testing

• Experience with evaluation frameworks (BLEU, ROUGE, custom business metrics)
• A/B testing methodologies for AI systems
• Automated testing and CI/CD for ML pipelines
• Performance monitoring and observability for AI systems

Bonus Points

• Experience with multimodal models and document understanding
• Knowledge of distributed training and model parallelization
• Experience with AI agents in business/enterprise contexts
• Understanding of compliance and governance for enterprise AI
• Previous work in analytics, BI, or data platform companies
• Publications or contributions to open-source AI projects

What We Offer

• Competitive salary and equity package
• Opportunity to define the AI architecture for next-generation analytics
• Access to substantial compute resources and latest AI/ML tools
• Collaboration with enterprise customers to solve real business problems

The Challenge

You'll be solving the complex problem of making AI agents reliable enough for enterprise decision-making while flexible enough to handle diverse analytical requests. This means building systems that can:

• Understand nuanced business questions across different domains
• Orchestrate complex multi-step analysis workflows
• Validate outputs for accuracy and business relevance
• Scale to handle enterprise data volumes and user loads
• Maintain conversation context across extended analytical sessions

The Impact You'll Have

In your first 90 days, you'll build the agentic workflows that enable business users to ask complex questions and receive comprehensive, multi-source analysis with actionable insights. Your AI architecture will be the differentiator that sets us apart from basic chatbots and traditional BI tools.

Ready to build the AI agents that will democratize data analysis?

Apply now with your resume, GitHub profile, and a brief description of the most complex agentic system you've built.