Company Description

Concentrate provides one OpenAI-compatible API to access, route, and manage models across leading AI providers and open-source models through a single endpoint. We help teams save time, lower token spend with credits back from our bulk purchasing power, improve reliability, and avoid vendor lock-in.

Supported by top-tier investors. This is a remote role or in-person in NYC.

We’re hiring an experienced Engineer to join our founding team.

This role is highly hands-on today, with meaningful ownership over architecture, technical direction, and execution. For the right person, this can grow into a broader engineering leadership role over time.

Role Description

You’ll lead the design and development of core production systems across our platform. This includes backend services, APIs, internal tooling, reliability, and debugging real customer issues end to end.

We’re looking for someone who is deeply technical, highly pragmatic, and excited to operate with broad ownership in an early-stage environment. You should be comfortable making strong technical decisions, setting direction, and helping lead a team soon (while staying very hands-on).

What You’ll Do

• Design and evolve the systems that sit behind our unified LLM API, including routing, retries, provider failover, logging, and observability
• Improve the reliability, latency, and cost-efficiency across multiple model providers
• Own backend and platform architecture across APIs, data stores, and cloud infra
• Debug customer issues end to end, from application behavior and API integration through infrastructure and provider/model behavior
• Define engineering patterns for testing, deployment safety, monitoring, and incident response
• Help hire and mentor engineers as the team grows

What We’re Looking For

• Experience building extremely high volume systems
• 5–12 years of experience, with flexibility for exceptional candidates
• Strong judgment around architecture, tradeoffs, and execution
• You’ve likely worked deeply with some of the following, but we care more about ownership and technical judgment than exact stack match: Python, TypeScript/Node.js, PostgreSQL, Redis, AWS, Docker, Kubernetes, Terraform, and modern CI/CD workflows.
• Experience with backend systems, APIs, infrastructure, or developer tooling
• Comfortable in fast-moving, early-stage environments
• Work experience with startups
• Clear written and verbal communication skills
• Fluent English required

Bonus

• Experience as a prior founder or CTO of a successful (or not successful) startup will fast track your candidacy.
• Experience with LLM APIs or AI infrastructure
• Experience hiring, mentoring, or leading engineers
• Interest in growing into a broader engineering leadership role

Salary Range: $200K-$300K cash compensation + strong equity

Equal Opportunity & Fair Chance Notice

Concentrate AI is an affirmative action and equal opportunity employer. We are committed to providing equal employment opportunities and do not discriminate in recruiting, hiring, training, promotion, or other employment practices on the basis of race, color, sex, age, religion, national origin, ancestry, protected veteran status, disability, sexual orientation, gender identity or expression, genetic information, or any other status protected by applicable law.

Qualified applicants with arrest and conviction records will be considered in accordance with the San Francisco Fair Chance Ordinance and applicable state and local laws.

California Privacy Notice

California residents may contact [email protected] for additional information regarding how we collect, use, and disclose personal information during the job application process.

Recruitment Agency Notice

Concentrate AI does not accept unsolicited resumes from recruitment agencies and is not responsible for any fees related to unsolicited submissions.