Machine Learning Engineer

SENIOR ML ENGINEER | BUILD GLOBAL AI NETWORKS | HYBRID SF | $300k + EQUITY

My client is building a unique, globally distributed system that harnesses spare computational resources from around the world to run cutting-edge models like Llama and Mistral. We’re searching for an ML engineer excited about solving complex engineering challenges within a small, high-impact team based in San Francisco.

If you’re passionate about working on advanced distributed systems, machine learning, and resource optimization, this could be a great opportunity. The team consists of experienced engineers who thrive in a dynamic, fast-paced environment, with a focus on creativity, collaboration, and hands-on coding.

We are looking for Senior-Staff level engineers or ex-founders, who are high agency, high throughput, very technical people who WANT to be in person working on interesting problems.

Salary: $200-300k + equity

Interview process: 4 stages

Location: SF (hybrid 3 days a week)

What we're looking for:

• Proficient in Typescript, Python, and at least one of Go, Rust, or C++
• Deep understanding of distributed systems and their underlying principles
• Hands-on experience with container orchestration and scheduling tools, such as Kubernetes or Nomad
• Experience with large language model inference engines (e.g., vLLM, TensorRT-LLM)
• Familiarity with AI development tools (e.g., ChatGPT, Claude, Cursor) to enhance productivity and workflow
• Knowledge of GPU programming and optimization techniques (CUDA experience is advantageous)

This client can support H1B visa transfers for candidates who require it.

Tags:

Python, Typescript, Rust, Go, C++, ML, Machine Learning, AI, GenAI, LLM, GPU, Inference