Track This Job
Add this job to your tracking list to:
- Monitor application status and updates
- Change status (Applied, Interview, Offer, etc.)
- Add personal notes and comments
- Set reminders for follow-ups
- Track your entire application journey
Save This Job
Add this job to your saved collection to:
- Access easily from your saved jobs dashboard
- Review job details later without searching again
- Compare with other saved opportunities
- Keep a collection of interesting positions
- Receive notifications about saved jobs before they expire
AI-Powered Job Summary
Get a concise overview of key job requirements, responsibilities, and qualifications in seconds.
Pro Tip: Use this feature to quickly decide if a job matches your skills before reading the full description.
Ascertain is building AI agents to automate the administrative work that burdens care teams. We are in major health systems and large specialty groups, saving hundreds of staff hours every week.
Our backers include Northwell Health, New York’s largest health system, and Deerfield Management, a leading healthcare investment firm.
Together, we’re on a mission to restore time, trust, and focus to the people who keep healthcare running. Our work is urgent — not because of startup timelines, but because our customers rely on us to drive financial resilience and operational clarity in a system under strain.
About The Job
As a Product Engineer in AI at Ascertain, you will own the development and optimization of agents that automate healthcare back-office workflows. This is a hands-on role: you'll configure and iterate on agentic systems, write production code when needed, and work directly with customers and our operations team to deeply understand user workflows and continuously improve performance.
You'll be responsible for building reliable agents to solve real problems, establishing QA processes and evals, analyzing call data, and using what you learn to optimize every aspect of how we deliver agentic software.
This role is based in our NYC office with a hybrid schedule.
What You’ll Do
- Design, build, and optimize production-grade voice agents using third-party platforms and internal tooling
- Own end-to-end quality of agent performance, including QA processes, evaluation frameworks, and continuous monitoring
- Analyze call transcripts and interaction data to identify failure modes and drive systematic improvements
- Work directly with customers and internal operations teams to understand workflows and translate them into scalable product solutions
- Collaborate with engineering to build and improve reliability, observability, and deployment infrastructure
- Write and maintain production Python code for integrations, APIs, and custom agent logic
- Contribute to product direction by bringing a strong user and workflow perspective into development decisions
- 4+ years of professional software engineering experience, including owning production systems end-to-end (shipping, debugging, monitoring, and continuously improving reliability)
- At least 2+ years of hands-on Python experience in a professional setting (not academic or personal projects), including building APIs, services, or data workflows
- Experience working cross-functionally with non-technical stakeholders
- Proven ability to operate in ambiguous environments and drive projects from undefined problem → shipped solution
- Experience building or working with conversational systems, voice AI, or LLM-based applications, with familiarity in telephony (e.g., Twilio) or real-time communication platforms is preferred
- You're a builder who cares as much about the user experience as the technical implementation
- You take ownership of outcomes, not just tasks
- You communicate clearly and build trust with operations, engineering, and customers alike
- You're excited to work at the intersection of product and engineering, and you see this blended role as a feature, not a compromise
- You thrive in early-stage environments where scope evolves and you're expected to figure things out
Compensation Range: $140K - $175K
Key Skills
Ranked by relevanceReady to apply?
Join Ascertain and take your career to the next level!
Application takes less than 5 minutes

