Roles
Compensation
The target base salary for this position ranges from $182, 300 to $220, 000, in addition to a competitive equity and benefits package (as applicable).
- Salary period
- unclear
- Location basis
- The base salary depends on factors such as location, job-related knowledge, skills and experience.
- Equity
- competitive
Tech stack
Required
Nice to have
Location
NYC
Work setup
- Employment
- full-time
- Level
- Senior
- Remote policy
- Hybrid (NYC) — 2x a week in office
- Remote scope
- hybrid
- Travel
- unclear
- Relocation
- unclear
- Visa
- unclear
- Authorization
- unclear
- Clearance
- unclear
Role details
Responsibilities
- Own AI features from prototype through production
- Improve workflows with clinical operators
- Build orchestration layers
- Build prompts
- Build evaluations
- Build retrieval systems
- Build tooling that makes LLMs reliable enough for real-world healthcare operations
- Design, build, and ship production LLM powered features end-to-end
- Build the AI application layer, including prompt orchestration, tool calling, retrieval (RAG), embeddings, agent workflows, and structured outputs
- Develop evaluation infrastructure, including regression suites, LLM-as-a-judge evaluations, synthetic datasets, human review workflows, and quality metrics that catch regressions before users do
- Design observability systems that measure accuracy, latency, cost, hallucination rates, and model behavior in production
- Build safety and reliability guardrails that ensure AI systems meet quality, compliance, and operational requirements
- Evaluate and integrate third-party tools, including orchestration frameworks, evaluation platforms, vector databases, and model providers; and make pragmatic build-versus-buy decisions
- Raise engineering standards across the team through technical leadership, code reviews, mentorship, and thoughtful system design
- Sit with EHR operators, Patient Advocates, and clinical teams to understand the workflows you're automating
- Prototype quickly, ship early, measure outcomes, and iterate based on real-world usage
Requirements
- 5+ years building production software
- 1–2 years building and deploying LLM-powered applications in production
- Strong Python engineer with experience building backend services and integrating modern AI APIs and frameworks
- Comfortable using AI-assisted development tools throughout the software development lifecycle
- shipped AI features that served real users
- strong product instincts
- thrive in ambiguous environments
- translating operational problems into technical solutions
Application
- Portfolio
- unclear
- GitHub
- unclear
- Cover letter
- unclear
- Apply flow
- ats
Company context
- Product
- direct-to-patient telehealth
- Industry
- unclear
Description
Ro (ro.co) | direct-to-patient telehealth | NYC (hybrid, 2x a week in office) Lots of open eng roles :) but we want to specifically highlight a brand new one for us: - Senior AI Engineer This is on a new team we’re building from the ground up. We’ve got an awesome Engineering Manager you’ll work alongside, and you’ll own AI features from prototype through production and spend as much time improving workflows with clinical operators as writing code. Most of your work will involve building orchestration layers, prompts, evaluations, retrieval systems, and tooling that make LLMs reliable enough for real-world healthcare operations.
Similar jobs
-
Loading similar jobs...