Skip to content
Back to jobs

Posted 3 weeks, 4 days ago

Ro

Senior AI Engineer

Roles

Compensation

The target base salary for this position ranges from $182, 300 to $220, 000, in addition to a competitive equity and benefits package (as applicable).

unclear
The base salary depends on factors such as location, job-related knowledge, skills and experience.
competitive

Tech stack

LLMorchestration layerspromptsevaluationsretrieval systemstoolingPythonAI
LangChainLangGraphAgentCorevector databasesprompt/version managementevaluation platformsobservability platformsLangSmithBraintrustArize Phoenix

Location

NYC

Work setup

full-time
Senior
Hybrid (NYC) — 2x a week in office
hybrid
unclear
unclear
unclear
unclear
unclear

Role details

  • Own AI features from prototype through production
  • Improve workflows with clinical operators
  • Build orchestration layers
  • Build prompts
  • Build evaluations
  • Build retrieval systems
  • Build tooling that makes LLMs reliable enough for real-world healthcare operations
  • Design, build, and ship production LLM powered features end-to-end
  • Build the AI application layer, including prompt orchestration, tool calling, retrieval (RAG), embeddings, agent workflows, and structured outputs
  • Develop evaluation infrastructure, including regression suites, LLM-as-a-judge evaluations, synthetic datasets, human review workflows, and quality metrics that catch regressions before users do
  • Design observability systems that measure accuracy, latency, cost, hallucination rates, and model behavior in production
  • Build safety and reliability guardrails that ensure AI systems meet quality, compliance, and operational requirements
  • Evaluate and integrate third-party tools, including orchestration frameworks, evaluation platforms, vector databases, and model providers; and make pragmatic build-versus-buy decisions
  • Raise engineering standards across the team through technical leadership, code reviews, mentorship, and thoughtful system design
  • Sit with EHR operators, Patient Advocates, and clinical teams to understand the workflows you're automating
  • Prototype quickly, ship early, measure outcomes, and iterate based on real-world usage
  • 5+ years building production software
  • 1–2 years building and deploying LLM-powered applications in production
  • Strong Python engineer with experience building backend services and integrating modern AI APIs and frameworks
  • Comfortable using AI-assisted development tools throughout the software development lifecycle
  • shipped AI features that served real users
  • strong product instincts
  • thrive in ambiguous environments
  • translating operational problems into technical solutions

Application

unclear
unclear
unclear
ats

Company context

direct-to-patient telehealth
unclear

Description

Ro (ro.co) | direct-to-patient telehealth | NYC (hybrid, 2x a week in office) Lots of open eng roles :) but we want to specifically highlight a brand new one for us: - Senior AI Engineer This is on a new team we’re building from the ground up. We’ve got an awesome Engineering Manager you’ll work alongside, and you’ll own AI features from prototype through production and spend as much time improving workflows with clinical operators as writing code. Most of your work will involve building orchestration layers, prompts, evaluations, retrieval systems, and tooling that make LLMs reliable enough for real-world healthcare operations.

Similar jobs

  • Loading similar jobs...