See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewUpload your resume and we draft a letter for this exact role, tailored to what it asks for.
You will build and maintain evaluation pipelines, benchmarks, and production workflows for AI-driven legal products. Additionally, you will manage cloud infrastructure, APIs, and monitoring systems to ensure reliable system performance.
Join a healthtech team building dependable AI products for legal work. You will work across AI research and product, creating the evaluations, services, and features that bring applied AI into production.
Build repeatable benchmarks and evaluation pipelines for model accuracy, hallucinations, retrieval quality, latency, and cost.
Create dashboards that help the team track changes in system performance.
Turn research prototypes into production retrieval, drafting, document, and agent workflows.
Develop backend services, APIs, and internal tools to support testing and releases.
Deploy and operate cloud infrastructure, including monitoring, databases, and delivery pipelines.
Partner with AI research while staying connected to product and user needs.
At least 3 years of experience as a software, infrastructure, or product engineer building and deploying production systems.
Strong Python skills and hands-on cloud deployment experience.
Experience building evaluation pipelines, benchmarks, or assessment systems for machine learning or AI systems.
Experience with APIs, databases, backend services, deployment pipelines, monitoring, and reliable cloud operations.
Ability to turn experimental code and ambiguous ideas into usable, maintainable products, with experience designing dashboards or monitoring systems.
Interest or experience in LLMs, retrieval-augmented generation, agents, AI benchmarks, or document automation. Full-stack experience is a plus.
Helpful technologies include FastAPI, Docker, React, Next.js, Postgres, and vector databases.
Annual base salary: $180,000 to $260,000 USD. Visa sponsorship is not available.
Remote, United States.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 221,278+ Jobs in Software Development
Answer easy questions
221,278+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”