Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewOne click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
Design and implement reinforcement learning environments and evaluation frameworks for clinical reasoning models. Collaborate with clinicians and research teams to validate model outputs and improve system reliability through iterative experimentation.
Build reinforcement learning environments and evaluations for clinical reasoning models at a healthtech company developing decision-support tools for clinicians. You will own the work from task design through delivery to model-training teams, helping make model outputs more reliable in healthcare.
Design multi-step clinical reasoning tasks with tool use, state transitions, and measurable success criteria.
Create and implement RL environments, including task data, reward functions, grading rubrics, and LLM judges.
Test evaluations for reward hacking, misleading scores, and other failure modes.
Run post-training and agent evaluation experiments, then use observed failures to improve environments.
Partner with clinicians and research colleagues to validate model outputs and deliver environments to training teams.
A PhD in computer science, machine learning, or a related field, or at least 3 years of full-time RL research or post-training experience; candidates with 3 or more years in research or industry, or who are in the final year of a PhD or a postdoc, are also considered.
At least a bachelor's degree in computer science, machine learning, mathematics, or a related technical field.
Hands-on experience building RL environments for post-training or agent evaluation, along with experience owning reward functions, grading rubrics, or LLM-judge calibration.
Production-level Python, PyTorch, and Transformers ecosystem skills, with experience in LLMs, reinforcement learning, post-training, evaluation, or reward modeling.
Experience in a full-time role at a leading AI research lab or advanced AI company.
Clear technical writing, comfort with uncertainty and cross-disciplinary work, and a habit of validating plausible model outputs.
Clinical AI experience is useful, as is knowledge of information retrieval, constraint solving, SAT/SMT, or domain-specific languages.
Authorization to work remotely in the United States or Canada, and willingness to attend in-person offsites several times per year.
Base salary: $250,000 to $400,000 annually. Visa sponsorship is not available.
Remote, with a primary location in Montreal, Quebec, Canada.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 212,393+ Jobs in Others
Answer easy questions
212,393+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”