For Employers

mpathic

Machine Learning Engineer, Evaluation

Posted 18 minutes ago
2-5 years experience
Apply Now

Please mention DailyRemote when applying

?Not checked yet0100
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Tailor your resume to this job

One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.

  • Job match score for this posting
  • Edits you accept or skip, no invented facts
  • Download it when it reads right: TXT free, PDF with Premium

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

You will build, deploy, and maintain machine learning models while designing rigorous evaluation frameworks to ensure system quality and reliability. This role involves creating benchmarks, analyzing model performance, and collaborating with cross-functional teams to improve production systems.

About mpathic

mpathic builds AI that understands clinical and human conversations: analyzing therapy and clinical-trial sessions, producing expert-labeled data for AI builders, and publishing open safety benchmarks.

About the role

We’re looking for a Machine Learning Engineer to build and improve ML-powered products, with a particular focus on evaluating their quality and reliability. You’ll work across the ML lifecycle, combining hands-on engineering with rigorous experimentation to understand how systems perform and where they need to improve.

This is a generalist ML engineering role with an evaluation focus. You’ll contribute to production systems while helping the team make sound decisions about models, data, and product changes.

What you’ll do

  • Build, deploy, and maintain ML models and services in collaboration with engineering and product teams.
  • Design evaluation approaches that reflect product needs and real-world operating conditions.
  • Create and maintain evaluation datasets, benchmarks, and automated regression tests that measure safety, empathy, and risk.
  • Select appropriate metrics, analyze performance across meaningful data segments, and investigate failure modes.
  • Design experiments and use statistical methods to judge whether an improvement is real.
  • Connect offline evaluation results with what customers see in production.
  • Develop tools that make evaluation repeatable and useful throughout development and release workflows.
  • Communicate findings, limitations, and recommendations clearly to clinicians, product leads, and customers.

What you’ll bring

  • Practical experience developing and shipping ML systems, typically 2–5 years of relevant work or equivalent.
  • Strong Python skills and familiarity with common ML frameworks.
  • Solid ML fundamentals, including training, validation, generalization, and common sources of model error.
  • Experience with evaluation metrics, benchmark design, and systematic error analysis.
  • An understanding of statistical inference, sampling, confidence intervals, and experimental design.
  • Experience identifying data leakage, evaluation bias, and gaps in test coverage.
  • Good software engineering practices, including testing, version control, and code review.
  • Skill at turning ambiguous product goals into measurable quality criteria.

Helpful additional experience

  • A/B testing and production performance monitoring.
  • Human evaluation, annotation guidelines, and inter-rater agreement.
  • Speech or conversational data: transcripts, diarization and multi-speaker setups.
  • Evaluating ranking, retrieval, recommendation, or generative AI systems.
  • Robustness testing, calibration, fairness analysis, or distribution shift detection.
  • Building evaluation tooling and integrating quality checks into CI/CD workflows.
  • Clear, direct communication, both written and verbal.
  • Startups and cross-functional teams.

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Software Development jobs →

Infrastructure Engineer, Networking & Cloud Hosting

Full Time Australia Software Development

Machine Learning Engineer, Data Products

Full Time Worldwide Software Development

Solutions Engineer, Splunk - Remote

Full Time United States $209K - $275K per year Software Development

Software Quality Engineer/Analyst

Full Time United States $106K - $145K per year Software Development

Senior Software Engineer - Postgres Engine

Full Time United States $190K - $260K per year Software Development

Database Designer (Clinical Trials)

Full Time India Software Development
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 224,690+ Jobs in Machine Learning Engineer

Answer easy questions

Answer easy questions

224,690+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified