For Employers

Litmus

MTS

Posted 4 hours ago
Worldwide
0-2 years experience
Apply Now

Please mention DailyRemote when applying

?Not checked yet0100
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Tailor your resume to this job

One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.

  • Job match score for this posting
  • Edits you accept or skip, no invented facts
  • Download it when it reads right: TXT free, PDF with Premium

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

You will architect and scale infrastructure for a hiring evaluation platform while building product features and AI research tools. The role involves designing RL environments and meta-optimization systems to improve the evaluation of human and agent performance.

About Litmus

At Litmus, we’re building evals for humans and redefining how talent is evaluated. Teams like Mercor, Wispr, Composio, Neo Scholars, Astranis, and more are already using Litmus to build their technical teams.

 

We’re at an inflection point. Every company in the world will soon be powered by neo-humans (agent assisted people). But building evals to measure neo-human performance is unexplored and difficult. It requires studying the limits of model & human capabilities across all sectors of knowledge work, designing realistic environments that you can profile multiple people against, and answering where a human adds value over a purely agentic system.

 

At Litmus, we’re solving this problem. We deliver hiring insights to companies by capturing how candidates use tools, reason, and make decisions in their interviews, giving agentic graders the evidence to evaluate candidate skillset and predict job performance.

 

The role

We're building an engineering team with complementary strengths across infrastructure, product engineering, and AI research. Depending on your expertise, your work could involve:

 

Platform & infrastructure

  • Architect, build, and scale reliable infrastructure that powers our hiring and evaluation platform

  • Own technical decisions across distributed systems and platform infrastructure, supporting high-throughput workloads

Product engineering

  • Own product features end-to-end, from technical design through deployment and iteration

  • Work closely with engineering and talent leaders at frontier technical teams and turn recurring customer needs into reusable platform capabilities

AI evaluation & research infrastructure

  • Design RL environments, evaluation rubrics, and reward signals that expose meaningful limits in neo-human systems.

  • Develop experiment orchestration and tracking systems for reproducible evaluations across humans and agents.

  • Build meta-optimization systems that use evaluation results, human and agent trajectories, and failure analysis to iteratively improve evaluation design.

 

What we look for

Required qualifications

  • Proficiency in Python, JavaScript/TypeScript, or Node.js.

  • A track record of building, shipping, and operating production systems OR experience in an early stage team

  • Ability to break down ambiguous problems and move quickly from ideas to execution

  • Strong independent judgment, with a willingness to challenge assumptions and take ownership of decisions

  • Ability to learn quickly, incorporate feedback, and improve based on evidence

High signals

  • Ex-founder

  • Experience operating distributed systems, cloud infrastructure (AWS/GCP), or serverless architectures

  • Experience building high-throughput data pipelines and distributed data processing systems

  • Experience with production-quality ML training, evaluation, or research infrastructure

  • Hands-on experience with reinforcement learning, LLM fine-tuning, or post-training

You’ll work directly alongside the founders, shaping product and technical direction. If you have deep expertise in one or more of these areas and are passionate about the mission, you’d be a good fit at Litmus.

 

Remote worldwide. Full-time. Open to all experience levels, including new graduates. We do not offer visa sponsorship.

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Others jobs →

Safety & Facilities Senior Specialist

Full Time United States $75305 - $100K per year Others

Coordinator ll Remote

Full Time United States $19 - $20 per hour Others

Channel Alliances Manager - West US

Full Time United States Others

Service of Process Team Member

Full Time United States Others

Senior Field Service Technician

Full Time United States $68600 - $109K per year Others

Senior Field Service Technician

Full Time United States $83300 - $133K per year Others
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 222,180+ Jobs in Others

Answer easy questions

Answer easy questions

222,180+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified