Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewQuestions interviewers often ask for this role, with sample answers.
One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
About Turing
Turing is one of the world’s leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.
About the Role
We’re looking for experienced, hands-on software engineers to help evaluate and improve AI coding models.
Rather than primarily building production applications, you’ll work with coding agents across real-world repositories and assess the quality of their work. You’ll review generated code and agent behavior, determine whether solutions are technically correct, identify failure modes, and create the evaluation signals and feedback used to improve model performance.
Think of the coding agent as another engineer whose work you’re reviewing: Can it understand the task? Did it choose the right approach? Is the resulting code correct, robust, and maintainable? Can you explain precisely where it succeeded or failed?
What You’ll Do:
Engagement Details:
Evaluation Process:
The practical exercise focuses on your ability to review and evaluate AI-generated code, not competitive programming or algorithm puzzles.
Requirements
Experience with LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training is a plus, but not required.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 218,429+ Jobs in Software Engineer
Answer easy questions
218,429+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”