For Employers

Lifted, an Upwork Company™

Technical Experts needed to stump AI Models

Posted 19 hours ago
10+ years experience
Apply Now

Please mention DailyRemote when applying

?
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

Design and implement complex, expert-level technical problems to test and challenge the capabilities of frontier AI models. Evaluate model performance by ensuring tasks are successfully solved only when the AI demonstrates genuine reasoning.

Company Description

This enterprise client helps the world’s most innovative companies improve their AI models by providing human feedback. 

Job Description

Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.

The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.

Qualifications

Who we need:

  • Masters degree or higher
  • 10+ years of professional experience in a technical domain
  • At least one publication (academic or professional)

Domains in demand:

  • Coding
  • Machine Learning
  • Systems
  • Security
  • Hardware

Additional Information

  • This is an ongoing project — at least 7 weeks
  • Onboarding process is approximately 90 minutes total

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Software Development jobs →

Senior Engineer, Process Validation

Full Time United States $100K - $130K per year Software Development

Teamleiter CRM / E-Mail Marketing REMOTE (d/w/m)

Full Time Germany Software Development

Solutions Architect Digital Pathology

Full Time United States $190K - $210K per year Software Development

Senior AI Engineer

Full Time Netherlands Software Development

Structural Engineer III

Full Time United States Software Development

Digital Pathology Helpdesk Engineer (f/m/d)

Full Time Germany Software Development
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 216,396+ Jobs in Software Development

Answer easy questions

Answer easy questions

216,396+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified