Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewOne click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
The role involves evaluating and ranking expert-level AI model outputs against detailed rubrics and quality standards. You will also be responsible for fact-checking claims, calibrating other raters, and refining grading guidelines.
Join a remote expert network as a senior rater and reviewer, evaluating challenging AI model outputs and helping calibrate other graders. Your work supports the development of reliable, high-quality AI systems.
Rank and rate expert-level model answers in your domain using detailed rubrics and written rationales.
Evaluate model reasoning step by step in specialized fields such as mathematics, code, law, medicine, or finance.
Fact-check detailed claims against primary sources and verify accuracy.
Assess answers against content policies, style guides, and edge cases.
Review other raters' work, calibrate standards, and develop or refine grading guidelines.
Assess search relevance and share feedback in live sessions.
At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or deep expertise in a relevant field.
Native or near-native written English proficiency.
Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
Experience leading, reviewing, or mentoring other raters or reviewers.
An advanced degree, professional license, or deep working expertise in the domain you evaluate.
Hands-on experience with AI data annotation, preference ranking, rubric grading, process labeling, or search-quality rating is a plus.
Compensation is $50 to $120 per hour, depending on project, field, and expertise. Payment is for hours worked.
Fully remote. Projects typically last from one week to several months.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 213,318+ Jobs in Others
Answer easy questions
213,318+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”
— Sarah J.
·
Marketing Manager
★★★★★
Verified
