Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewOne click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
You will evaluate and rank AI model responses for accuracy, safety, and helpfulness based on detailed rubrics. Additionally, you will perform fact-checking and label reasoning steps to improve the quality of AI systems.
Join a talent pool supporting AI model evaluation and improvement through careful, structured feedback. This flexible, project-based work helps improve the quality, accuracy, and safety of AI systems.
Compare and rank model responses to identify which performs better.
Rate answers for accuracy, helpfulness, tone, and safety using detailed rubrics.
Label reasoning steps as correct or incorrect and write concise rationales for your ratings.
Fact-check claims against reliable sources and assess compliance with content policies and style guides.
Evaluate search result relevance and provide live feedback on model outputs during sessions.
Zero to five years of relevant professional experience.
Native or near-native written English and meticulous attention to detail.
Experience rating, reviewing, fact-checking, editing, moderating, or grading work against written guidelines.
A degree or work background in a field you can evaluate, such as writing, journalism, research, teaching, trust and safety, mathematics, science, law, medicine, or finance.
Ability to apply rubrics or style guides consistently across many items.
Experience with AI data evaluation platforms, search quality rating, or ads rating is useful but not required.
Compensation is $20 to $45 per hour, depending on the project, field, and experience. Pay is based on hours worked.
Fully remote. Projects typically run from one week to several months.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 216,691+ Jobs in Others
Answer easy questions
216,691+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”