Review contributor evaluations of AI-generated responses to ensure they meet project guidelines and accurately identify factual errors. Provide detailed feedback to contributors to maintain high-quality performance and ensure evaluations align with rubric dimensions.
What if your knowledge of panish language could help improve the AI.
PROJECT DETAILS
Location: Remote in the Mexico
Job Type: Freelance
Pay Rate: $6 USD /hour
Expected capacity: 20 hours per week
Start date: As soon as possible
WHAT YOU’LL DO
Review contributor evaluations of model-generated responses to ensure adherence to project-specific guidelines and rubric dimensions.
Verify that contributors consistently apply all instructions, constraints, and evaluation criteria when assessing model responses.
Confirm that contributors accurately identify factual errors, hallucinations, or missing information in model responses, ensuring evaluations reflect whether responses fulfill the user query.
Ensure contributor-selected options align appropriately with rubric dimensions and are justified by the evidence present in the model response.
Review open-text comments provided by contributors, ensuring they identify areas of opportunity, weaknesses, or limitations that may not have been captured by rubric criteria.
Provide detailed feedback on contributor performance, highlighting areas for improvement and ensuring evaluations are consistently high-quality.
YOU ARE A FIT IF YOU’RE…
Proven expertise in one or more of the following areas:
Film and media studies
Entertainment journalism, film criticism, or media commentary
Content analysis focused on movies, TV series, and streaming platforms
Entertainment blogging, reviewing, or significant contributions to pop culture communities
Pop culture commentary and media writing
Strong familiarity with:
Narrative structures, character arcs, and continuity across cinematic universes and episodic storytelling
Contextual and cultural references specific to entertainment media
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”