Analyze and interpret complex domain-specific charts and data visualizations to create high-quality, objective assessment tasks. Provide detailed, step-by-step explanations and calculations to ensure clarity and accuracy in AI training benchmarks.
This opportunity is ideal for data-driven professionals with a meticulous eye for interpreting domain-specific charts, excellent quantitative reasoning, and a passion for communicating complex concepts clearly in both written and verbal form. Contributors from Medicine & Biostatistics, Finance & Economics, Engineering & Physics, Earth Sciences & GIS, Data Science & Statistics, or Operations & Manufacturing are especially encouraged to express interest.
Scope of Work
- Interpret and analyze domain-specific charts, graphs, and data visualizations with a high level of accuracy and domain terminology precision.
- Design clear, unambiguous questions that require multi-step quantitative reasoning based on information-rich charts.
- Develop objectively answerable tasks focused on in-depth reasoning, calculations, comparisons, and trend analysis.
- Provide precise answers along with detailed, step-by-step explanations of your reasoning and calculation process.
- Utilize correct chart terms, units, axes, scales, legends, confidence intervals, and time periods in all tasks and solutions.
- Collaborate remotely with project coordinators and reviewers, demonstrating strong written and verbal communication skills.
- Ensure tasks are clear, free from subjectivity, and avoid unsupported conclusions or unnecessary complexity.
Preferred Qualifications
- Bachelor's degree or equivalent professional experience in a relevant domain (Medicine, Finance, Engineering, Earth Science, Data Science, Operations, etc.).
- At least two years of professional, academic, or research experience working with domain-relevant charts or quantitative data.
- Advanced degree, professional credential, or significant industry specialization (highly desirable).
- Demonstrated ability to select and interpret complex charts, including those with multiple data series, annotations, or statistical features.
- Experience authoring technical assessments, benchmark questions, or structured analytical tasks for learning, analytics, or evaluation purposes.
- Proven ability to write unambiguous, objectively answerable questions and communicate calculations clearly in English.
- Remote collaboration and asynchronous communication experience with cross-functional technical or research teams.