Please mention DailyRemote when applying
Work Location: Remote in Austria
Engagement Model: Independent Contractor/Freelance
Estimated Workload: 15 hours/week (Flexible workload that scales with project demand; some projects involve fast turnarounds and benefit from prompt availability)
Estimated Start Date: after 13th of July 2026
Language(s) Needed: German and English
We are seeking highly qualified Academic Subject Matter Experts (SMEs) to support the development and evaluation of next-generation Artificial Intelligence (AI) systems.
Role Summary
Academic Subject Matter Experts will use their academic expertise to create challenging, academically rigorous question-and-answer (Q&A) pairs designed to evaluate advanced AI reasoning capabilities. Questions should require advanced subject-matter reasoning and be supported by authoritative academic and/or primary sources. Depending on project requirements, contributors may also be asked to review and refine AI-generated responses. The work demands deep subject-matter knowledge, rigorous analytical thinking, and the ability to interpret and work confidently with complex academic materials, often in their original language(s).
We are recruiting experts holding a Master's degree or PhD in German History.
Role Responsibilities
Create original, academically rigorous Q&A pairs in your area of expertise, that require advanced reasoning, are supported by authoritative academic sources, and are designed to challenge current AI models.
Design questions that demand advanced reasoning, synthesis, and specialized domain knowledge rather than easily retrievable facts.
Evaluate and critique AI-generated responses against defined criteria, and revise or rewrite them to a higher standard where required.
Reference primary and secondary academic sources (literature, historical texts, films, manuscripts, scholarly publications, and other discipline-specific material) to ground and verify your work.
Ensure factual accuracy, internal consistency, source traceability, and adherence to project guidelines.
Refine content in response to quality-assurance feedback.
Participate in qualification and calibration exercises prior to project assignment.
Role Requirements
Master's degree or PhD in the relevant academic discipline (German History).
Familiarity with generative AI technologies and AI evaluation methodologies.
Demonstrated expertise through academic study, research, teaching, or publication.
Excellent analytical, critical-thinking, and research skills.
Ability to communicate and justify complex academic judgments clearly and precisely in writing.
Strong attention to detail and an uncompromising commitment to accuracy.
Language Requirements
Idiomatic fluency in German with the confidence to work directly with original-language academic materials.
Professional-level written English, if required for project deliverables (with primary sources cited in their original language).
Additional language combinations may be required depending on project needs.
Preferred Qualifications
Previous work in AI data creation, annotation, evaluation, or Large Language Model (LLM) projects strongly preferred.
University teaching or research experience.
Experience creating educational, assessment, or knowledge-based content.
DataForce by TransPerfect is part of the TransPerfect family of companies, the world’s largest provider of language and technology solutions for global business, with offices in more than 100 cities worldwide.
We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering, enriching and processing data for Machine Learning in different AI domains.
To learn more about DataForce please visit us at https://www.transperfect.com/dataforce.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Discover remote opportunities in Teaching
Answer easy questions
200,000+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“ I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!