You will test AI agents by running real-life errands such as bookings, shopping, and email follow-ups while screen recording the process. You are responsible for scoring the agent's performance and providing clear written feedback on the user experience.
United States$80 - $125 per hour5-10 yrs expHealthcare
Review medical records and clinical documentation to provide high-quality input for training next-generation AI systems. Identify inconsistencies in clinical data and provide feedback to improve model performance and data quality.
United States$80 - $125 per hour5-10 yrs expHealthcare
Review medical records and inpatient documentation to provide high-quality input for training AI systems. Identify inconsistencies in clinical data and provide feedback to improve model performance and data quality.
United States$80 - $125 per hour5-10 yrs expHealthcare
Review medical records and clinical documentation to support the training and improvement of AI models. Ensure clinical information is accurate, consistent, and supported by medical records while providing feedback to the project team.
United States$80 - $150 per hour5-10 yrs expOthers
Review and assess AI-generated quantitative research and trading strategy outputs focused on fixed income and rates markets. Provide detailed written feedback on model assumptions, statistical rigor, and methodological issues such as lookahead bias and overfitting.
Evaluate and provide feedback on AI-generated trading strategies for various rates products to improve their accuracy and market viability. Collaborate with technology teams to refine trading logic and ensure AI recommendations align with real-world market practices.
Review and annotate short video and audio clips while assessing the accuracy of AI-generated descriptions. Maintain data integrity and provide clear written feedback to support process improvements and content moderation standards.
Develop realistic finance and business process prompts to train AI systems and create objective rubrics for evaluating AI-generated outputs. Review AI agent responses using these rubrics and provide structured, actionable feedback while documenting all work with precision.
United States$60 - $70 per hour2-5 yrs expHealthcare
The Registered Nurse will annotate and review clinical content and inpatient documentation to ensure accuracy and clinical soundness. They will also evaluate AI-generated outputs for clinical safety and appropriateness across various care scenarios.
You will test AI agents by performing real-life errands such as booking trips, shopping, and managing forms while screen recording the process. You are responsible for scoring the agent's performance and providing clear written feedback on the user experience.
You will serve as a forward-deployed research partner embedded in enterprise AI systems to identify failure modes and improve performance. Responsibilities include designing high-signal datasets, running experimental loops, and developing robust agentic workflows.
You will develop, modify, and debug front-end and back-end application components while contributing to an AI training project. Responsibilities include tracing data across systems, diagnosing technical failures, and reviewing AI-generated code for performance and security.
Design and build small-scale game projects and interactive scenes to serve as assessment tasks for AI systems. Integrate gameplay bugs and feature challenges while drafting clear instructions and success criteria for evaluation.
The graphic designer will create high-quality visual assets and digital illustrations to help train next-generation AI systems. They will also collaborate with stakeholders to refine design outputs through iterative feedback cycles.
United States$175 - $300 per hour10+ yrs expFinance
You will contribute to AI training by modeling real-world equity research, analyzing earnings reports, and synthesizing peer benchmarking insights. Additionally, you will produce high-quality research summaries and articulate investment theses based on deep sector expertise.
Review and assess AI responses to business analysis scenarios while ensuring data privacy and quality standards are met. Collaborate with research teams to develop evaluation frameworks and validate data consistency.
Create challenging mobile coding tasks and reinforcement learning environments to train AI models. Define problem parameters, build reproducible environments, and develop deterministic verifiers for code solutions.
You will test 2D and creative applications using real-world workflows to identify bugs, usability issues, and inconsistencies. Additionally, you will create and execute test cases while documenting clear feedback on application functionality and user experience.
The role involves creating high-quality visual assets and digital illustrations to help train next-generation AI systems. You will also critique existing materials and collaborate with stakeholders to ensure design consistency and impact.
United States$180 - $220 per hour5-10 yrs expOthers
The analyst will participate in expert interviews to provide insights into sell-side research methodologies and evaluate AI-powered tools for financial analysis. They will also document feedback and collaborate with project coordinators to improve the accuracy and relevance of AI-generated financial content.
You will perform simulated contract negotiations and redlining exercises to train and evaluate AI models. Additionally, you will collaborate with product and research teams to create evaluation frameworks and refine best practices for AI-driven contract review solutions.
Review and evaluate curated collections of images to assess their aesthetic quality, composition, and creative value. Document and articulate detailed critiques to help train next-generation AI systems.
The specialist will perform realistic financial workflows using the Bloomberg Terminal to support the development of AI systems. They are responsible for documenting processes, identifying data inconsistencies, and providing high-quality financial analysis.
Evaluate Tamil audio clips for nativeness, fluency, and linguistic authenticity to support AI model training. Document assessments with clear feedback and collaborate with coordinators to ensure high-quality results.
You will create challenging coding tasks for AI systems to solve, including feature implementation and bug fixes. Additionally, you will implement deterministic verifiers to validate AI solutions and ensure high-quality model performance.
The specialist will perform network monitoring, alert investigation, and log analysis within the Security Onion platform to support AI model training. They are responsible for documenting workflows, creating realistic prompts, and evaluating task outputs to ensure high-quality data.
The attorney will perform simulated litigation tasks and review AI responses to improve the precision and legal judgment of AI models. They will also collaborate with research teams to develop evaluation frameworks and guidelines for AI-driven legal solutions.
You will contribute to the design and development of end-to-end fullstack systems and internal platform capabilities. You will also build maintainable backend services and high-quality frontend interfaces while collaborating with cross-functional teams.
Evaluate AI-generated content for accuracy, safety, and policy alignment regarding chemical, biological, radiological, and nuclear topics. Identify and flag unsafe or misuse-enabling content while creating gold-standard reference examples for responsible AI behavior.
The Head of Communications will own and execute the company's external communications and PR strategy across media, customers, and the AI ecosystem. Responsibilities include managing media relations, developing messaging for product launches, and positioning company leaders through strategic speaking and interview opportunities.
The Research Marketing Lead will own the end-to-end go-to-market strategy for technical research, benchmarks, and AI evaluations. They will partner with research teams to translate complex technical findings into high-impact narratives that drive adoption and industry engagement.
United States$245 - $280 per hour2-5 yrs expFinance
Evaluate and improve AI model outputs regarding financial reasoning, valuation, and investment analysis. Create expert-level prompts and provide domain feedback to refine model behavior and accuracy.
United States$100 - $200 per hour5-10 yrs expOthers
You will evaluate and annotate data sets to train AI systems while providing expert insights on child development and behavior. You will also collaborate with interdisciplinary teams to ensure psychological integrity and create guidelines for AI interactions.
Evaluate AI-generated code for correctness, quality, and design while creating challenging engineering problems and test cases. Review model reasoning on architecture and provide detailed technical feedback to improve performance.
United States$245 - $280 per hour2-5 yrs expOthers
Evaluate AI model responses to complex business strategy problems and provide detailed feedback to improve performance. Apply structured frameworks to assess reasoning quality and collaborate with the project team to refine guidelines.
Design and create realistic business scenarios and tasks to train next-generation AI systems. Evaluate AI-generated solutions and provide actionable feedback to improve model performance for business documentation.
You will create Reinforcement Learning Environments to test AI models on complex software engineering tasks using Model Context Protocol tools. Your work involves designing reproducible environments and golden reference solutions to measure AI performance in software development.
United States$175 - $300 per hour10+ yrs expOthers
The role involves reviewing and contributing to datasets that model real-world equity research to train AI systems. You will analyze earnings reports, perform valuation analysis, and articulate investment theses based on deep sector expertise.
Design and implement realistic cloud infrastructure environments to evaluate AI model proficiency in systems design and troubleshooting. Develop deterministic validation tests and failure scenarios to rigorously test AI model responses and recovery strategies.
The Data Engineer will design, build, and maintain scalable data pipelines to ingest and process large-scale datasets across cloud environments. They will collaborate with AI researchers and engineering teams to support data-intensive applications and model development.
The QA Engineer will own testing activities across new features and bug fixes while collaborating with engineering teams to ensure product quality. They are responsible for designing manual test cases, executing automated tests, and documenting issues throughout the development lifecycle.
Create, modify, and validate detailed parametric CAD models in FreeCAD while applying GD&T and DFM principles. Conduct engineering QA reviews and develop technical documentation to ensure model accuracy and manufacturability.
Lead the visual direction and execution of high-quality video and motion content across brand campaigns and product launches. Translate complex AI and software concepts into engaging, technical, and futuristic visual stories.
You will provide expert feedback on manufacturing processes and refine AI-generated content for manufacturing workflows. Additionally, you will develop and validate rubrics to evaluate the accuracy and efficiency of manufacturing processes.
Create and modify detailed parametric 3D CAD models and engineering drawings for mechanical components and assemblies. Perform quality assurance and prepare technical documentation to support the training of AI systems.
Develop and evaluate complex psychiatric case studies to train AI models with culturally nuanced scenarios. Conduct psychological assessments and provide expert annotations while ensuring clinical accuracy in both Marathi and English.
Review inpatient clinical documentation to assess accuracy, completeness, and clinical appropriateness. Adjudicate discrepancies and provide well-reasoned judgments while identifying significant errors or omissions.
The Director will build and scale the operational infrastructure by designing automation roadmaps and managing the internal Ops Platform. They will collaborate cross-functionally with Product, Engineering, and Finance to translate complex operational needs into technical requirements.
Analyze complex mechanical assemblies to identify design constraints and formulate technical questions for AI training. Review AI-generated outputs for mechanical reasoning accuracy and document edge cases for project improvement.
Analyze and assess psychological case studies to provide insights for AI model training. Develop culturally sensitive psychological materials and evaluate AI-generated content for accuracy and ethical alignment.
You will create challenging coding tasks and implement deterministic verifiers to help train next-generation AI systems. The role involves designing tasks for feature implementation and bug fixes to shape how models learn and reason.
Analyze and assess psychological case studies to provide insights for AI model training and development. Evaluate AI-generated content for accuracy, ethical standards, and alignment with psychological best practices.
You will perform personal finance workflow tasks and provide expert written explanations on Canadian financial topics to train AI systems. Additionally, you will review AI-generated financial guidance against rubrics to ensure accuracy and quality.
Review and evaluate PCB CAM and Gerber files for manufacturability while performing detailed visual inspections and defect analysis. Collaborate with project leads to refine workflow processes and contribute to the development of AI training datasets.
Analyze written content and AI-generated responses to ensure accuracy, clarity, and adherence to guidelines. Provide constructive feedback and document findings systematically using evaluation tools.
The role involves interpreting complex technical drawings, CNC documentation, and construction plans to provide expert feedback for training AI systems. You will also conduct safety and regulatory reviews of building and fire plans while producing clear technical explanations for project deliverables.
Analyze and assess psychological case studies to provide feedback for AI model training and data enrichment. Collaborate with interdisciplinary teams to ensure AI-generated content aligns with ethical standards and psychological best practices.
Evaluate and disposition First Article Inspections for regulatory compliance while assessing cosmetic defects in manufacturing contexts. Conduct virtual surveys and analyze inspection data to provide expert feedback for AI model development.
Review and annotate robotic system videos by providing feedback based on electrical and electronic system observations. Analyze complex electrical schematics and document technical anomalies to assist machine learning specialists.
The psychologist will analyze and assess psychological case studies to provide insights for training next-generation AI systems. They will also develop culturally sensitive materials and evaluate AI-generated content for accuracy and ethical alignment.
The technician will interpret complex technical diagrams to diagnose equipment faults and analyze PLC logic to identify root causes of operational issues. They will also document detailed troubleshooting reports and provide expert commentary to assist in training next-generation AI systems.
Develop and evaluate complex psychiatric case studies to inform AI model training using real-world, culturally nuanced scenarios. Conduct thorough psychological assessments and provide expert annotations reflecting Lithuanian psychiatric practices.
Review and annotate videos of robotic systems and mechanical components to support AI training. Ensure technical accuracy of annotations and provide feedback on complex or ambiguous examples.
Develop and evaluate complex psychiatric case studies to inform AI model training with culturally nuanced scenarios. Conduct thorough psychological assessments and produce precise documentation in both Tagalog and English.
Review and annotate video footage from robotic systems to identify visual features and anomalies for AI training. Collaborate with development teams to refine annotation protocols and maintain high-quality, consistent datasets.
Develop and evaluate complex psychiatric case studies to inform AI model training with culturally nuanced scenarios. Conduct thorough psychological assessments and provide expert annotations reflecting Georgian psychiatric practices.
The specialist will review accounting workflows, validate financial data, and identify inconsistencies to improve AI systems. Responsibilities include managing invoicing, bill payments, bank reconciliations, and generating financial reports.
The specialist will manage and review Salesforce workflows, including leads, contacts, and opportunities to support business processes. They will also create reports and dashboards while documenting steps to train AI systems.
You will design, build, and manage complex Airtable workflows to support AI model training and data organization. Additionally, you will document these processes and provide feedback to ensure they reflect realistic operational use cases.
The role involves using AI assistant tools to complete and evaluate everyday digital tasks like scheduling and emailing. You will provide structured feedback and grade AI responses to improve model performance and accuracy.
United States$150 - $300 per hour2-5 yrs expOthers
Evaluate code patches generated by LLMs and provide detailed feedback with written justifications. Conduct peer reviews of work submitted by other subject-matter experts.
Canada, United Kingdom, United States2-5 yrs expOthers
The Consulting Specialist will reconstruct and enhance PowerPoint presentations to improve clarity and visual impact while collaborating on AI model training. They will translate complex information into engaging formats and provide constructive feedback on narrative flow and design.
The specialist will reconstruct and enhance data-driven presentations to ensure visual consistency and narrative impact. They will also interpret complex datasets to develop analytics reports that provide actionable insights for stakeholders.
Review, analyze, and enhance book manuscripts to improve clarity, narrative structure, and market alignment. Collaborate with stakeholders to provide actionable editorial feedback and contribute to the development of AI editorial guidelines.
Canada, United Kingdom, United States2-5 yrs expOthers
Analyze and reconstruct technical presentation slides to enhance clarity and visual impact while documenting complex system architectures. Collaborate asynchronously to refine technical narratives and support AI training initiatives through high-quality deliverables.
United States$50 - $100 per hour2-5 yrs expTeaching
The role involves participating in realistic one-on-one tutoring and educational conversations to train AI systems. You will simulate common teaching scenarios, provide constructive feedback, and adapt your communication style to meet various learner needs.
The role involves providing expert insights on IT strategy, systems architecture, and infrastructure to help train AI systems. You will also review documentation, workflows, and security compliance practices to improve operational efficiency and AI development.
United States$70 - $100 per hour10+ yrs expHealthcare
Review inpatient cases for clinical quality, documentation accuracy, and appropriate care while providing feedback to improve AI model training. Collaborate with the project team to clarify complex cases and maintain high-quality review standards.
United States$15 - $20 per hour2-5 yrs expMarketing
The Community Manager will respond to customer inquiries and resolve support tickets while de-escalating conflicts across various channels. They will also monitor community activity and collaborate with internal teams to ensure customer needs are met.
The specialist will play and record AAA games using in-house tools to capture high-quality data for AI training. They are responsible for organizing, annotating, and securely transferring these game sessions while maintaining clear communication with the remote team.
Analyze research-level problems involving AdS/CFT correspondence and holographic Weyl anomalies. Formulate or verify complex tensor algebra expressions and contribute to the training of next-generation AI systems.
The specialist will complete and document real-world GitHub workflows to generate high-quality interaction data for AI system development. Responsibilities include managing repositories, performing version control tasks, and recording screen demonstrations of these workflows.
The specialist will review and analyze written content and AI-generated responses for accuracy, clarity, and adherence to guidelines. They will provide constructive feedback and document findings using specific evaluation tools.
Design realistic business scenarios and engage in structured conversations with LLMs to evaluate document-related deliverables. Document feedback and provide side-by-side preference data to improve AI model quality and accuracy.
Lead the design and execution of CRISPR-based gene editing experiments and develop cloning strategies for novel constructs. Collaborate with interdisciplinary teams to translate experimental data into structured formats for AI model training.
Reconstruct and enhance executive-level business slides for sales and go-to-market contexts using Microsoft PowerPoint. Provide a detailed reasoning log for all design and content changes to support AI training and evaluation.
Annotate and label audio and video content while ensuring high accuracy and consistency across datasets. Collaborate with project leads to resolve queries and provide feedback on annotation processes to improve workflows.
You will complete and document realistic Google Analytics workflows to provide high-quality interaction data for AI system development. This involves recording your screen, creating detailed rubrics, and reviewing outputs for accuracy.
The Stripe Specialist will execute and document realistic payment and financial workflows within the Stripe platform to generate high-quality interaction data. This role involves recording screen sessions, creating detailed rubrics, and explaining Stripe features to support the development of AI systems.
You will complete realistic music production workflows in FL Studio and document the steps taken to support AI system development. This involves recording your screen, creating detailed rubrics, and evaluating task outputs for accuracy.
You will complete and document realistic educational workflows within Google Classroom to support the development of AI systems. This includes creating assignments, managing student data, and recording your screen to demonstrate these processes.
The role involves performing simulated contract negotiations and redlining exercises to train and evaluate AI models. You will collaborate with research teams to create evaluation frameworks and provide expert feedback to improve AI precision in legal tasks.
Review and annotate video footage of robotic arms performing tasks to ensure accurate grading based on established guidelines. Collaborate with trainers and contributors to maintain high-quality standards and provide feedback to improve annotation processes.
Perform simulated contract negotiations and redlining exercises to provide expert feedback for AI model training. Collaborate with product and research teams to establish evaluation frameworks and improve the precision of AI-driven contract review solutions.
You will analyze, debug, and resolve software vulnerabilities while contributing to the training of next-generation AI systems. Additionally, you will perform security audits, penetration testing, and refactor legacy code to enhance system performance and security.
You will create challenging coding tasks for AI systems involving feature implementation and bug fixes. Additionally, you will implement deterministic verifiers to validate AI-generated solutions.
Design and tune PID and advanced controllers for deployment on physical systems like robotics or industrial hardware. Develop and validate plant models using first principles and implement control algorithms in Python.
Create, review, and refine detailed civil and structural BIM models and drawing sets while ensuring compliance with international engineering codes. Provide high-quality domain input to train and evaluate AI-powered engineering systems.
You will apply your technical expertise to train next-generation AI systems by providing high-quality, real-world input. The role involves building scalable services, performing security audits, and optimizing backend performance.
You will apply your software engineering expertise to train next-generation AI systems by providing high-quality, real-world input. Your work involves building scalable services, optimizing performance, and resolving complex software bugs.
You will create Reinforcement Learning Environments to test AI models on complex software engineering tasks like debugging and refactoring. Additionally, you will contribute expert-level code samples and validate peer-contributed technical submissions to improve AI training data quality.
The Virtual Assistant will manage day-to-day administrative tasks, team logistics, and operational documentation. They will also oversee gifting operations, vendor coordination, and expense tracking for the distributed team.
United States$150 - $350 per hour2-5 yrs expOthers
Reconstruct and enhance business slides for product and engineering roadmaps to train AI systems. Document detailed logs justifying all design and content improvements made to the slides.
You will analyze, profile, and optimize GPU kernels to maximize computational throughput while collaborating with stakeholders to identify and resolve bottlenecks. Additionally, you will refactor C++ and CUDA codebases and implement shader logic using GLSL and WebGPU to ensure seamless pipeline integration.
United States$150 - $350 per hour2-5 yrs expOthers
Analyze and reconstruct business slides related to travel, hospitality, and culinary topics to improve data visualization and visual storytelling. Document all changes made and provide rationales for design decisions to support AI model training.
Evaluate and refine AI-generated responses to ensure accuracy, clarity, and alignment with business objectives. Author and enhance technical documentation, strategy reports, and market analyses while providing actionable feedback on AI performance.
You will create Reinforcement Learning Environments to test AI models on complex software engineering problems using Model Context Protocol tools. Your tasks include fixing bugs, implementing features, and refactoring code to measure AI performance and reasoning capabilities.
Provide expert feedback on manufacturing processes and refine AI-generated content related to CAM and CNC workflows. Develop and validate detailed rubrics to evaluate the accuracy and efficiency of manufacturing processes.
United States$300K - $500K per year2-5 yrs expProduct
The Strategic Project Lead will own end-to-end project execution for AI Lab customers, from pipeline scoping to delivery. They will align operations and domain experts while maintaining clear client communication and driving rapid project milestones.
The role involves reconstructing and enhancing business slides for operations and service delivery projects to train AI systems. You will improve data visualization, narrative flow, and factual accuracy while providing written logs to justify your design and content choices.
Design, implement, and optimize GPU-based software solutions using CUDA, WebGPU, or GLSL. Profile and fine-tune GPU kernels and shaders while developing host-side logic in C++.
Analyze, review, and enhance AI-generated technical content while creating and refining prompts to guide AI model performance. Conduct rubric-based assessments and draft technical documentation to support the training of next-generation AI systems.
You will create Reinforcement Learning Environments to test AI models on complex software engineering tasks using Model Context Protocol tools. Responsibilities include fixing bugs, refactoring code, and designing reproducible environments to measure AI performance.
Analyze and synthesize information from public records and lengthy documents to produce accurate, factual articles. Participate in iterative editorial reviews and maintain transparency by documenting research methods and citation trails.
Diagnose and resolve complex hardware, software, and networking issues while documenting solutions in a ticket management system. Contribute detailed process insights to enhance support workflows and provide high-quality input for AI training data.
The Supply Chain Manager will utilize ERP systems to support supply chain workflows, build demand forecasts, and develop supplier evaluation scorecards. Additionally, the role involves analyzing inventory levels and preparing actionable reports using Excel to support procurement decision-making.
The role involves designing and producing expert-level evaluation tasks to train AI systems by simulating real-world data entry and validation challenges. You will also curate complex datasets and author detailed grading rubrics to assess AI agent performance.
Analyze and interpret domain-specific charts and data visualizations to provide accurate, step-by-step reasoning. Design clear, objective, and unambiguous tasks that require multi-step quantitative analysis for AI training purposes.
Interpret complex financial and operational charts to draft objective reasoning questions for AI training. Collaborate remotely to ensure high-quality, unambiguous tasks that support the development and evaluation of AI models.
United States$25 - $50 per hour2-5 yrs expTeaching
Interpret complex statistical visualizations and design objective, multi-step analytical tasks to train AI systems. Deliver precise, unambiguous answers with detailed written explanations using advanced data science terminology.
Develop, implement, and refine features within open source codebases while resolving complex bugs and refactoring legacy code. Collaborate remotely with contributors to maintain documentation and deliver high-quality, scalable technical solutions.
The role involves analyzing, debugging, and refactoring codebases across multiple programming languages to support AI model training. You will also develop coding tasks and provide actionable feedback to evaluate and improve AI performance.
United States$175 - $300 per hour10+ yrs expFinance
You will conduct comprehensive financial research and build detailed Excel-based valuation models to support AI training initiatives. Additionally, you will prepare and critique client-facing materials, ensuring methodological accuracy and strategic clarity.
Develop, modify, and debug front-end and back-end application components while implementing user-facing features and supporting services. Evaluate and improve code written in multiple programming languages and review AI-generated solutions for performance and security.
Engage in realistic one-on-one career coaching conversations to help train next-generation AI systems. Provide practical guidance on career planning, job searches, and professional development while following project guidelines.
Audit and reconcile CRM and revenue systems to resolve operational inconsistencies, policy conflicts, and data inaccuracies. Draft operational prompts and document technical reasoning to support system optimization and sustainable governance.
You will evaluate AI-generated psychological content for accuracy and ethical standards while developing data sets for training AI systems. Additionally, you will provide detailed feedback to refine AI responses in clinical and therapeutic contexts.
Design and develop high-quality, accessible user interfaces while collaborating with cross-functional teams to translate requirements into functional solutions. You will champion frontend best practices, including component reusability and performance optimization, to ensure a seamless user experience.
You will work directly with leading AI labs and enterprises to define research goals and implement ML and evaluation pipelines. This role involves building large-scale data intelligence systems and developing agentic workflows for production environments.
Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions. Collaborate with cross-functional teams to implement data integration, transformation, and processing solutions.
You will design, develop, and refine machine learning models while managing large datasets using MongoDB. Additionally, you will collaborate with cross-functional teams to evaluate model performance and document technical workflows.
The specialist will analyze case-based scenarios and review AI-generated mental health guidance to ensure clinical accuracy and sensitivity. They will also develop best practices for trauma-informed care and collaborate with cross-disciplinary teams to refine training data quality.
Review and annotate short video and audio clips to support AI training and evaluation objectives. Provide clear written feedback on AI-generated descriptions and ensure content labeling adheres to project guidelines.
Canada, United Kingdom, United States2-5 yrs expWriting
Evaluate and compare AI-generated responses against writing prompts to ensure clarity, tone, and instructional value. Provide detailed rationales and analytical scores while collaborating asynchronously with project managers.
Assess and score AI-generated responses based on clarity, tone, and adherence to instructions. Document detailed rationales for evaluations and identify factual inaccuracies or constraints violations.
Review and analyze extensive business data sets to ensure accuracy, relevance, and compliance with PII and data privacy protocols. Provide detailed feedback and recommendations to inform and refine AI training processes.
You will author precise, verifiable question-and-answer sets based on multi-part CAD assemblies to train AI systems. Additionally, you will analyze complex mechanical designs and collaborate asynchronously to refine technical content.
You will design and ship fullstack features, including backend APIs, data pipelines, and React frontends while managing platform infrastructure. You will also collaborate with research and operations teams to build resilient, observable systems using AI-driven development workflows.
Develop and validate machine learning models, training pipelines, and inference systems while optimizing for performance and hardware utilization. Diagnose complex system-level failures and review AI-generated code to ensure correctness and engineering quality.
The specialist will review and refine Shopify-related analytical tasks to ensure they align with real-world platform workflows and data models. They will provide actionable feedback to improve the realism and completeness of AI training scenarios.
The Senior AI Trainer will review and annotate video footage of robotic arms to provide high-quality data for training AI systems. This involves precise timestamping, event segmentation, and collaborating with team members to ensure annotation consistency.
Design and implement realistic cloud infrastructure environments to evaluate AI model proficiency in systems design and troubleshooting. Develop deterministic validation tests and failure scenarios to rigorously test AI model responses and recovery strategies.
Evaluate and rate AI-generated technical outputs against quality criteria while identifying inaccurate or incomplete information. Design comprehensive test cases for functional and edge-case scenarios and document defects with precise reproduction steps.
Develop high-difficulty question-and-answer pairs that challenge AI models on interpretation, argument, and analytical reasoning within the humanities. Research and provide authoritative citations while testing and refining questions against AI models to ensure accuracy and clarity.
You will apply your physics expertise to solve advanced problems and provide rigorous, well-documented derivations to help train next-generation AI systems. The role involves producing technically precise solutions using LaTeX and computational tools while ensuring high standards of reproducibility.
The expert will design, analyze, and validate various electronic circuits including analog, digital, and RF systems. They are also responsible for reviewing AI-generated circuit solutions and developing automated verification workflows using Python and CLI-based tools.
United States$60 - $120 per hour5-10 yrs expOthers
Analyze complex computer systems and business processes to identify improvements while gathering and validating requirements from stakeholders. Collaborate with cross-functional teams to troubleshoot technical issues and contribute domain expertise to AI training data design.
You will analyze technical decisions and evaluate architectural proposals to provide expert-level feedback. Additionally, you will produce comprehensive technical documentation and develop automation testing strategies to optimize system performance.
United States$245 - $280 per hour2-5 yrs expFinance
You will evaluate and improve AI model outputs regarding financial reasoning, valuation, and investment scenarios. This involves creating expert-level prompts and providing domain feedback to refine model behavior.
United States$245 - $280 per hour10+ yrs expTeaching
Evaluate AI model responses for accuracy, depth, and reasoning quality while creating expert-level prompts and critiques. Apply academic rigor to identify errors and help define performance standards for AI systems.
Evaluate AI-generated content for quality, accuracy, and structure while providing detailed editorial feedback. Develop reference materials that establish high standards for AI-generated writing.
You will create Reinforcement Learning Environments to test AI models on complex software engineering tasks like debugging, refactoring, and performance optimization. Additionally, you will contribute expert-level code samples and validate peer-contributed technical submissions.
Capture high-quality, first-person video footage of everyday activities using a smartphone to train AI systems. Ensure all metadata is accurate while adhering to strict privacy, safety, and consent protocols.
The specialist will assess and refine CRM data models while designing compliance-constrained workflows for SaaS revenue processes. They will also diagnose data integrity gaps and contribute operational insights to train AI systems.
You will configure and optimize CRM systems and revenue-related tools to improve operational efficiency and data integrity. Additionally, you will establish workflows, resolve policy conflicts, and provide actionable reporting to support high-growth teams.
Analyze technical materials to produce well-structured developer and product documentation. Create and edit high-quality content while adhering to information architecture and docs-as-code standards.
Analyze product and design challenges to articulate decision-making rationales through structured written deliverables like design docs and research reports. Evaluate design systems, accessibility, and frontend architecture while providing expert commentary on project artifacts.
Design, develop, and refine machine learning models while managing large datasets using MongoDB. Collaborate with cross-functional teams to evaluate model performance and integrate efficient data pipelines.
You will design, implement, and manage highly available PostgreSQL database architectures within a cloud-native environment. Additionally, you will optimize database performance, automate maintenance tasks, and ensure disaster recovery readiness.
Evaluate AI model responses to complex business strategy problems and provide detailed feedback to improve performance. Apply structured consulting frameworks to assess reasoning quality and identify gaps in model outputs.
Australia, Canada, Ireland +3 more$245 - $280 per hour2-5 yrs expSoftware Development
Evaluate AI model outputs across statistics, machine learning, and quantitative reasoning to ensure high-quality performance. Create expert-level prompts, datasets, and reference solutions while providing structured feedback to improve model capabilities.
You will evaluate and improve AI model outputs regarding financial reasoning, valuation, and investment analysis. This involves creating expert-level prompts, identifying errors in model responses, and providing domain feedback to shape model behavior.
Design and simulate high-quality multi-turn conversations between users and AI assistants to improve Large Language Models. Collaborate with peers to ensure logical flow, proper tool usage, and adherence to quality guidelines.
The specialist will manage CRM operations, pipeline visibility, and forecasting to support revenue growth. They will also build dashboards and analyze sales trends to provide actionable insights for leadership.
You will create Reinforcement Learning Environments to test AI models on complex software engineering problems using Model Context Protocol tools. Tasks include fixing bugs, implementing features, refactoring code, and optimizing performance to ensure high-quality model training.
United States$60 - $120 per hour5-10 yrs expOthers
You will create Reinforcement Learning Environments to test AI models on complex software engineering problems using Model Context Protocol tools. Your tasks include fixing bugs, implementing features, refactoring code, and optimizing performance to ensure high-quality AI training.
Design visually compelling graphics, layouts, and interfaces while creating UI/UX wireframes and prototypes using Figma. Collaborate in a remote environment to provide feedback on design iterations and contribute insights on user interaction best practices.
Deliver empathetic and efficient customer support while documenting interactions using CRM software. Contribute expert product knowledge to address queries and provide input to train AI systems in real-world contexts.
You will create reinforcement learning environments to test AI models by solving full-stack software problems. This involves writing code, troubleshooting bugs across the UI and API layers, and documenting technical decisions to improve AI training data.
Identify, engage, and close partnerships with companies to acquire operational data for AI training and evaluation. Manage the full sales pipeline from initial outbound prospecting to signed agreement and partner onboarding.
Design, develop, and maintain scalable backend systems using Java and Spring Boot while architecting robust microservices. Collaborate with the team to review technical specifications, optimize system performance, and document technical solutions.
Design realistic DevOps tasks based on production scenarios and write working reference solutions with validation steps. Review AI-generated output to identify failures and provide precise corrections with reasoning.
Develop and maintain high-quality front-end interfaces using React and React Native while collaborating with designers. Deliver tasks independently within a distributed team environment to meet project specifications.
You will create Reinforcement Learning Environments to test AI models by developing code samples, debugging, and building features. Additionally, you will document your technical reasoning and review peer-contributed code to ensure high-quality training data.
Design and implement cloud infrastructure environments to evaluate AI model proficiency in systems design and deployment. Develop deterministic validation tests and failure scenarios to ensure the reliability and accuracy of reinforcement learning environments.
Design, build, and maintain scalable data pipelines and storage solutions to support AI-driven products and research. Collaborate with cross-functional teams to ensure data quality, operational reliability, and efficient processing workflows.
United States$50 - $120 per hour5-10 yrs expOthers
The expert will provide feedback on manufacturing processes and refine AI-generated content related to CAM and CNC workflows. They are also responsible for developing and validating rubrics to evaluate the accuracy and efficiency of manufacturing processes.
United States$140 - $245 per hour5-10 yrs expLegal
Conduct comprehensive legal analysis and research to support project objectives and provide nuanced insights. Draft, review, and edit legal documents while ensuring content quality and accuracy through structured feedback.
Poland, United Kingdom$40 - $85 per hour5-10 yrs expOthers
Develop high-quality model responses and 'golden responses' for complex mathematics prompts to be used in AI training. Collaborate with a global team to refine mathematical content and improve project guidelines.
Support the full recruitment lifecycle by sourcing candidates via LinkedIn and portals, validating profiles, and coordinating interviews. Maintain recruitment trackers and assist with hiring operations for both IT and Non-IT requirements.