You will serve as the primary point of contact for a group of domain experts, managing their onboarding, performance, and retention. Additionally, you will route operational issues to the appropriate teams and use automation to streamline communication and tracking.
United States$50 - $125 per hour2-5 yrs expMarketing
Identify and engage high-quality technical experts across various domains to build a robust talent pipeline. Automate research and outreach processes while ensuring candidates meet strict quality standards through screener assessments.
Collaborate with researchers to simulate production-style reliability scenarios, including incident response, debugging, and infrastructure changes. Document reasoning, verify scenario realism, and help define acceptance criteria for training frontier AI models.
You will work live with researchers to implement and review payment flows in a sandboxed codebase, including authorization, capture, and dispute handling. Additionally, you will provide feedback on scenario realism, define acceptance criteria, and document your technical reasoning.
Design realistic mechanical engineering tasks and evaluation scenarios that test the capabilities of AI models. Document reference solutions, scoring criteria, and provide expert insights into industry-standard workflows for the research team.
United States$50 - $150 per hour2-5 yrs expWriting
Design realistic healthcare tasks and scenarios that challenge AI models to improve evaluation and training data. Document reference solutions, define scoring criteria, and validate clinical accuracy of AI responses.
Design realistic legal tasks and scenarios that test AI model capabilities in areas like litigation, M&A, and privacy. Document reference solutions, create explicit scoring criteria, and refine tasks based on model performance.
Design realistic sales tasks and scenarios that serve as evaluation and training data for frontier AI models. Document reference solutions, define scoring criteria, and test tasks against AI models to identify performance gaps.
United States$50 - $150 per hour2-5 yrs expFinance
Design realistic finance tasks and scenarios that challenge AI models while documenting reference solutions and scoring criteria. Evaluate model performance against these tasks to improve training data for frontier AI models.