Design realistic, multi-step coding and technical tasks to evaluate the reasoning and instruction-following capabilities of frontier AI models. Grade model outputs against rubrics, provide structured feedback, and collaborate with the team to improve AI engineering practices.
You will contribute your professional expertise to develop realistic scenarios and problems for AI training and evaluation. Additionally, you will review work for accuracy, define quality standards, and provide clear explanations to improve AI performance.
