You will define and improve benchmarking methodologies for frontier coding agents while partnering with top AI researchers and engineers. Your work involves creating high-signal feedback systems, developing evaluation environments, and contributing to open-source research products.
You will own the end-to-end strategy and execution for integrations and data partnerships, including sourcing, negotiating, and managing relationships with ATS and CRM vendors. You will also collaborate with product and engineering teams to translate partner needs into technical requirements and drive measurable adoption.
You will stress-test large language models by designing adversarial prompts to expose vulnerabilities such as bias, hallucinations, and broken guardrails. Additionally, you will document experiments, score model responses against harm taxonomies, and collaborate with researchers to strengthen AI defenses.
Provide technical support to users via email and phone while resolving bugs, inquiries, and workflow issues. Collaborate with internal teams to improve user experience and contribute to product feedback loops.
The Senior Partner Insights Manager will lead analytics initiatives to drive partner strategy and improve student outcomes across educational institutions. They will build and scale data products, dashboards, and reporting frameworks while collaborating cross-functionally to translate complex data into actionable insights.
The Resume Reviewer will evaluate a high volume of candidate resumes daily to assess qualifications and project fit. They are responsible for making quick, accurate decisions to match candidates with project opportunities while meeting daily throughput targets.
You will design, build, and publish coding benchmarks to measure and improve frontier coding agents. This involves creating realistic software-engineering tasks and developing reliable evaluation methodologies to diagnose agent capabilities and failure modes.
Design and execute adversarial prompts to test AI model safety against CBRNE threats while documenting failure points. Collaborate with researchers and policy teams to refine evaluation frameworks and improve model defenses.
You will design adversarial prompts and multi-turn interaction chains to test AI models for vulnerabilities related to cyberattacks and malware generation. Additionally, you will evaluate model-generated technical output for functional correctness and document findings within a structured cybersecurity framework.
