Match your resume skills with our AI powered skill match!
Questions interviewers often ask for this role, with sample answers.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
You will lead the development and evolution of the Human Data platform, including evaluation environments for RL, coding, and STEM. Additionally, you will manage operational workflows such as payments, task approvals, and project taxonomies to ensure production efficiency.
Anyone AI Labs — Anyone AI’s Human Data Division Owns: the Human Data platform (RL / coding / STEM evaluation environments, pipelines & project taxonomies, and the admin/ops surface like payments, task approve/reject, roles, revenue & cost)
Location: Remote / LatAm / US
The role Development of the platform that runs Anyone AI’s Human Data work end to end. That means standing up and evolving environments for RL, coding, STEM, and related evals; leading pipeline and project-taxonomy design; and building the admin systems that keep production moving, payments, task approval and rejection, roles, and visibility into project revenue and cost. This is a high-autonomy seat: you lead the platform initiative. You need enough fluency in human data / evaluation workflows to make the right product and engineering calls without constant hand-holding.
Responsibilities
● Evaluation environments. Design, stand up, and harden RL, coding, STEM, and other eval environments that contributors and internal teams can actually run against (reliably, repeatably, and at the quality bar labs expect).
● Pipelines & taxonomies. Lead platform development for how projects are structured: pipelines from brief → tasks → QC → delivery, plus project taxonomies that stay coherent as we add domains and clients.
● Admin & operations surface. support the operational layer: payments / payouts, task approve/reject flows, RBAC and roles management, and practical revenue & cost visibility per project.
● Lead the initiative. Set technical direction for the platform, prioritize ruthlessly between env work, pipeline, and admin firefighting, and leave the system more instrumented and operable than you found it. Experience
● Owned a multi-sided platform (operators + contributors + internal stakeholders), not only feature slices.
● Built or deeply operated systems in human data, RLHF, labeling, or model evaluation — or very close: RL/eval harnesses, annotation pipelines, coding/STEM eval environments.
● Shipped admin or back-office workflows: approvals, roles/permissions, payments or payouts, and operational metrics.
● Led a technical initiative with high ambiguity on a small team.
Qualifications
● Senior software engineer (4+ years, or equivalent ownership): backend or full-stack, comfortable owning a production web product and the services behind it.
● Proven autonomy, you can take a messy domain (human data / evals) and turn it into a roadmap and shipped systems.
● Working fluency with how frontier human-data and evaluation work actually runs (tasks, QC, environments, expert workflows) enough to design for it, not only implement specs.
● Nice to have: env orchestration (containers, workers, sandboxes), prior work at or adjacent to Scale AI / Surge / Handshake AI / Labelbox / Other platforms, modern web/data stack familiarity.
● Fluent English. Spanish is a nice-to-have.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 218,224+ Jobs in Platform Engineer
Answer easy questions
218,224+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”