You will architect the transformation and warehouse layers to process billions of records while integrating LLM-based extraction and validation into production infrastructure. You are responsible for designing evaluation harnesses, managing token budgets, and ensuring data quality through robust observability and orchestration patterns.
Architect and own the end-to-end extraction and ETL pipeline to transform unstructured web data into a high-accuracy B2B dataset. Define architectural standards for extractor frameworks, LLM infrastructure, and agentic workflows while ensuring cost-effective and reliable data processing.
You will own the design, build, and operation of backend services, RESTful APIs, and AI/LLM systems while leading two engineering pods. This role is 80% hands-on architecture and engineering, focusing on scaling systems and setting high technical standards for the team.
You will lead a team of Applied AI Engineers to architect and maintain systems for measuring, verifying, and enforcing data quality across billions of records. This involves building verification pipelines, LLM-based validators, and release gates to ensure high-quality data reaches customers.
