For Employers

Avra

Member of Technical Staff | Knowledge Platform

Posted 5 hours ago
5-10 years experience
Apply Now

Please mention DailyRemote when applying

?Not checked yet0100
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Tailor your resume to this job

One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.

  • Job match score for this posting
  • Edits you accept or skip, no invented facts
  • Download it when it reads right: TXT free, PDF with Premium

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

You will build and maintain the acquisition layer for data collection using crawlers, scrapers, and browser automation. Additionally, you will manage the data platform, including streaming pipelines and lakehouse infrastructure to ensure high-quality, versioned data for research and production.

About Avra

Avra is a frontier AI lab building relational foundation models from the ground up (no third-party wrappers).

We model how businesses and individuals are connected and interact over time. Put simply: we bring connections into the math.

Leading enterprises in LatAm use Avra's models to power key decisions in credit, growth, and fraud. Our customers include the largest banks and marketplaces in Latin America, such as Mercado Libre, Telefonica, Banco Inter and Getnet.

Avra was founded in 2024 by Viviane Meister and Bruno Alano (ex-OpenAI). Our investors include NXTP, Clocktower Ventures, as well as the Sequoia and a16z scouts. We are accelerated by NVIDIA, AWS, and Google.

We are a team of builders. Join us.

About the role

Avra is a frontier AI lab building relational foundation models. You own how data gets into Avra and what shape it is in when it arrives.

That covers two paths. The first is acquisition: crawlers, scrapers and browser automation that collect data from sources with no API, and keep collecting when those sources change. The second is the data platform itself: the streams, pipelines and lakehouse that turn raw captures and large relational datasets into versioned tables that research, training and production predictions depend on.

This is a hands-on role for someone who has done both sides: built collection systems against difficult sources, and moved large volumes of data through production pipelines.

What you'll do

  • Build and run the acquisition layer: crawlers, scrapers and browser RPA that collect data from websites and portals, with scheduling, retries, session handling and change detection.

  • Keep collection reliable as sources change: detect layout and access changes early, track coverage and freshness per source, and repair quickly.

  • Run event-driven ingestion on Kafka and Pub/Sub, including ordering, replays, dead-letter queues, backpressure and idempotent consumers.

  • Build batch and incremental pipelines in Spark, dbt and SQL that turn raw captures into clean, typed, relational tables.

  • Own the lakehouse on Parquet and Iceberg: schema evolution, partitioning, compaction, and snapshots that make training sets reproducible.

  • Set data quality and lineage standards: contracts, tests, and traceability from a prediction back to the source record.

  • Operate everything on Kubernetes, packaged with Helm, provisioned with Terraform and shipped through CI/CD with reliable rollback.

  • Collect responsibly, in partnership with Security and Legal: rate limits, terms of use, LGPD and handling of personal data.

How we measure success

  • Freshness: time from a change at the source to that data being available in the lakehouse.

  • Coverage and success rate per source, and time to recover when a source breaks.

  • Time to onboard a new source, from first request to production collection.

  • Pipeline reliability: on-time runs, failed runs and consumer lag.

  • Data quality: issues caught by tests before consumers see them, against issues noticed downstream.

  • Cost per record collected and per terabyte processed.

What we're looking for

  • 5+ years of relevant engineering experience at tech and product-driven companies.

  • Required: a production background in at least one of web scraping, large-scale crawlers, or browser RPA. You have built and operated collection against real sources, not only consumed APIs.

  • Required: a data engineering background with large volumes of data, using Spark, dbt and SQL, on columnar and table formats such as Parquet and Iceberg.

  • Experience with messaging and streaming systems in production: Kafka and/or Pub/Sub.

  • Production code in Python and JavaScript, from pipelines and crawlers to browser automation.

  • Hands-on Kubernetes experience, including packaging with Helm.

  • Infrastructure as code with Terraform, and CI/CD pipelines with reliable rollback.

  • Willingness to operate what you build, including incident response when a source or pipeline breaks.

  • Daily use of coding agents, with a considered view on using them safely.

Nice to have

  • Collection from difficult sources: heavy JavaScript rendering, logged-in sessions, rate limits and proxy management, with tools like Playwright, Puppeteer or Scrapy.

  • Workflow orchestration with Airflow, Dagster or Temporal.

  • Entity resolution and relational or graph data modeling across many sources.

  • Datasets for ML: point-in-time correctness, reproducible training sets and evaluation splits.

  • GCP and AWS data services, including GKE, BigQuery, Dataproc and EKS.

  • Observability with OpenTelemetry.

  • Financial services or regulated environments, including LGPD and ISO 27001.

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Others jobs →

Brand Reputation Manager

Full Time Europe Others

Senior Residential Hazard Mitigation Subject Matter Expert (California)

Full Time United States $98187 - $166K per year Others

Nuclear Engineer 4

Full Time United States $125K - $200K per year Others

Supply Chain Associate, Demand Planning

Full Time Poland Others

Senior Director, Programs and Impact

Full Time United States $125K - $135K per year Others

School Certifying Official

Other United States $70304 - $75000 per year Others
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 221,512+ Jobs in Others

Answer easy questions

Answer easy questions

221,512+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified