For Employers

Clera

Senior Data Engineer

Posted 2 hours ago
$100K - $140K per year
5-10 years experience
Apply Now

Please mention DailyRemote when applying

?
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

You will design and own a multi-source data platform, managing everything from ingestion and event-driven processing to orchestrated batch workflows. Your role involves building robust data pipelines, ensuring data quality through contracts and testing, and optimizing storage and transformation layers.

About the Role

Join a data infrastructure and analytics team building a platform that turns information from multiple sources into reliable, current company intelligence. You will own the platform across architecture, ingestion, and production operations, supporting products with trusted data.

What You'll Do

  • Design a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows.

  • Build ingestion from provider APIs, webhooks, files, and web scraping, with rate limits and robust failure handling.

  • Orchestrate scheduled workflows and historical backfills using Airflow, Dagster, Prefect, or similar tools.

  • Develop event-driven processing with messaging or task queues, including retries, dead-letter handling, and controlled replay.

  • Preserve source payloads in Google Cloud Storage and transform them with dbt into raw, standardized, and curated layers.

  • Implement idempotent upserts and safe retries to prevent duplicate records and data corruption.

  • Define data contracts, validation, pipeline tests, and monitoring for freshness and failures.

  • Optimize PostgreSQL schemas and loading patterns, and integrate enrichment and LLM-based structured extraction.

What We're Looking For

  • At least 5 years building and operating production data platforms that integrate multiple sources, with ownership from architecture through deployment and ongoing operations.

  • Production experience with workflow orchestration, including dependencies, retries, and recovery; Airflow is preferred.

  • Hands-on production experience with dbt and Google Cloud Platform.

  • Strong Python skills, including asynchronous HTTP and concurrent processing with tools such as asyncio, aiohttp, or HTTPX.

  • Strong SQL and PostgreSQL skills, including data modeling, query optimization, and incremental loading.

  • Experience with event-driven systems, messaging or task queues, data contracts, raw and curated storage, retention policies, automated testing, and pipeline monitoring.

  • Experience building platforms or substantial pipelines from scratch is valuable. Web scraping, entity resolution, BigQuery, Dataform, and LLM-based extraction are also relevant.

Compensation & Benefits

Base salary: $100,000 to $140,000 USD annually. Visa sponsorship is not available.

Location

Remote within Europe, including Norway, Switzerland, and the United Kingdom.

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Software Development jobs →

Sr. Manager, Applications Development

Full Time United States Software Development

Sr. Software Developer, E-Commerce Systems

Full Time Argentina Software Development

Business Insights Analyst, Remote US

Full Time United States Software Development

Senior Network Engineer

Full Time United States Software Development

Data & AI Forward Deployed Engineer

Full Time Colombia Software Development

2028 Systems Requirements Engineer MID

Full Time Mexico Software Development
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 223,976+ Jobs in Data Engineer

Answer easy questions

Answer easy questions

223,976+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified