Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewQuestions interviewers often ask for this role, with sample answers.
One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
You will drive the architecture for user-data handling and lead the migration of existing pipelines while ensuring output consistency. Additionally, you will establish engineering processes, mentor team members, and handle incident management.
Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable products, platforms, and data-driven solutions.
We specialize in Artificial Intelligence, Data and Cloud, Intelligent Automation, and Digital Products, combining deep technical expertise with a strong focus on engineering excellence and a people-first culture.
In the CEE region, we’re a team of nearly 1,000 experts delivering modern applications, data platforms, and AI solutions for clients such as Millennium, ING, Play, Edenred, Arabian Drilling, FedEx, Leroy Merlin, Truecaller, Volotea, Schmitz Cargobull, and many, many more. We work with leading technologies including AWS, Azure, GCP, Databricks, and Snowflake, and combine strong engineering culture with a consulting mindset and a continuous focus on growth and knowledge sharing.
Proposing and driving the architecture for user-data handling across Airflow, Spark, dbt and BigQuery, including encryption points, derived tables, backfills and partitioning.
Migrating existing pipelines one at a time while keeping their outputs unchanged, using a regression harness you build.
Designing and introducing processes the team will use after the migration, including pipeline change reviews, testing standards, incident post-mortems and release checklists.
Refactoring pipelines to remove duplicated steps and copy-pasted logic.
Building verification jobs to demonstrate that data-lifecycle rules are followed end to end.
Pairing with and mentoring a data engineer, with the goal of enabling the team to own the migrated pipelines independently.
Sharing pipeline maintenance and incident handling, and addressing root causes.
Documenting key decisions in concise architecture decision records.
Deep hands-on experience with Airflow, Spark, dbt, BigQuery and Python.
A track record of technically leading at least one pipeline migration from start to finish.
Experience refactoring a live pipeline and proving that its output remained unchanged.
Proven ability to introduce engineering practices such as testing, code review and incident handling, and help a team adopt them consistently.
Mentoring experience with a concrete outcome.
A hands-on approach to technical decisions, combined with the ability to support and guide other engineers.
Work from the European Union region and a work permit are required.
Experience with encryption at rest, data retention or deletion compliance, for example GDPR.
Experience with envelope encryption and a key manager such as GCP KMS, BigQuery AEAD functions or Tink.
Experience with BigQuery column-level security, policy tags or Data Catalog.
Experience with Config Connector (KCC) for managing GCP resources from Kubernetes.
Experience working with Kafka events.
CV review – HR call – Interview – Client Interview – Decision
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 221,014+ Jobs in Data Engineer
Answer easy questions
221,014+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”