Lead Data Engineer

 Posted 23 days ago
     
5-10 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Design, build, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark. Collaborate with data scientists to implement Lakehouse architecture and ensure data quality and security across cloud platforms.

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. 

Job Description

Your Role:

  • Design, build, and maintain data pipelines and ETL processes using Databricks and Apache Spark.
  • Optimize data workflows for performance, scalability, and cost efficiency.
  • Implement data Lakehouse architecture and manage data ingestion from multiple sources.
  • Collaborate with data scientists and analysts to enable advanced analytics and machine learning workloads.
  • Ensure data quality, governance, and security across all data assets.
  • Monitor and troubleshoot Databricks clusters, jobs, and workflows.
  • Integrate Databricks with cloud services (AWS, Azure, or GCP) and other enterprise systems.
  • Document processes, standards, and best practices for data engineering.

 

Your Profile:

  • Hands-on experience with Databricks, Apache Spark, and PySpark.
  • Strong knowledge of SQL, Python, and data modeling principles.
  • Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
  • Familiarity with Delta Lake, Lakehouse architecture, and data governance.
  • Understanding of CI/CD pipelines and DevOps practices for data workflows.

 

#LI-DC10

#LI-Remote

Capgemini is an AI-powered global business and technology transformation partner, delivering tangible business value. We imagine the future of organizations and make it real with AI, technology and people. With our strong heritage of nearly 60 years, we are a responsible and diverse group of 420,000 team members in more than 50 countries. We deliver end-to-end services and solutions with our deep industry expertise and strong partner ecosystem, leveraging our capabilities across strategy, technology, design, engineering and business operations. The Group reported 2024 global revenues of €22.1 billion.
Make it real | www.capgemini.com

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Data Engineer

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified