GCP Data Engineer

 Posted 2 months ago
  
 Mexico
  
2-5 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Design and implement scalable cloud-based data warehouses and ETL pipelines using GCP, BigQuery, and PySpark. Manage real-time data ingestion, optimize query performance, and create analytical dashboards for stakeholders.

REQUIREMENTS

 

  • 3+YOE in Data Engineering and working with GCP, GCP Big Query 
  • Knowledge on Data warehouse 
  • Experienc working with Data forms 
  • Excellent data engineering skills including expert SQL, data modeling, and query optimization 
  • Strong experience with big data stack (Spark, PySpark, Hadoop, HIVE, BigQuery, Pub/Sub) in building scalable ETL pipelines 
  • Excellent programming skills (Python) including production level coding techniques (testing, OOP structures, optimization, etc) 
  • Data visualization and dashboarding experience 
  • Great at debugging, troubleshooting, designing, and implementing solutions to complex technical issues 
  • Aptitude to independently learn new technologies, prototype, and propose solutions 
  • Advanced English level

 

RESPONSIBILITIES

 

  • Design a cloud-based data warehouse using BigQuery to support analytical workloads. Define fact and dimension tables, apply appropriate partitioning and clustering strategies, and document the data model.
  • Build a scalable ETL pipeline using PySpark on GCP that ingests raw data, applies transformations, and writes curated data to BigQuery. Implement error handling, logging, unit tests, and modular OOP-based code.
  • Design and implement a real-time data ingestion solution using Pub/Sub and Dataflow to process streaming events and store aggregated results in BigQuery.
  • Use Dataform to build, version, and manage SQL-based transformations in BigQuery. Define dependencies, apply data quality assertions, and automate pipeline execution.
  • Create a dashboard using BigQuery as the data source (e.g., Looker or Looker Studio). Optimize queries for performance and explain metrics, KPIs, and design decisions to stakeholders.

 

Capgemini is a global leader in partnering with companies to transform and manage their business by harnessing the power of technology. The Group is guided everyday by its purpose of unleashing human energy through technology for an inclusive and sustainable future. It is a responsible and diverse organization of over 300,000 team members in nearly 50 countries. With its strong 50-year heritage and deep industry expertise, Capgemini is trusted by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms.

 

What you will love about working with us:

  • At Capgemini we’re always looking ahead.
  • We reimagine possibilities, and we innovate with technology to bring ideas to life.
  • We encourage flexibility in how, when, and where people get their work done, allowing a better work-life balance, and greater empowerment.
  • They partner with their managers to find an arrangement that works best for their role and their circumstances.
  • We offer game-changing programs to accelerate the growth of our people and the development of their expertise.

 

What you need to know about what we offer:

  • Excellent compensation and benefits
  • Career path, trainings and real growth opportunities
  • Engaging and challenging projects.
  • Excellent work environment and culture.
  • Open and Effective management.
  • Highly professional and collaborative teams.

 

At Capgemini Mexico, we aim to attract the best talent and are committed to creating a diverse and inclusive work environment, so there is no discrimination based on race, sex, sexual orientation, gender identity or expression, or any other characteristic of a person. All applications welcome and will be considered based on merit against the job and/or experience for the position.

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Data Engineer

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified