Data Engineer (Python & PySpark)

 Posted a month ago
  
 India
  
5-10 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Design, develop, and maintain end-to-end ETL/ELT pipelines and large-scale data processing frameworks using Python and PySpark. Architect and manage cost-efficient data solutions within the GCP ecosystem, including data warehouse and data lake architectures.

Key Responsibilities

  • Pipeline Development: Design, develop, and maintain end-to-end ETL/ELT pipelines using Python and PySpark.
  • Big Data Processing: Build large-scale data processing frameworks to handle structured and unstructured data, ensuring high performance and reliability.
  • Cloud Infrastructure: Architect and manage data solutions within the GCP ecosystem, focusing on cost-efficiency and security.
  • Data Modeling: Design and implement robust data warehouse models (Star/Snowflake schemas) and data lake architectures.
  • Optimization: Identify, design, and implement internal process improvements, such as automating manual processes and optimizing data delivery for greater scalability.
  • Collaboration: Work closely with stakeholders to understand data requirements and translate them into technical specifications.

Technical Qualifications

  • Core Programming: Strong proficiency in Python, including experience with libraries like Pandas, NumPy, and logging frameworks.
  • Big Data: 3+ years of hands-on experience with Apache Spark (PySpark) for distributed data processing.
  • GCP Ecosystem: Practical experience with Google Cloud services, specifically:
  • BigQuery (Optimization, Partitioning, Clustering).
  • Cloud DataProc or Dataflow.
  • Cloud Storage (GCS) and Cloud Functions.
  • Cloud Composer (Apache Airflow) for orchestration.
  • Data Warehousing: Solid understanding of relational databases and SQL (PostgreSQL, MySQL) as well as NoSQL environments.
  • DevOps & Tools: Experience with Git, Docker, and CI/CD pipelines. Familiarity with Terraform or other IaC tools is a significant plus.

At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.

Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.

We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.

Similar Jobs

See all Remote Software Development jobs →

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Data Engineer

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified