Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewOne click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.
Upload your resume and we draft a letter for this exact role, tailored to what it asks for.
Develop and maintain scalable data pipelines using Databricks, Python, and PySpark while automating ETL workflows with Delta Live Tables. Optimize Spark performance and ensure data quality and governance across all engineering solutions.
This is a remote position.
3–6 years of experience in Data Engineering.
Strong knowledge of SQL, Python, and PySpark.
Hands-on experience with Databricks and Apache Spark.
Understanding of Spark optimization, partitioning, and shuffling.
Experience with Delta Lake, Z-Ordering, and VACUUM.
Experience building ETL pipelines using Delta Live Tables (DLT).
Knowledge of Apache Airflow or Azure Data Factory.
Understanding of data governance and data quality.
Develop and maintain scalable data pipelines using Databricks, Python, and PySpark.
Build and automate ETL workflows using Delta Live Tables (DLT).
Optimize Spark jobs through partitioning, shuffling, and performance tuning.
Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.
Manage data orchestration using Airflow or Azure Data Factory.
Ensure data quality, governance, and pipeline performance.
Collaborate with cross-functional teams to deliver efficient data engineering solutions.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 217,956+ Jobs in Software Development
Answer easy questions
217,956+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”