Senior Data Engineer (Databricks)

 Posted 24 days ago
  
 Poland
  
 160 - 210 per hour
  
⭐ 5-10 years experience
Apply Now

Please mention DailyRemote when applying

AI Summary

Design and implement scalable data pipelines using PySpark on Databricks while optimizing Spark jobs for performance and cost. Migrate legacy data warehouses to Lakehouse architecture and enforce high code quality through CI/CD and rigorous reviews.

Location: 100% Remote
Contract: B2B or UoP (via Entrada AI Poland)


ABOUT ENTRADA AI

Entrada AI is a specialized consulting partner and a strategic portfolio company of Databricks Ventures. This is a rare distinction: Databricks invested in us because of our technical excellence, placing us in the "inner circle" of the ecosystem. For our engineers, this means direct access to product roadmaps, private previews, and the teams building the platform.

You will join a team of industry veterans and Databricks MVPs. We look for engineers who value clean architecture over quick fixes. We don't just maintain pipelines; we solve complex architectural challenges for Fortune 500 clients using features often before they are widely available.

THE ROLE

  • Architecture & Development: Design and implement scalable data pipelines using Apache Spark (PySpark) on Databricks. You will build solutions, not just run scripts.

  • Optimization: Analyze and optimize complex Spark jobs for performance and cost (partitioning, z-ordering, Photon engine utilization).

  • Modernization: Migrate legacy data warehouses to the Lakehouse architecture using Delta Lake.

  • Standards: Enforce high code quality standards through rigorous code reviews and CI/CD implementation (Databricks Asset Bundles).

  • Mentorship: Share knowledge with the team and act as a technical advisor for clients.

MUST HAVES

  • Senior Experience: 5+ years in Data Engineering with a strong focus on distributed systems.

  • Databricks Expertise: Minimum 3 years of hands-on experience with the Databricks platform. You understand the internals of Delta Lake.

  • Cloud Native: Production experience with Azure (ADLS Gen2, ADF) or AWS (S3, Glue).

  • Coding: Advanced proficiency in Python and SQL.

  • Modern Governance: Experience with Unity Catalog implementation.

  • Communication: Fluent English (C1+) is mandatory for direct client collaboration.

NICE TO HAVES

  • Experience building data applications using Databricks Apps.

  • Familiarity with Delta Live Tables (DLT).

  • Databricks Certifications (Data Engineer Professional).

  • Experience with dbt.

THE OFFER

  • Competitive Salary: 160 - 210 PLN / hour based on your experience and skills.

  • Stable Employment: Contract signed with our Polish entity (Entrada AI Poland). We are open to both Employees (UoP) and Independent Contractors (B2B) for long-term cooperation.

  • 100% Remote: Full flexibility to work from anywhere in Poland.

  • Apple Hardware: Macbook Air M4 15" provided.

  • Referral Bonus: Bonus for bringing other top-tier engineers to the team.

  • Professional Growth:

    • Databricks certification cost coverage.

    • Support on the path to becoming a Databricks Solution Architect Champion.

    • Opportunity to present at industry conferences (building your personal brand).

    • Direct collaboration with Databricks MVPs and product teams.



RECRUITMENT PROCESS

  • Introductory Call (20 min): Short conversation with our Recruiter to discuss your background and expectations.

  • Technical Interview (60 min): Deep dive into your technical skills with our engineering team.

  • Optional Client Interview: Required only in specific cases.

  • Decision & Offer: We aim to close the process efficiently.

Similar Jobs

See all Remote Software Development jobs β†’

Personalize your Remote Job Search in 3 Easy Steps!

Discover remote opportunities in Data Engineer

Answer easy questions

Answer easy questions

200,000+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified