Build and support Databricks pipelines for data ingestion using Medallion Architecture. Optimize Delta Lake tables and debug Genie Spaces to improve natural language query quality.
This is a remote position.
Onsite/ Hybrid/ Remote:Remote
Duration: 1 Month Rate Range: Upto $89/hr on C2C or $82/hr on W2
Work Authorization:GC, USC, All valid EADs except H1B, OPT, CPT
Must Have:
Advanced Databricks engineering experience
Delta Lake
Data ingestion from new and diverse sources
Medallion Architecture: Bronze, Silver, Gold
Databricks Genie Spaces
Genie Space debugging, query tuning, and performance optimization
Advanced SQL and Spark/PySpark
Responsibilities:
Build and support Databricks pipelines for new data source ingestion.
Design and develop Bronze, Silver, and Gold data layers.
Optimize Delta Lake tables, queries, and platform performance.
Debug Genie Spaces and improve natural language query response quality.
Tune underlying SQL and data models used by Genie Spaces.
Support short-term delivery needs across the Databricks platform.
Qualifications:
Strong hands-on Databricks and Delta Lake engineering background.
Proven experience building Medallion Architecture in production.
Experience integrating multiple data sources into centralized data platforms.
Direct experience with Databricks Genie Spaces is required.
Strong SQL, Spark, and data performance tuning experience.
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”