For Employers

Vrinda International

SEMANTIC & GENIE ENGINEER (DATABRICKS)

Posted 2 days ago
1500K per year
5-10 years experience
Apply Now

Please mention DailyRemote when applying

?Not checked yet0100
Resume Match Score

See how much of this job your resume covers, and what’s missing.

Want a recruiter to go through it line by line?

Get professional review

Tailor your resume to this job

One click makes a copy of your resume for this role, scores it against the posting, and proposes edits line by line. Your default resume is never changed.

  • Job match score for this posting
  • Edits you accept or skip, no invented facts
  • Download it when it reads right: TXT free, PDF with Premium

Create a cover letter for this job

Upload your resume and we draft a letter for this exact role, tailored to what it asks for.

  • Tailored to this role
  • Based on your resume
  • Fully editable
AI Summary

The engineer will design and implement data governance strategies using Unity Catalog and Delta Lake while optimizing query performance. They will also develop custom applications and multi-agent systems to automate data operations and enhance decision-making.

Summary
We are seeking a highly skilled Semantic & Genie Engineer to join our IT Services team, focusing on advanced data architecture and intelligent automation within the Databricks ecosystem. This pivotal role is designed to leverage cutting-edge technologies to enhance data governance, optimize query performance, and develop sophisticated multi-agent orchestration solutions. The ideal candidate will bridge the gap between complex data engineering and generative AI capabilities, ensuring robust data quality and seamless integration of semantic layers across our platforms.

Responsibilities
  • Design and implement Unity Catalog strategies to manage data access, lineage, and governance effectively.
  • Architect and maintain Delta Lake structures to ensure high-performance data storage and processing.
  • Conduct comprehensive data profiling and establish rigorous validation frameworks to uphold data integrity.
  • Optimize complex SQL queries and database performance to support real-time analytics and reporting needs.
  • Develop and deploy custom applications using Python, Streamlit, and Databricks Apps to visualize insights and automate workflows.
  • Engineer advanced multi-agent systems and Databricks Genie Agents to drive autonomous data operations and decision-making.
  • Configure and monitor Databricks Metric Views to track key performance indicators and system health.
  • Manage version control and collaborative development processes using Git for all codebases and configurations.
  • Integrate Machine Learning Pipelines (MCP) to enhance the predictive capabilities of data solutions.

Requirements

Requirements:
  • Minimum of 5 years of professional experience in data engineering or related technical fields.
  • Proficiency in Python programming and advanced SQL for data manipulation and analysis.
  • Deep expertise with Databricks ecosystem components, including Unity Catalog, Delta Lake, and Databricks Genie.
  • Strong background in data quality assurance, profiling techniques, and validation methodologies.
  • Demonstrated ability to perform query optimization and tune data pipelines for maximum efficiency.
  • Experience building interactive dashboards and applications using Streamlit and Databricks Apps.
  • Knowledge of multi-agent orchestration patterns and the implementation of Genie Agents/Spaces.
  • Familiarity with Git version control systems and collaborative development practices.
  • Understanding of Machine Learning Pipelines (MCP) and their integration into data workflows.

Automatically Apply to the Best Remote Jobs

Stop the endless job search. Our AI finds and applies to the best jobs for you.

Try it Now
Keep looking

Similar Jobs

See all Remote Software Development jobs →

QA Lead

Full Time Czech Republic Software Development

Middle Python Developer with SQL Skills

Full Time Latvia Software Development

Azure Data Platform Engineer

Full Time Jordan Software Development

AWS Cloud Architect (US)

Full Time United States Software Development

Senior Backend Engineer - Go

Freelance, Full Time Europe Software Development

Senior Databricks Data Engineer

Full Time United States Software Development
Apply Now

Personalize your Remote Job Search in 3 Easy Steps!

Featuring 215,945+ Jobs in Software Development

Answer easy questions

Answer easy questions

215,945+ jobs across 15+ categories

Get your best job matches

Get your best job matches

Only hand-screened, legit jobs

Find a remote job faster

Find a remote job faster

No ads, scams, or junk

“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”

Sarah J. — Sarah J. · Marketing Manager ★★★★★ Verified