Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Databricks and Apache Spark. Collaborate with cross-functional teams to deliver data-driven solutions while ensuring performance, cost efficiency, and data governance.
About the Role:
Vidha IT Solutions LLC is looking for a talented Databricks Architect to join our growing team. This is an exciting opportunity to work at the forefront of data engineering, building and optimizing scalable data solutions that drive real business impact. If you're passionate about big data, cloud platforms, and cutting-edge analytics, we want to hear from you!
Location: Remote Visa: Any visa w2 Only
Responsibilities:
Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark
Build and optimize ETL/ELT workflows to support data ingestion, transformation, and delivery
Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions
Manage and monitor Databricks clusters, notebooks, and job scheduling for performance and cost efficiency
Implement Delta Lake architecture and best practices for data reliability and governance
Integrate Databricks with cloud platforms such as AWS, Azure, or GCP and enterprise data sources
Troubleshoot and resolve data pipeline issues, ensuring high availability and data quality
Requirements:
Proven experience as a Databricks Engineer or Data Engineer with hands-on Databricks platform expertise
Strong proficiency in Apache Spark, PySpark, and SQL
Experience with Delta Lake, Lakehouse architecture, and data modeling
Familiarity with cloud platforms (AWS, Azure, or GCP) and cloud-native data services
Experience building and managing ETL/ELT pipelines at scale
Knowledge of Python, Scala, or other relevant programming languages
Strong problem-solving skills and ability to work in a collaborative, fast-paced environment
About Us:
Vidha IT Solutions LLC is a dynamic technology services company dedicated to delivering innovative IT and data solutions to clients across industries. Our team thrives on solving complex challenges with modern technology, and we take pride in fostering a collaborative and growth-oriented workplace. At Vidha IT Solutions, employees are empowered to make an impact and grow their careers alongside a passionate, forward-thinking team.
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”
— Sarah J.
·
Marketing Manager
★★★★★
Verified
