Databricks Data Engineer - Clearance Required

Overview

TSGi is seeking a Senior Databricks Data Engineer to support a large-scale federal technology modernization program. This is a remote position supporting the development and migration of cloud-based data solutions.

The Data Engineer will build and operate ingestion pipelines and Bronze, Silver, and Gold data layers within Databricks, helping migrate data and business logic from legacy environments into a modern cloud architecture.

An active DoD Secret clearance and U.S. citizenship are required for this position.

Responsibilities

• Build, operate, and maintain ingestion pipelines within Databricks.
• Develop and support Bronze, Silver, and Gold data pipelines using Medallion Architecture.
• Migrate data and business logic from legacy systems into modern cloud-based environments.
• Gather and analyze technical and business requirements.
• Design and develop batch, incremental, and streaming ingestion pipelines.
• Monitor data jobs and troubleshoot pipeline and production issues.
• Provide post-go-live production support and break/fix assistance.
• Document technical processes, data workflows, and procedures.
• Collaborate with technical teams and stakeholders in an Agile environment.

Qualifications

• Per our Federal Government Contract, Active DoD Secret clearance and U.S. citizenship required.
• Strong experience in data engineering, ETL/ELT development, or data warehousing.
• Strong PySpark and/or Spark SQL skills with solid SQL fundamentals.
• Experience with Databricks and Medallion Architecture, including Bronze, Silver, and Gold layering.
• Experience with Delta Lake, including ACID transactions, schema evolution, time travel, and MERGE/upsert patterns.
• Experience designing batch and incremental/streaming ingestion pipelines.
• Familiarity with Agile processes.
• Excellent written and verbal communication skills.
• Strong interpersonal, organizational, and prioritization skills.
• Databricks certification or additional hands-on Databricks experience preferred.
• DoD, Navy, or other federal experience preferred.
• AWS GovCloud experience preferred.
• Experience migrating code from non-accredited to accredited AWS environments is a plus.

Compensation:

• W2 Hourly rate starts at $88. Pay rates are based on experience, qualifications, location, and certifications, and are subject to change at any time.
• Benefits vary by compensation type and may include paid time off (PTO), medical, dental, and vision coverage, life insurance, long-term disability insurance, a 401(k) plan, and additional optional benefits.

4 Reasons to Join The Squires Group, Inc.: 1. Our Commitment to You - We offer competitive pay, multi-year projects, and a list of exciting clients.2. Work-Life Balance - We work hard; we work smart and have quality time for family and "life." 3. Golden Rule - We treat our consultants the way we want to be treated: with integrity, professionalism, and trust.4. We Care About You – We help you meet your career goals and continuously support your efforts in the field.

Check out our Referral Program!

If you see a position posted by The Squires Group and know the perfect person for the job, please send us your referral. For more information on our Referral Program, go to https://bit.ly/squiresreferral.

The Squires Group, Inc. is an Equal Opportunity/Affirmative Action Employer.