Data Engineer

Data Engineer

Location: Remote
Clearance Level: Active Secret

Overview

Rackner is seeking a Data Engineer to design, develop, and maintain data ingestion, transformation, integration, and data quality processes supporting modern cloud-based data platforms.

The Data Engineer will work primarily within the Microsoft Fabric environment, developing scalable data pipelines and implementing Bronze, Silver, and Gold medallion architecture layers across assigned data domains. This role will support the ingestion and transformation of data from student information systems, HR/personnel systems, financial systems, operational databases, and other enterprise data sources.

The Data Engineer will also support education data integration using the Ed-Fi Data Standard and REST APIs, including source-to-Ed-Fi mapping, descriptor customization, synchronization, validation, and future migration activities.

Responsibilities

• Develop and maintain data ingestion pipelines, transformation logic, and data quality processes within Microsoft Fabric
• Implement and maintain Bronze, Silver, and Gold medallion architecture layers for assigned data domains
• Extract, transform, and load data from enterprise source systems, including:
  • Student information systems
  • HR and personnel systems
  • Financial systems
  • Logistics systems
  • IT service management platforms
  • Operational databases
• Develop ETL and ELT pipelines that ingest source-system data into the Microsoft Fabric Lakehouse
• Build and maintain data integration pipelines, API connections, and automated synchronization processes
• Develop Ed-Fi REST API integrations supporting education data workstreams
• Implement Aspen-to-Ed-Fi export mappings, descriptor customization, transformation logic, and API-based data synchronization
• Develop non-education data ingestion pipelines supporting HR/DCPDS, finance, logistics, and IT service management domains
• Perform source-system data profiling, mapping, cleansing, and transformation
• Conduct reconciliation testing and validate data completeness, accuracy, and consistency across source and target systems
• Identify, troubleshoot, and resolve data quality, pipeline, and integration issues
• Develop SQL queries, Python or PySpark processing logic, and reusable data transformation components
• Support data population and migration activities across cloud and enterprise data environments
• Produce and maintain technical documentation for data pipelines, interfaces, mappings, transformation logic, and operational processes
• Collaborate with data architects, analysts, governance specialists, application teams, and source-system owners to define and implement data integration requirements
• Support Ed-Fi Data Management Service (DMS) migration planning as the DMS reaches production readiness
• Support knowledge transfer and operational transition activities for implemented pipelines and data services

Qualifications

• Experience developing data pipelines, ETL/ELT processes, and data integrations
• Experience with Microsoft Fabric, Azure Data Factory, or comparable cloud data platforms
• Strong SQL proficiency, including querying, transformation, validation, and troubleshooting
• Experience with Python and/or PySpark for data engineering workloads
• Experience working with structured and semi-structured enterprise data
• Understanding of cloud-based data lake, lakehouse, or data warehouse architectures
• Experience with data mapping, data profiling, reconciliation testing, and data quality processes
• Experience integrating systems through REST APIs or similar application interfaces
• Ability to document data flows, pipeline configurations, mappings, and technical processes
• Strong troubleshooting, analytical, and communication skills
• Active Secret clearance

Preferred Qualifications

• Experience with Microsoft Fabric Lakehouse architecture
• Experience implementing Bronze, Silver, and Gold medallion data architectures
• Experience with the Ed-Fi Data Standard, Ed-Fi ODS/API, or Ed-Fi REST APIs
• Experience performing Aspen-to-Ed-Fi mapping or integrating other student information systems with Ed-Fi
• Experience with HR/DCPDS, financial, logistics, or IT service management data
• Experience supporting large-scale cloud data migrations or modernization initiatives
• Familiarity with data governance, metadata management, lineage, and enterprise data quality practices

About Rackner
Rackner is a software consultancy focused on building mission-critical systems for the U.S. government. Our teams work across cloud platforms, DevSecOps, AI/ML, distributed systems, and modern software engineering initiatives supporting federal agencies and national security missions. Rackner engineers and technical teams collaborate closely with leadership, program teams, and mission stakeholders to design, demonstrate, and improve software systems that address complex operational challenges.

Benefits & Perks
At Rackner, we believe that when our people grow, our company grows with them, and we are committed to supporting their growth, development and success. We are proud to offer a creative and forward-thinking environment that includes:
• Company-supported certifications aligned to current and future program work, 
including cloud, Kubernetes, DevSecOps, security, AI/ML, project management, and 
related technical areas
• Clear advancement tracks and future leadership opportunities
• 401(k) with 100% match up to 6%
• Comprehensive medical, dental, vision, life, and disability coverage
• Generous PTO and paid holidays
• Home-office equipment plan and remote work support
• Fitness and wellness reimbursement
• Weekly pay schedule and modern perks, including team events

Equal Opportunity
Rackner is an equal opportunity employer and considers all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other protected characteristics.