Please mention DailyRemote when applying
See how much of this job your resume covers, and what’s missing.
Want a recruiter to go through it line by line?
Get professional reviewUpload your resume and we draft a letter for this exact role, tailored to what it asks for.
The Data Migration Engineer will translate complex Informatica workflows into Python EL scripts and dbt transformation models. They will also orchestrate these pipelines using Airflow and ensure data quality through rigorous testing and reconciliation.
Key Responsibilities
• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.
• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Featuring 218,211+ Jobs in Software Development
Answer easy questions
218,211+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”