The Data Engineer will design, develop, and maintain enterprise data integration and ETL/ELT solutions using Talend and Azure. They will also monitor production pipelines, optimize database processes, and collaborate with stakeholders to ensure data quality and security.
This is a remote position.
A public sector organization is seeking an experienced Data Engineer to support a large-scale initiative modernizing environmental and natural resource regulatory processes.
The Data Engineer will design, develop, maintain, and support enterprise data integration, ETL/ELT, and data pipeline solutions using Talend, SQL, Azure, and relational databases.
Requirements
- Design, develop, test, and support enterprise data integration and ETL/ELT solutions using Talend.
- Build data mappings, transformations, reconciliation processes, and reusable integration components.
- Develop and optimize SQL queries, stored procedures, and database processes using SQL Server, Oracle, or PostgreSQL.
- Administer and support Talend Management Console (TMC) and Talend Remote Engine.
- Schedule, monitor, troubleshoot, and resolve production data pipeline and integration issues.
- Develop scalable batch and near-real-time data pipelines.
- Design and integrate REST APIs using Azure API Management.
- Support data quality, governance, metadata, lineage, security, and data privacy requirements.
- Work across development, testing, and production environments following established SDLC practices.
- Collaborate with data engineers, architects, business stakeholders, platform teams, and vendors.
- Leverage AI and automation tools for code generation, testing, data analysis, documentation, and pipeline optimization.
Required Qualifications
- Post-secondary degree, diploma, or certificate in Computer Science, Engineering, or a related field.
- 3+ years of experience designing, developing, testing, and supporting enterprise data integration solutions.
- 3+ years of experience with Talend Management Console/Talend Administration Center.
- 3+ years of experience installing, configuring, supporting, and troubleshooting Talend Remote Engine.
- 2+ years of production support experience for enterprise integration solutions.
- 4+ years working within a mature Software Development Lifecycle (SDLC).
- 1+ year of experience using AI for code generation, data analysis, automation, or development productivity.
Preferred Qualifications
- 6+ years of experience in business/data requirements analysis.
- 6+ years of strong Microsoft SQL Server experience.
- Experience building scalable ETL pipelines, implementing data quality, and working with cloud platforms.
- 3+ years of experience integrating RESTful APIs.
- 3+ years of experience with message queuing technologies.
- Experience with ServiceNow and Azure-based data management integrations.
- Experience with data governance, metadata management, data classification, and data lineage.