Senior Data Engineer

Job duties:

• Design, develop, and maintain scalable data pipelines using Databricks and Azure.
• Develop and maintain data models to support business and analytical requirements.
• Perform data ingestion, transformation, and integration across enterprise data sources.
• Develop efficient and reusable data engineering solutions.
• Monitor and troubleshoot data pipelines and resolve performance or data quality issues.
• Collaborate with architects and engineering teams to implement data platform solutions.
• Translate business requirements into technical data solutions.
• Optimize data processing workflows for performance, scalability, and reliability.
• Follow established data engineering, security, quality, and governance standards.
• Participate in code reviews and contribute to engineering best practices.
• Support data migration, modernization, and platform enhancement initiatives.
• Document data pipelines, models, processes, and technical solutions.

Requirements:

• 5+ years of experience in Data Engineering or a related technical discipline.
• Strong hands-on experience with Databricks.
• Experience with Python or PySpark.
• Solid experience with data modeling, including designing and implementing data structures for analytical and operational use cases.
• Experience building and maintaining data solutions on Microsoft Azure.
• Strong understanding of the Microsoft technology ecosystem.
• Experience developing scalable data pipelines and data transformation processes.
• Strong SQL skills and experience working with large datasets.
• Nice to have: Experience with Azure Data Factory, Azure Synapse Analytics, Azure SQL, Microsoft Fabric, or Power BI.