Senior Data Engineer

Position Summary:

We are looking for a Senior Data Engineer to expedite our Data Platform Stack to support our developers, database architects, data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects in a dynamic environment. The ideal candidate will have 8 plus years of hands-on experience, preferably with Snowflake, SQL Server, AWS and Matillion ETL, to build, optimize, and maintain data pipelines and data integration solutions. This role involves working closely with cross-functional teams to support data-driven initiatives across the organization.

Responsibilities

• Analyze and interpret complex data Ability to identify data anomalies and resolve data issues.
• Understand specific business processes and domain concepts and relate them to data subject domains.
• Optimize SQL queries, scripts, and stored procedures in Snowflake and SQL Server to improve efficiency and reduce processing time.
• Integrate and manage data from various sources, ensuring data quality, reliability, and performance
• Design, develop, and maintain scalable and high-performance ETL pipelines using Matillion ETL to ingest, transform, and load data into Snowflake.
• Monitor data pipeline and ETL performance, identifying bottlenecks and making necessary adjustments to ensure optimal system performance.
• Perform troubleshooting and root cause analysis to resolve data issues and prevent future occurrences.
• Develop and implement data models within Snowflake to support business intelligence and analytics requirements.
• Collaborate with Data Leads, Product Managers and QA Engineers to validate requirements, participate in user requirement sessions.
• Perform tests and validate data flows and prepare ETL processes according to business requirements.
• Perform ETL tuning and SQL tuning.
• Ability to document data flows representing business logic in ETL routines.
• Design and implement data conversion strategy from legacy to new platforms.
• Perform design validation, reconciliation, and error handling in data load processes.
• Design and prepare technical specifications and guidelines including ER diagrams and related documents.

Qualifications:

• Must be well versed with Data warehousing concepts including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts including the data modeling Normal forms.
• Knowledge of AWS Infrastructure including S3, SNS, EC2, CloudWatch and RDS.
• 8+ years working in ETL/Data transformation projects with one or more related products such as Informatica or Talend or Microsoft SSIS.
• Experience in business intelligence, data warehousing initiatives.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases like Oracle or MS SQL Server or Snowflake.
• Strong SQL and Python skills with experience in query optimization and performance.
• Strong analytical, problem-solving, and communication skill.
• Bachelor’s in mathematics, Computer Science or related technical field.
• Experience with additional ETL tools, data transformation methods, or cloud platforms is a plus.
• Healthcare and PBM: PBM-specific knowledge and experience with transforming various healthcare data is a plus, but not required.
• Experience with Matillion ELT tool and Snowflake Database is preferred
• Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any of Cloud Environments (AWS / Azure / Google).

Salary Range: 150,000 - 170,000