Senior Data Engineer - Remote

Apply for this position Please mention DailyRemote when applying
Posted 13 days ago United States Salary undisclosed
Before you apply - make sure the job is legit.

Attempting to apply for jobs might take you off this site to a different website not owned by us. Any consequence as a result for attempting to apply for jobs is strictly at your own risk and we assume no liability.

Job Description

Our team is looking for someone who is an expert at data transformation in the MS Cloud environment. Experience with SPARK, Databricks, Azure, data pipelines, data factories are needed. If you have a strong background in these technologies, we would love to talk to you. Independently formulates and defines system scope based upon defined data functional requirements. Devises Extract Transform, Load (ETL) and Extract, Load, and Transform (ELT) components to solve complex problems. Works with peers to ensure highly robust and sustainable solutions are devised with low maintenance requirements. Populates technical specifications leveraging defined templates based upon business requirements. Participates in sprint activities through designing, coding, debugging, testing, and documenting ETL/ELT resources constructed. Independently creates extracts, imports, and APIs. May work with SQL Server Integration Services, Microsoft Data Factory, and interface engines. Establishes tables with indices with pre-calculated datasets to augment BI activities. Provides input on team strategy and vision. Supports and helps manage external resources, such as service providers and vendor support. Participates in strategic and tactical planning discussions. PRIMARY RESPONSIBILITIES Works autonomously to define and create ETL/ELT (Extract, Transform, Load/Extract, Load, Transform) resources. May work directly with subject matter experts to define or troubleshoot data migration issues. Works with external partners to ensure the health of data extracts. Possesses an understanding of PHI/PII (Protected Health Information/Personally Identifiable Information) principles and how they apply to data engineering. Collaborates with peers, team and functional leaders to categorize and segregate data. Provides guidance and training to less experienced staff. Develops templates and standards for ETL/ELT (Extract, Transform, Load/Extract, Load, Transform) development. Possesses a strong understanding of existing ETL/ELT processes and can quickly troubleshoot and remediate issues. Exhibits an understanding of health system data, principles, and coding standards (CPT, ICD, LOINC). Reviews new technologies and makes recommendations for adoption to management. Performs other duties as assigned. EDUCATION Bachelor's degree EXPERIENCE Six years' experience PHYSICAL REQUIREMENTS Frequent lifting/carrying and pushing/pulling objects weighing 0-25 lbs. Frequent sitting, standing, walking, reaching and repetitive foot/leg and hand/arm movements. Frequent use of vision and depth perception for distances near (20 inches or less) and far (20 feet or more) and to identify and distinguish colors. Frequent use of hearing and speech to share information through oral communication. Ability to hear alarms, malfunctioning machinery, etc. Frequent keyboard use/data entry. Occasional bending, stooping, kneeling, squatting, twisting and gripping. Occasional lifting/carrying and pushing/pulling objects weighing 25-50 lbs. Rare climbing. Our team is looking for someone who is an expert at data transformation in the MS Cloud environment. Experience with SPARK, Databricks, Azure, data pipelines, data factories are needed. If you have a strong background in these technologies, we would love to talk to you. Independently formulates and defines system scope based upon defined data functional requirements. Devises Extract Transform, Load (ETL) and Extract, Load, and Transform (ELT) components to solve complex problems. Works with peers to ensure highly robust and sustainable solutions are devised with low maintenance requirements. Populates technical specifications leveraging defined templates based upon business requirements. Participates in sprint activities through designing, coding, debugging, testing, and documenting ETL/ELT resources constructed. Independently creates extracts, imports, and APIs. May work with SQL Server Integration Services, Microsoft Data Factory, and interface engines. Establishes tables with indices with pre-calculated datasets to augment BI activities. Provides input on team strategy and vision. Supports and helps manage external resources, such as service providers and vendor support. Participates in strategic and tactical planning discussions.