Develop and optimize scalable ETL/ELT processes and Lakehouse architectures on Databricks within the Azure Cloud. Collaborate with data scientists and analysts to implement data-driven solutions and mentor junior colleagues on technical standards.
The role involves analyzing existing SQL-based data import processes and designing an automated ETL tool. The candidate will develop concepts for automatic data structure recognition, potentially using AI, and conduct a make-or-buy analysis of integration tools.
Analyze existing data import processes in a SQL-based data warehouse and design an automated import tool for ETL processes. Develop a concept for automatic data structure recognition, potentially using AI, and conduct a make-or-buy market analysis.
