The Lead Test Engineer will own the test strategy and quality engineering approach for an Azure Databricks platform. This includes designing a structured test framework, embedding automated testing into CI/CD pipelines, and mentoring other test engineers.
Build and maintain scalable ETL pipelines and data models within the Azure Databricks ecosystem. Collaborate with multi-disciplinary teams to optimize data ingestion, transformation, and the delivery of high-performing data products.
Collect, clean, and manage data from multiple systems to identify patterns and trends. Develop dashboards and visual insights to support decision-making for non-technical stakeholders.
The role involves assessing existing systems and defining target architectures to recommend scalable technology solutions. The architect will produce high-level designs and ensure alignment with security, scalability, and performance standards.
