The Principal Databricks Architect will lead the design, implementation, and governance of scalable Lakehouse architectures and data pipelines. They will provide technical leadership, mentor engineering teams, and ensure platform standards for security, performance, and data quality are met.
Develop, test, deploy, and maintain batch and streaming data pipelines and governed data products using Databricks, Python, SQL, Spark, and Delta Lake. Monitor and troubleshoot production workflows, support releases and CI/CD, and document data processes while collaborating with architects, analysts, and data owners.
The role involves designing and executing comprehensive testing strategies for ServiceNow applications, including automated testing and user acceptance coordination. You will also collaborate with stakeholders to document defects, manage release readiness, and ensure system reliability.