Design, develop, and maintain scalable data pipelines and high-performance Spark applications for batch and real-time processing. Implement Kafka-based streaming solutions and manage data architectures using Delta Lake across Azure and AWS platforms.
