Sachin Krishna Patil

I’m a Lead Data Engineer with 12+ years of experience designing and building scalable data platforms, ingestion frameworks, data pipelines, and data quality solutions across cybersecurity, finance, telecommunications, and other domains. My core expertise includes Apache Spark, Scala, Java, SQL, Airflow, Kafka, Snowflake, BigQuery, S3, GCS, and distributed data processing. In my current role at Qualys, I lead data engineering initiatives for a large-scale cybersecurity analytics platform, building high-volume batch and near-real-time pipelines and optimizing data processing and analytical performance. Two key achievements include architecting a scalable data ingestion framework that reduced data transfer time by 40%, and designing a Spark-compatible SFTP library that improved data transfer security by 60% while supporting multiple key-exchange algorithms. I’m looking for a remote Lead/Senior Data Engineer, Data Platform Engineer, or Data Engineering Consultant role, where I can design scalable data solutions, solve complex data engineering problems, optimize performance, and contribute to modern cloud-based data platforms while working effectively with distributed teams.