Yajith Vishwa

Built and automated 30+ ELT pipelines implementing SCD Type 1, 2, and 3 methodologies to transfer data from OLTP systems (SQL Server, MySQL, and PostgreSQL) to OLAP platforms including Snowflake, Databricks Delta Tables, and Google BigQuery. Leveraged Medallion Architecture to incrementally cleanse, enrich, and aggregate data, delivering high-quality, business-ready SQL views for critical reporting and analytics while collaborating closely with stakeholders to ensure data accuracy and alignment with business requirements. Developed Snowpark-based Snowflake Stored Procedures for data transformation and curation across layers. Created a custom Python module for CRUD operations using the Microsoft Web REST API Client to automate Dynamics CRM ETL processes in Databricks, replacing KingswaySoft SSIS components hosted on Azure Data Factory and generating $2,000/month in cost savings. Automated CI/CD deployment of Databricks notebooks through Databricks REST APIs, eliminating manual deployment efforts for 500+ ETL jobs and improving operational efficiency within Azure DevOps, while also developing a JAMS Scheduling Framework for orchestrating Snowflake Stored Procedures. Played a key role in enterprise data platform modernization by migrating 250+ ADF, SSIS, and IBM DataStage ETL jobs to GCP Databricks using custom Python utility modules, streamlining data movement and transformation across SQL Server, ADLS, GCS, Snowflake, and MongoDB, resulting in over $100K in cost savings.