Design, develop, and support scalable data integrations and pipelines using the o9 INT3.0 platform, PySpark, and Delta Lake. Collaborate with cross-functional teams to optimize ETL/ELT processes and ensure reliable data storage within Azure Data Lake Storage.
Role: Sr Integration Consultant (Int 3.0,pyspark, Delta lake
Mandatory Skills
o9 INT3.0
PySpark
Delta Lake
SQL
Data Integration & ETL
Azure Data Lake Storage (ADLS)
Experience Required
8–12 years of total IT experience.
Minimum 3+ years of hands-on experience with o9 Solutions INT3.0.
Strong experience in PySpark-based data engineering and Delta Lake implementation.
Experience with large-scale data integration and transformation projects.
Immediate joiners or candidates currently serving notice period preferred.
Location
Remote (must be flexible to travel to Bangalore whenever required).
Education
Bachelor's or Master's degree in Engineering, Computer Science, Information Technology, Supply Chain, Operations, or a related field.
Key Responsibilities
Design, develop, and support integrations using the o9 INT3.0 platform.
Build scalable data pipelines using PySpark and Delta Lake.
Develop and maintain inbound and outbound integrations between enterprise source systems and o9.
Design and optimize ETL/ELT processes for large datasets.
Work with Azure Data Lake (ADLS) and Delta Lake architecture to ensure reliable data storage and processing.
Develop complex SQL queries, stored procedures, and data validation routines.
Perform data extraction, transformation, cleansing, and loading from multiple source systems.
Configure and monitor integration pipelines, batch jobs, and data workflows.
Collaborate with business, functional, and technical teams to understand requirements and deliver integration solutions.
Troubleshoot integration, performance, and data quality issues.
Support deployment, testing, production releases, and post-go-live activities.
Ensure adherence to data governance, security, and best practices.
Required Skills & Qualifications
Strong hands-on experience with o9 INT3.0 Integration Framework.
Expertise in PySpark for data transformation and processing.
Strong knowledge of Delta Lake, including Delta tables, optimization, partitioning, and data versioning.
Advanced SQL and data modeling skills.
Experience with ETL/ELT design and implementation.
Experience working with Azure Data Lake Storage (ADLS).
Understanding of Data Warehousing and Lakehouse architectures.
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”