002AZM - Data Integration Engineer
Please mention DailyRemote when applying
AI Summary
The role involves designing, developing, and maintaining scalable data pipelines and optimizing data storage solutions using cloud platforms and big data technologies. Key tasks include implementing pipelines with Python and PySpark, developing ETL processes using tools like Airflow and AWS Glue, and ensuring data integrity.
Name of the position: Data Integration Engineer
Location: Remote
No. of resources needed: 01
Mode: Contract
Years of experience: 5+ Years
Shift: UK shift
Job Overview:
We are seeking an experienced Senior Data Integration Engineer to design, develop, and maintain scalable data pipelines and optimize data storage solutions. You will work with cloud platforms, big data technologies, and ETL processes to support business intelligence and analytics.
We are seeking an experienced Senior Data Integration Engineer to design, develop, and maintain scalable data pipelines and optimize data storage solutions. You will work with cloud platforms, big data technologies, and ETL processes to support business intelligence and analytics.
Key Responsibilities:
- Design and implement scalable data pipelines using Python, PySpark, and Big Data tools.
- Optimize data processing performance in AWS.
- Collaborate with business teams to deliver reliable data solutions.
- Develop and maintain ETL processes using tools like Airflow, Azkaban, and AWS Glue.
- Troubleshoot and ensure data integrity across data pipelines.
- Mentor junior team members and promote best practices.
Key Skills:
- Strong experience with Python, PySpark, SQL, AWS (Redshift, Glue, S3).
- Expertise in big data technologies (Hadoop, Hive, Spark).
- Proficient in data modeling and ETL orchestration.
- Experience with business intelligence tools (Tableau, Power BI).
- Strong problem-solving and communication skills.
Automatically Apply to the Best Remote Jobs
Stop the endless job search. Our AI finds and applies to the best jobs for you.
