Streamsets Data Engineer (Python/Spark/Hadoop) - £500-£mths OUTSIDE IR35 - London/Remote (95%)

Apply for this position Please mention DailyRemote when applying
Posted 14 days ago Worldwide Salary undisclosed
Before you apply - make sure the job is legit.

Attempting to apply for jobs might take you off this site to a different website not owned by us. Any consequence as a result for attempting to apply for jobs is strictly at your own risk and we assume no liability.

Job Description

I am currently on the look out for a Steamsets Data Engineer with Python/Spark experience to work for my consultancy client based in London.

The position is offering between £500 and £550 Outside IR35 and a 12 Month initial contract.

The role will be mostly remote but may require occasional travel to the client's site in London.

Please see more details below:

Must have skills: Spark, Impala, SQL and any BI Tool

Role responsibilities: Work with Business Data Engineers, support them to perform data analysis, data profiling, data quality and data ingestion in various layers using Database queries, SQL Server, Cloudera, Impala Databases and other data sources CSV files. Create pipelines and jobs in Aon DASP platform using Control Hub StreamSets to meet the business user Business Data Engineers needs Participate in code review and design re-usable frameworks in StreamSets

Required experience:
5 years of experience working on data integration projects involving cloud based data warehousing using StreamSets - Data Collector create pipelines, Control Hub, HIVE on Impala and Cloudera Databases

5 years of Strong SQL experience prefer MS SQL, Impala, Cloudera Analysis,

Design, development, support and Enhancements of pipelines in data warehouse environment with Cloudera Bigdata Technologies Spark, HDFS, HIVE, Impala, StreamSets, Hue, Kafka, Cloudera along with Shell Scripting.

If you are interested in the role and wish to apply then please respond via this website with a copy of your CV and a contact number, alternatively if this isn't the right fit or timing for you then I offer good referral fees for any successfully placed recommendations.

Many Thanks