I am currently on the look out for a Steamsets Data Engineer with Python/Spark experience to work for my consultancy client based in London.
The position is offering between £500 and £550 Outside IR35 and a 12 Month initial contract.
The role will be mostly remote but may require occasional travel to the client's site in London.
Please see more details below:
Must have skills: Spark, Impala, SQL and any BI Tool
Role responsibilities: Work with Business Data Engineers, support them to perform data analysis, data profiling, data quality and data ingestion in various layers using Database queries, SQL Server, Cloudera, Impala Databases and other data sources CSV files. Create pipelines and jobs in Aon DASP platform using Control Hub StreamSets to meet the business user Business Data Engineers needs Participate in code review and design re-usable frameworks in StreamSets
5 years of experience working on data integration projects involving cloud based data warehousing using StreamSets - Data Collector create pipelines, Control Hub, HIVE on Impala and Cloudera Databases
5 years of Strong SQL experience prefer MS SQL, Impala, Cloudera Analysis,
Design, development, support and Enhancements of pipelines in data warehouse environment with Cloudera Bigdata Technologies Spark, HDFS, HIVE, Impala, StreamSets, Hue, Kafka, Cloudera along with Shell Scripting.
If you are interested in the role and wish to apply then please respond via this website with a copy of your CV and a contact number, alternatively if this isn't the right fit or timing for you then I offer good referral fees for any successfully placed recommendations.