Senior Big Data Engineer | Remote

Apply for this position Please mention DailyRemote when applying
timePosted 4 days ago location United States salary$120k - 165k (US Dollars)
Before you apply - make sure the job is legit.

Attempting to apply for jobs might take you off this site to a different website not owned by us. Any consequence as a result for attempting to apply for jobs is strictly at your own risk and we assume no liability.

Job Description

Job DescriptionResideo is seeking a Senior Big Data Engineer to join our Connected Services team extracting insights from connected devices in homes, energy consumption data, and user behavior data. This team is responsible for leveraging Resideo's data from multiple sources to drive actionable insights to our Pros and Homeowners. As part of this initiative, we are looking for a Senior Big Data Engineer to help us build a data platform to enable analytic and data science services. Success in this role comes from marrying a strong data engineering background with product and business acumen to deliver scalable data pipelines and scalable storage solution to prepare and organize the data to be utilized. Job Duties: Solid background in Big Data and distributed computing for more than 5 years Design, build and support scalable and reliable data platforms Develop technical tools and programming to cleanse, organize and transform data and to maintain and update data structures and integrity on an automated basis Document architecture and process for external collaboration and support Analyze data to identify deliverables, gaps and inconsistencies Design application components and evolve architecture including UI, API/Services, Data Access, Integration, Application components etc. Actively participate in code review and test solutions to ensure it meets best practice specifications Implement innovative analytical solution using Hadoop, NoSQL and other Big Data related technologies, applying new features in Cloud/ on premise/ Hybrid solutions. Work closely with Product, Engineering, and Data stakeholders to ensure data solutions are aligned with business and are of high quality Perform analysis of business problems and technical environments and use this in implementation of quality technical solutions. You Must Have: 5+ years hands on enterprise software development with big data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning) 5+ years hands on big data manipulation (cleansing data, ingestion pipelines, validation rules, transformation, infrastructure cost analysis, maintaining and scaling pipelines) 5+ years Cloud experience with 1 or more leading cloud providers (Azure Preferred) : Storage; Compute; Networking; Identity and Security; NoSQL; RDBMS and Cubes; Big Data Processing; Queues and Stream Processing; Serverless; Data Analysis and Visualization; ML as a service One or more in each of these categories: Big Data stack: Hadoop, Yarn, HDFS, MapReduce, Hive, Spark, Kafka, Zookeper. ETL & Streaming Pipelines: Ariflow, Streamsets, Kafka Streams, Jenkins Queues and Stream processing: Kafka Streams; Flink; Spark Streaming; Storm; Event Hub; IOT Hub; MQTT; Storage Queues; Service Bus; Stream Analytics. NoSQL: Cassandra/ Hbase; MongoDB, Elassandra Programming Languages: Java/ Scala; Python; SQL; Bash, Spark API Development: Rest, Thrift, GraphQL Cluster Management: Cluster operation, Cluster planning via Qubole We Value: Experience defining and implementing algorithms that create tools for building data sets, managing data pipelines, and training and validating models Experience and understanding of the connected home Solid understanding of CI/CD principles and best practices. Solid skills in infrastructure troubleshooting, support and practical experience in performance tuning and optimization, bottleneck problem analysis. Engineering experience and practice in Data Management, Data Storage, Data Visualization, Data Governance (PI, GDPR), Disaster Recovery, Integration, Operation, Security. #LI-REMOTE Perks: Salary Range The expected salary range for this role is $120,000 - $165,000. The salary range for this same position may be lower or higher in markets outside of Colorado. Benefits Resideo provides comprehensive benefits, including life and health insurance, life assistance program, accidental death and dismemberment insurance, disability insurance, retirement plans, vacation & holidays. About UsResideo is a leading global provider of critical comfort and security solutions primarily in residential environments and distributor of low-voltage electronic and security products. Building on a 130-year heritage, Resideo has a presence in more than 150 million homes, with 15 million systems installed in homes each year. We continue to serve more than 110,000 professionals through leading distributors, including our ADI Global Distribution business, which exports to more than 100 countries from more than 200 stocking locations around the world. Resideo is a $5.0 billion company with approximately 13,000 global employees. For more information about Resideo, please visit . At Resideo, we bring together diverse individuals to build the future of homes. Resideo is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, religion, or veteran status.