Senior Big Data Engineer - Remote

Apply for this position Please mention DailyRemote when applying
Posted 13 days ago United States Salary undisclosed
Before you apply - make sure the job is legit.

Attempting to apply for jobs might take you off this site to a different website not owned by us. Any consequence as a result for attempting to apply for jobs is strictly at your own risk and we assume no liability.

Job Description

Job DescriptionSeniorBig Data Platform EngineerJoin us as we build a next-generation Enterprise Analytics Platform to reengineer a real estate enterprise. As a Senior Big Data Platform Engineer, you will be joining our Enterprise Analytics Platform Team to build EAP platform from ground up to serve agents, brokers, home buyers and sellers.What we're looking for:You're a talented, creative, and motivated Data Platform Engineer who loves to build data platform tools and ready to work with a team of individuals who share your passion. With a related degree under your beltand relevant experienceyou're ready to take your programming and data knowledge to the next level. You enjoy building tools such as Data Ingestion Platform to ingest data from diverse sources to Data Lake, building data lake tools to ingest data, monitor pipelines, and grant access to data. With your unwavering commitment to quality, excellent data/cloud skills, and collaborative work ethic, you'll do great things here at Realogy AI Lab.What you'll do:You'll be responsible for designing and building high performance, scalable data solutions that meet the needs of millions of agents, brokers, home buyers, and sellers.You'll work with other Data Engineers for build out of Next Generation Data Ingestion Platform.You'll design and develop data ingestion pipelines for batch and real-time streaming of data from in-house OLTP systems and third-party data.You'll work with team to design and develop Data Lake to store and process 10s of terabyte of data.You'll work with team to design Data Lake CLI to manage Data Lake Storage and Access.You will design and develop ETL pipelines to process data in data lake for descriptive and prescriptive reporting.You'll develop ETL data pipelines to build Enterprise Data Models for Property, Agent, Broker, office and other master entities.You will design and develop CI/CD process for continuous delivery in AWS Cloud.You'll design, develop, and test robust, scalable data platform components.You'll work with a variety of teams and individuals, including product engineers to understand their data pipeline needs and come up with innovative solutions.EDUCATION AND EXPERIENCE/SPECIAL SKILLS/TECHNOLOGIES/TOOLS REQUIREMENTS: (include travel and/or foreign language requirements) (if applicable). When using experience as a requirement, please quantify the number of years required.Bachelor's in Computer Science, Engineering, or related technical discipline or equivalent combination of training and experience.10+ years programming experience: building business logic layers and back-end systems for high-volume pipelines.2 years' experience with Golang.2 years' experience with Spark, Spark SQL, and Scala.2 years' experience using AWS Data Services: any combination of DMS, EMR, Glue, Athena, S3, CloudWatch, Lambda or IAM.2 years' experience with high-speed messaging frameworks and streaming (Kafka).1-year exp. with data architecture, ETL and processing of structured and unstructured data.2 years' experience with DevOps tools (any combination of GitHub, Travis CI or Jira) and methodologies (Lean, Agile, Scrum, Test Driven Development)Excellent written and verbal communication skills in English.This position can be performed anywhere except Colorado.#LI-KD1#LI-Remote About UsRealogy Holdings Corp.(NYSE: RLGY) is the leading and most integrated provider of U.S. residential real estate services, encompassing franchise, brokerage, and title and settlement businesses as well as a mortgage joint venture. Realogy's diverse brand portfolio includessome of the most recognized names in real estate: Better Homes and Gardens® Real Estate, Century 21®, Coldwell Banker®, Coldwell Banker Commercial®, Corcoran®, ERA®, Sotheby's International Realty®. Using innovative technology, data and marketing products, best-in-class learning and support services, and high-quality lead generation programs, Realogy fuels the productivity of independent sales agents, helping them build stronger businesses and best serve today's consumers. Realogy's affiliated brokerages operate around the world with approximately 190,000 independent sales agents in the United States and more than 112,000 independent sales agents in 113 other countries and territories. Recognized for nine consecutive years as one of theWorld's Most Ethical Companies, Realogy has also been designated a Great Place to Workand one of Forbes' Best Employers for Diversity. Realogy is headquartered in Madison, New Jersey.At Realogy, diversity fuels success - for our company and for our employees. We strive to be the preferred company for diverse talent, committed to creating an inclusive environment that encourages everyone to succeed. We pursue talent - strategic thinkers who are eager to innovate, focused on execution and accountable for results. We value diversity - respecting backgrounds, cultures, perspectives.You'll find our commitment to diversity reflected in our achievements:Forbes 2020 Best Employers for Diversity.Recognized on the 2020 Human Rights Campaign Corporate Equality Index .Recognized for gender diversity on our board of directors by Executive Women of New Jersey and Women's Forum of New York.First residential real estate company to endorse theEquality Actand fully support H.R. 1447amending the Fair Housing Act to include LGBTQ+ as protected classes.With diversity, we succeed together. We hope you'll join us. EEO StatementEOE AA M/F/Vet/Disability