Data Engineer not (Analyst OR Scientist OR analytics)

Apply for this position Please mention DailyRemote when applying
Posted 9 days ago United States Salary undisclosed
Before you apply - make sure the job is legit.

Attempting to apply for jobs might take you off this site to a different website not owned by us. Any consequence as a result for attempting to apply for jobs is strictly at your own risk and we assume no liability.

Job Description

Data Engineer not (Analyst OR Scientist OR analytics) San Francisco, CA Job description Responsibilities Develop and automate large scale, high-performance data processing systems (batch andor streaming) to drive Airbnb business growth and improve the product experience. Build scalable Spark data pipelines leveraging Airflow schedulerexecutor framework Minimum Requirements 4+ years of relevant industry experience Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions Working knowledge of relational databases and query authoring (SQL). Good communication skills, both written and verbal Strong experience using ETL framework (ex Airflow, Flume, Oozie etc.) to build and deploy production-quality ETL pipelines. Experience building batch data pipelines in Spark Scala. Strong understanding of distributed storage and compute (S3, Hive, Spark) General software engineering skills (Java or Python, Github) abhinav at apextgi dot com