About the role
We are seeking a talented and motivated Senior Software Engineer to join our Datalake team within the Query Engine organization. In this role, you will focus on enhancing our query engine with a particular emphasis on the Iceberg table format and efficient scans of various file formats. This is an exciting opportunity to contribute to cutting-edge technology in the big data ecosystem.
What you’ll be doing
- Designing and implementing features for Dremio’s query engine with a focus on the Iceberg table format
- Optimizing file scan operations for various file formats, including Parquet, Avro and others
- Collaborating with members of the query planning and query execution teams to ensure seamless integration of features across the code stack
- Working with and contributing to open-source projects like Apache Iceberg, Parquet and Arrow
- Maintaining and enhancing compliance with the Iceberg table format specification
- Conducting performance tuning and benchmarking to enhance query execution speed
- Understanding and reasoning about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment
- Participating in code reviews and providing constructive feedback to peers
What we’re looking for
- B.S., M.S. or PhD in Computer Science or in a related technical field
- 5+ years of software engineering experience, with a focus on database systems, query execution or related fields
- Strong programming skills in an object oriented language such as Java or C++
- Understanding of database internals, query planning, distributed systems, concurrency control, data replication, and storage systems
- Familiarity with cloud object stores, such as AWS S3, ADLS or GCS.
- Experience with Apache Iceberg, Parquet, AVRO and/or Delta
- Interested and motivated to be part of a fast-moving startup with a fun and accomplished team
- Desire to learn: You can stand your ground as well as be mentored by your teammates
Bonus points if you have
- Experience working with and contributing to open source projects
Return to Office Philosophy
Workplace Wednesdays - to break down silos, build relationships and improve cross-team communication. Lunch catering / meal credits provided in the office and local socials align to Workplace Wednesdays. In general, Dremio will remain a hybrid work environment. We will not be implementing a 100% (5 days a week) return to office policy for all roles.
#LI-JF1 #LI-Remote