Big Data Engineer (Spark or Flink + Scala/Kotlin/Java)

Correct Context is looking for a Big Data Engineer (Spark or Flink + Scala/Kotlin/Java) for Comscore in Poland and around.

Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.

Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.

We offer:

• Real big data projects at petabyte scale 🚀

• An international environment (US, PL, IE, CL) 🌎

• A small, independent team working environment 🧑‍💻

• High influence on the working environment

• Hands-on engineering work

• Flexible work time ⏰

• Fully remote or in-office work in Wroclaw, Poland 🏢

• 18,000 - 25,000 PLN net/month B2B 💰

• Private healthcare (PL) 🏥

• Multikafeteria (PL) 🍽️

• Free parking (PL) 🚗

As a Big Data Engineer, you'll:

• Design and build end-to-end big data processing pipelines and client-facing HTTP APIs that serve the data

• Develop and debug petabyte scale systems with Scala ZIO/Tapir and Spark/AWS/EMR/Airflow/Iceberg/Trino/Superset/PostgreSQL/Redis

• Conduct proofs of concept for enhancements

The candidate must have:

• Strong experience debugging and optimizing big data pipelines, with a solid understanding of performance characteristics and bottlenecks, plus proven ability to design and build efficient data pipelines using Spark, Flink, or similar tools

• Strong experience in any JVM language: Scala/Java/Kotlin

• Experience building systems in AWS or another cloud

• No language barrier in English to work effectively in an international team

• Proficiency in communicating technical design concepts and choices

If you do not have all the qualifications, but you think there is a match, let's talk.

The recruitment process for the Big Data Engineer position has the following steps:

1. Technical survey - about 10 min

2. Technical screening - 30 min

3. Technical interview - 60-90 min

4. Interview with manager (optional) - 30-60 min