Big Data Engineer (Spark or Flink + Scala/Kotlin/Java)
⚲ Wrocław
18 000 - 25 000 PLN (B2B)
Wymagania
- Big Data
- Spark
- Flink
- Scala
- Kotlin
- Java
Opis stanowiska
O projekcie:
Correct Context is looking for a Big Data Engineer (Spark or Flink + Scala/Kotlin/Java) for Comscore in Poland and around.
Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.
Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.
We offer:
- Real big data projects at petabyte scale 🚀- An international environment (US, PL, IE, CL) 🌎- A small, independent team working environment 🧑💻- High influence on the working environment- Hands-on engineering work- Flexible work time ⏰- Fully remote or in-office work in Wroclaw, Poland 🏢- 18,000 - 25,000 PLN net/month B2B 💰- Private healthcare (PL) 🏥- Multikafeteria (PL) 🍽️- Free parking (PL) 🚗
If you do not have all the qualifications, but you think there is a match, let's talk.
The recruitment process for the Big Data Engineer position has the following steps:
- Technical survey - about 10 min- Technical screening - 30 min- Technical interview - 60-90 min- Interview with manager (optional) - 30-60 min
Wymagania:
The candidate must have:
- Strong experience debugging and optimizing big data pipelines, with a solid understanding of performance characteristics and bottlenecks, plus proven ability to design and build efficient data pipelines using Spark, Flink, or similar tools - Strong experience in any JVM language: Scala/Java/Kotlin - Experience building systems in AWS or another cloud - No language barrier in English to work effectively in an international team - Proficiency in communicating technical design concepts and choices
Codzienne zadania:
- Design and build end-to-end big data processing pipelines and client-facing HTTP APIs that serve the data
- Develop and debug petabyte scale systems with Scala ZIO/Tapir and Spark/AWS/EMR/Airflow/Iceberg/Trino/Superset/PostgreSQL/Redis
- Conduct proofs of concept for enhancements
Correct Context is looking for a Big Data Engineer (Spark or Flink + Scala/Kotlin/Java) for Comscore in Poland and around.
Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.
Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.
We offer:
- Real big data projects at petabyte scale 🚀- An international environment (US, PL, IE, CL) 🌎- A small, independent team working environment 🧑💻- High influence on the working environment- Hands-on engineering work- Flexible work time ⏰- Fully remote or in-office work in Wroclaw, Poland 🏢- 18,000 - 25,000 PLN net/month B2B 💰- Private healthcare (PL) 🏥- Multikafeteria (PL) 🍽️- Free parking (PL) 🚗
If you do not have all the qualifications, but you think there is a match, let's talk.
The recruitment process for the Big Data Engineer position has the following steps:
- Technical survey - about 10 min- Technical screening - 30 min- Technical interview - 60-90 min- Interview with manager (optional) - 30-60 min
Wymagania:
The candidate must have:
- Strong experience debugging and optimizing big data pipelines, with a solid understanding of performance characteristics and bottlenecks, plus proven ability to design and build efficient data pipelines using Spark, Flink, or similar tools - Strong experience in any JVM language: Scala/Java/Kotlin - Experience building systems in AWS or another cloud - No language barrier in English to work effectively in an international team - Proficiency in communicating technical design concepts and choices
Codzienne zadania:
- Design and build end-to-end big data processing pipelines and client-facing HTTP APIs that serve the data
- Develop and debug petabyte scale systems with Scala ZIO/Tapir and Spark/AWS/EMR/Airflow/Iceberg/Trino/Superset/PostgreSQL/Redis
- Conduct proofs of concept for enhancements
🔍 Dekoder Ogłoszenia
🔴
Real big data projects at petabyte scale 🚀
Projekt może dotyczyć dużych zbiorów danych, ale skala petabajtów może być teoretyczna lub obejmować tylko niewielką część infrastruktury.
🔴
A small, independent team working environment 🧑💻
Może oznaczać brak jasno zdefiniowanych procesów i dużą samodzielność, ale też potencjalnie brak wsparcia ze strony większych struktur.
🔴
High influence on the working environment
Może oznaczać realny wpływ na kształtowanie procesów i technologii, ale też potencjalnie odpowiedzialność za rozwiązywanie problemów, które nie są jasno przypisane.
🔴
If you do not have all the qualifications, but you think there is a match, let's talk.
Firma jest otwarta na kandydatów z pewnymi brakami, ale może to też oznaczać, że oczekiwania co do posiadanych umiejętności są elastyczne, a rzeczywiste wymagania mogą być wyższe.
🟡
Strong experience debugging and optimizing big data
Choć brzmi konkretnie, 'strong experience' jest subiektywne i może oznaczać różne poziomy zaawansowania w zależności od rekrutera.