Big Data Engineer IV
⚲ Kraków
31 248 - 34 944 PLN (B2B)
Wymagania
- Scala
- Cloud
- Kubernetes
- Java
- SQL
- Docker (nice to have)
- Jenkins (nice to have)
- Hadoop (nice to have)
- Data engineering (nice to have)
- Python (nice to have)
- Apache Spark (nice to have)
- BigQuery (nice to have)
Opis stanowiska
O projekcie:
At OpenX, we have built a team that is uniquely experienced in designing and operating high-scale ad marketplaces, and we are constantly on the lookout for thoughtful, creative executors who are as fascinated as we are about finding new ways to apply a blend of market design, technical innovation, operational excellence, and empathetic partner service to the frontiers of digital advertising.
You will work in all aspects of agile application development, including our enterprise platform that interfaces with a multitude of services that are dependent on to deliver billions of requests per day. Your opinions will be important in all phases of product development, starting from requirements to validation and deployment.
Working on the enterprise platform, you will be working with multiple distributed teams to architect, create, and deliver new features and functionality in order to deliver the best possible advertising experience in the market. Scalability, performance, and rock-solid reliability are all factors to consider with every line you code.
The Team and Project:
You will be part of the core data platform team. Our exchange handles billions of ad requests daily connecting thousands of publishers with demand partners. Each request produces data events that have to be processed to extract business value from them. Daily our applications produce more than 1PB of data.
Please note: all interview stages are run remotely!
Wymagania:
- 8+ years experience in Java, Scala or Python development- 3+ years of experience in Big Data systems development- Experience building complex data pipelines, including SQL-based transformations with tools such as dbt or Dataform, and large-scale data processing with distributed frameworks such as Apache Spark.- Expertise using BigQuery or other data warehouses including performance tuning and monitoring.- Understands data orchestration tools like Airflow to extend it with new data pipelines and troubleshoots its operational issues.- Cloud experience with Google Cloud Platform or AWS, k8s, and Docker.- Understanding of CI/CD, automated testing, monitoring and other DevOps practices.- Fluently speak algorithms, data structures, and platforms.- Experience with database system design, RDBMs and/or NoSQL.- Bachelor’s degree in computer science, physics, or related field. A Master’s degree is a plus.- Communicative Polish and English.
Codzienne zadania:
- Design large-scale data processing systems.
- Work with Product to drive the requirements, and own the project end-to-end.
- Analyze and improve the efficiency, scalability, and stability of applications.
- Think long-term and be unsatisfied with band-aids.
- Identify unnecessary complexity and remove it.
At OpenX, we have built a team that is uniquely experienced in designing and operating high-scale ad marketplaces, and we are constantly on the lookout for thoughtful, creative executors who are as fascinated as we are about finding new ways to apply a blend of market design, technical innovation, operational excellence, and empathetic partner service to the frontiers of digital advertising.
You will work in all aspects of agile application development, including our enterprise platform that interfaces with a multitude of services that are dependent on to deliver billions of requests per day. Your opinions will be important in all phases of product development, starting from requirements to validation and deployment.
Working on the enterprise platform, you will be working with multiple distributed teams to architect, create, and deliver new features and functionality in order to deliver the best possible advertising experience in the market. Scalability, performance, and rock-solid reliability are all factors to consider with every line you code.
The Team and Project:
You will be part of the core data platform team. Our exchange handles billions of ad requests daily connecting thousands of publishers with demand partners. Each request produces data events that have to be processed to extract business value from them. Daily our applications produce more than 1PB of data.
Please note: all interview stages are run remotely!
Wymagania:
- 8+ years experience in Java, Scala or Python development- 3+ years of experience in Big Data systems development- Experience building complex data pipelines, including SQL-based transformations with tools such as dbt or Dataform, and large-scale data processing with distributed frameworks such as Apache Spark.- Expertise using BigQuery or other data warehouses including performance tuning and monitoring.- Understands data orchestration tools like Airflow to extend it with new data pipelines and troubleshoots its operational issues.- Cloud experience with Google Cloud Platform or AWS, k8s, and Docker.- Understanding of CI/CD, automated testing, monitoring and other DevOps practices.- Fluently speak algorithms, data structures, and platforms.- Experience with database system design, RDBMs and/or NoSQL.- Bachelor’s degree in computer science, physics, or related field. A Master’s degree is a plus.- Communicative Polish and English.
Codzienne zadania:
- Design large-scale data processing systems.
- Work with Product to drive the requirements, and own the project end-to-end.
- Analyze and improve the efficiency, scalability, and stability of applications.
- Think long-term and be unsatisfied with band-aids.
- Identify unnecessary complexity and remove it.
🔍 Dekoder Ogłoszenia
🟡
thoughtful, creative executors
Oczekuje się od Ciebie samodzielności i inicjatywy w rozwiązywaniu problemów, a nie tylko wykonywania poleceń.
🟡
Your opinions will be important in all phases of product development
Twoje sugestie i pomysły będą brane pod uwagę, ale ostateczne decyzje mogą należeć do innych osób.
🟡
working with multiple distributed teams
Będziesz musiał efektywnie komunikować się i współpracować z zespołami znajdującymi się w różnych lokalizacjach i strefach czasowych.
🟢
Scalability, performance, and rock-solid reliability are all factors to consider with every line you code.
Oczekuje się od Ciebie pisania kodu, który jest nie tylko funkcjonalny, ale także wydajny, skalowalny i odporny na błędy.
🟡
extract business value from them
Twoja praca będzie bezpośrednio powiązana z generowaniem przychodów lub optymalizacją procesów biznesowych firmy.