Data Engineer (Azure / Databricks / Spark)
⚲ Warsaw
23 520 - 26 040 PLN (B2B)
Wymagania
- Azure
- Databricks
- Python
- SQL
- ETL
- Big Data
- Spark
- Azure Data Factory (ADF)
Opis stanowiska
O projekcie:
- The project focuses on the development of a Predictive Maintenance system for jet engines. We are looking for experienced Data Engineers who will work on processing large-scale datasets using Big Data technologies.- The project is planned for 3 months, full-time, and fully remote. The candidate will work using equipment provided by the client.- Experience with projects based on Databricks and Apache Spark is highly preferred.
Wymagania:
- Good knowledge of SQL-
Experience in Python development-
General understanding of Big Data processing standards and tools-
Experience with the Spark platform-
Experience with Databricks-
Experience with Data Processing and Storage services of Azure cloud is preferable
Codzienne zadania:
- Develop and maintain ETL/ELT data pipelines.
- Process and transform large datasets using Databricks and Apache Spark.
- Build data solutions in Azure environment.
- Develop data processing logic using Python and SQL.
- Optimize data workflows and ensure data quality.
- Collaborate with Data Science and BI teams.
- Support the development of a Predictive Maintenance system.
- The project focuses on the development of a Predictive Maintenance system for jet engines. We are looking for experienced Data Engineers who will work on processing large-scale datasets using Big Data technologies.- The project is planned for 3 months, full-time, and fully remote. The candidate will work using equipment provided by the client.- Experience with projects based on Databricks and Apache Spark is highly preferred.
Wymagania:
- Good knowledge of SQL-
Experience in Python development-
General understanding of Big Data processing standards and tools-
Experience with the Spark platform-
Experience with Databricks-
Experience with Data Processing and Storage services of Azure cloud is preferable
Codzienne zadania:
- Develop and maintain ETL/ELT data pipelines.
- Process and transform large datasets using Databricks and Apache Spark.
- Build data solutions in Azure environment.
- Develop data processing logic using Python and SQL.
- Optimize data workflows and ensure data quality.
- Collaborate with Data Science and BI teams.
- Support the development of a Predictive Maintenance system.
🔍 Dekoder Ogłoszenia
🔴
The project is planned for 3 months, full-time, and fully remote.
Projekt jest kontraktowy i może nie zostać przedłużony, mimo że jest opisywany jako praca na pełen etat.
🟡
The candidate will work using equipment provided by the client.
Oznacza to, że nie będziesz mógł używać swojego prywatnego sprzętu, co może ograniczać elastyczność pracy.
🔴
Experience with projects based on Databricks and Apache Spark is highly preferred.
Chociaż jest to preferowane, może oznaczać, że brak tego doświadczenia nie jest dyskwalifikujący, ale może być problemem w praktyce.
🔴
Experience with Data Processing and Storage services of Azure cloud is preferable
Podobnie jak wyżej, preferencja może sugerować, że jest to mile widziane, ale niekonieczne, co może prowadzić do nauki na bieżąco.
🟡
Collaborate with Data Science and BI teams.
Może oznaczać, że będziesz musiał tłumaczyć złożone techniczne zagadnienia do mniej technicznych zespołów lub pracować z niejasnymi wymaganiami.