Data Engineer (Azure / Databricks / Spark)
SQUARE ONE RESOURCES sp. z o.o.
⚲ Warszawa
140–155 zł netto (+ VAT) / godz.
Wymagania
- Databricks
- Python
- SQL
- ETL
- Big Data
- Spark
- Azure Data Factory (ADF)
- Microsoft Azure
Opis stanowiska
Nasze wymagania:
Good knowledge of SQL
Experience in Python development
General understanding of Big Data processing standards and tools
Experience with the Spark platform
Experience with Databricks
Experience with Data Processing and Storage services of Azure cloud is preferable
O projekcie:
The project focuses on the development of a Predictive Maintenance system for jet engines. We are looking for experienced Data Engineers who will work on processing large-scale datasets using Big Data technologies.
The project is planned for 3 months, full-time, and fully remote. The candidate will work using equipment provided by the client.
Experience with projects based on Databricks and Apache Spark is highly preferred.
Zakres obowiązków:
Develop and maintain ETL/ELT data pipelines.
Process and transform large datasets using Databricks and Apache Spark.
Build data solutions in Azure environment.
Develop data processing logic using Python and SQL.
Optimize data workflows and ensure data quality.
Collaborate with Data Science and BI teams.
Support the development of a Predictive Maintenance system.
Oferujemy:
100% remote
Full-time job
Laptop and required equipment provided by the client
Medicover
Medicover Sport
Start ASAP
Good knowledge of SQL
Experience in Python development
General understanding of Big Data processing standards and tools
Experience with the Spark platform
Experience with Databricks
Experience with Data Processing and Storage services of Azure cloud is preferable
O projekcie:
The project focuses on the development of a Predictive Maintenance system for jet engines. We are looking for experienced Data Engineers who will work on processing large-scale datasets using Big Data technologies.
The project is planned for 3 months, full-time, and fully remote. The candidate will work using equipment provided by the client.
Experience with projects based on Databricks and Apache Spark is highly preferred.
Zakres obowiązków:
Develop and maintain ETL/ELT data pipelines.
Process and transform large datasets using Databricks and Apache Spark.
Build data solutions in Azure environment.
Develop data processing logic using Python and SQL.
Optimize data workflows and ensure data quality.
Collaborate with Data Science and BI teams.
Support the development of a Predictive Maintenance system.
Oferujemy:
100% remote
Full-time job
Laptop and required equipment provided by the client
Medicover
Medicover Sport
Start ASAP
🔍 Dekoder Ogłoszenia
🔴
General understanding of Big Data processing standards and tools
Może oznaczać bardzo podstawową wiedzę, a nie głębokie zrozumienie.
🔴
Experience with Data Processing and Storage services of Azure cloud is preferable
To nie jest wymagane, więc prawdopodobnie nie będziesz pracować z tymi usługami lub będzie to bardzo ograniczony zakres.
🟡
The project is planned for 3 months
Jest bardzo prawdopodobne, że projekt zostanie przedłużony lub będzie to początek dłuższej współpracy, ale nie jest to gwarantowane.
🔴
Experience with projects based on Databricks and Apache Spark is highly preferred
Chociaż nie jest to wymagane, brak tego doświadczenia może znacząco obniżyć Twoje szanse na zatrudnienie.
🟡
Collaborate with Data Science and BI teams
Może oznaczać konieczność częstego wyjaśniania podstawowych koncepcji technicznych lub rozwiązywania problemów wynikających z braku spójności między zespołami.