Cloud Data Engineer - 100 % remote
AVENGA (Agencja Pracy, nr KRAZ: 8448)
⚲ Warszawa
26 880 - 30 240 PLN (B2B)
Wymagania
- Python
- Google Cloud Services
- BigQuery
- Terraform
- PySpark (nice to have)
- SQL (nice to have)
- Airflow (nice to have)
- Jenkins (nice to have)
- OpenShift (nice to have)
- Git (nice to have)
- Docker (nice to have)
- Kubernetes (nice to have)
Opis stanowiska
O projekcie:
For one of our international clients, we are looking for an experienced Cloud Data Engineer to join the team and be responsible for both the development and operation of cloud-based client services.
Wymagania:
- You have several years of professional experience as a data engineer or in a similar position- You are a clean programmer with an agile mindset and love DataOps- You preferably have solid knowledge of Google Cloud Services and Terraform- You have experience with Python (Poetry, Pydantic, Google Python APIs, etc.)- You are used to dealing with mass data- You are characterized by a high level of quality awareness, trustworthiness and interest in new technologies- You can work independently in an agile cross-functional team- Nice to have: PySpark, SQL, Airflow, Jenkins, OpenShift, Git, Docker, Kubernetes, Java, Kafka- TECHSTACK: Python, Google Cloud Services (BigQuery, Cloud Build, Cloud Storage, Pub/Sub, Cloud Composer, DataFlow, dbt), Terraform
Codzienne zadania:
- You are responsible for the development, but also for the operation of our services in the cloud
- You analyze, understand and accompany the requirements from the idea to the end-of-life (DataOps)
- You contribute to the design of the solution, which includes development, testing and documentation
- You carry out analyses and research to solve complex business problems
- You will work as a member of your cross-functional agile team with internal stakeholders from across the organisation to develop best-in-class data products and KPIs using existing data assets
For one of our international clients, we are looking for an experienced Cloud Data Engineer to join the team and be responsible for both the development and operation of cloud-based client services.
Wymagania:
- You have several years of professional experience as a data engineer or in a similar position- You are a clean programmer with an agile mindset and love DataOps- You preferably have solid knowledge of Google Cloud Services and Terraform- You have experience with Python (Poetry, Pydantic, Google Python APIs, etc.)- You are used to dealing with mass data- You are characterized by a high level of quality awareness, trustworthiness and interest in new technologies- You can work independently in an agile cross-functional team- Nice to have: PySpark, SQL, Airflow, Jenkins, OpenShift, Git, Docker, Kubernetes, Java, Kafka- TECHSTACK: Python, Google Cloud Services (BigQuery, Cloud Build, Cloud Storage, Pub/Sub, Cloud Composer, DataFlow, dbt), Terraform
Codzienne zadania:
- You are responsible for the development, but also for the operation of our services in the cloud
- You analyze, understand and accompany the requirements from the idea to the end-of-life (DataOps)
- You contribute to the design of the solution, which includes development, testing and documentation
- You carry out analyses and research to solve complex business problems
- You will work as a member of your cross-functional agile team with internal stakeholders from across the organisation to develop best-in-class data products and KPIs using existing data assets
🔍 Dekoder Ogłoszenia
🔴
responsible for both the development and operation of cloud-based client services
Oznacza to, że będziesz odpowiedzialny nie tylko za tworzenie nowych rozwiązań, ale także za utrzymanie i rozwiązywanie problemów w istniejących usługach, co może oznaczać dyżury i pracę poza standardowymi godzinami.
🔴
You are a clean programmer with an agile mindset and love DataOps
Podkreśla to potrzebę pisania kodu wysokiej jakości i stosowania zwinnych metodyk, ale 'love DataOps' może sugerować, że oczekuje się od Ciebie głębokiego zaangażowania w automatyzację procesów danych, co może być czasochłonne.
🔴
You can work independently in an agile cross-functional team
Chociaż praca w zespole jest podkreślona, nacisk na 'niezależność' może oznaczać, że będziesz musiał samodzielnie rozwiązywać wiele problemów bez stałego nadzoru, a zespół może być rozproszony geograficznie.
🔴
You analyze, understand and accompany the requirements from the idea to the end-of-life (DataOps)
Obejmuje to pełny cykl życia danych, co może oznaczać, że będziesz zaangażowany w zadania od początkowego zbierania wymagań po wycofywanie usług, co może być bardzo szerokim zakresem obowiązków.
🔴
Nice to have: PySpark, SQL, Airflow, Jenkins, OpenShift, Git, Docker, Kubernetes, Java, Kafka
Lista 'nice to have' jest bardzo długa i obejmuje wiele kluczowych technologii, co może sugerować, że w praktyce oczekuje się od kandydata znajomości większości z nich, a nie tylko kilku wybranych.