Senior Data Engineer - financial industry (f/m/x)
⚲ Białystok, Centrum, Bydgoszcz, Gdańsk, Oliwa, Katowice, Kraków, Podgórze, Lublin, Łódź, Śródmieście, Piła, Poznań, Wilda, Rzeszów, Szczecin, Toruń, Warszawa, Mokotów, Wrocław, Fabryczna
Do uzgodnienia
Wymagania
- Python
- PySpark
- Databricks
- Azure Data Factory
- Azure Event Hubs
- Analytical thinking
- Elasticsearch
Opis stanowiska
Nasze wymagania:
At least 5 years of experience in a Data Engineer, Big Data Engineer, or similar role
Strong hands-on experience with Python and PySpark
Proven experience with Databricks, Delta Tables, and modern data architectures
Practical knowledge of the Microsoft Azure ecosystem, including Azure Data Factory and Azure Event Hub
Experience building and maintaining scalable ETL/ELT pipelines
Advanced level of English
Interest in modern technologies and experience using AI-assisted development tools in everyday work
Mile widziane:
Familiarity with Elasticsearch
Strong analytical skills and a proactive approach to solving complex data-related challenges
O projekcie:
We are looking for a Senior Big Data Developer to join our team in building a modern data platform using Databricks and the Microsoft Azure ecosystem. In this role, you will be responsible for designing and developing scalable data solutions, implementing and optimizing ETL/ELT pipelines, and integrating data from multiple sources. If you are passionate about modern data engineering, AI-assisted development, and creating impactful data solutions, don't hesitate to apply!
Zakres obowiązków:
Design and develop data solutions using Databricks, Python, and PySpark
Build and optimize ETL/ELT pipelines for batch and streaming data processing
Implement and maintain medallion architecture using Delta Tables
Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub
Work with Azure services such as Azure Data Factory to support end-to-end data workflows
Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity
Oferujemy:
Great Place to Work since 2015 - it’s thanks to feedback from our workers that we get this special title and constantly implement new ideas
Employment stability - revenue of PLN 2.1BN, no debts, since 2006 on the market
We share the profit with Workers - over PLN 76M has already been allocated for this aim since 2022
Attractive benefits package - private healthcare, benefits cafeteria platform, car discounts and more
Comfortable workplace – class A offices or remote work
Dozens of fascinating projects for prestigious brands from all over the world – you can change them thanks to Job Changer application
PLN 1 000 000 per year for your ideas - with this amount, we support the passions and voluntary actions of our workers
Investment in your growth – meetups, webinars, training platform and technology blog – you choose
Fantastic atmosphere created by all Sii Power People
At least 5 years of experience in a Data Engineer, Big Data Engineer, or similar role
Strong hands-on experience with Python and PySpark
Proven experience with Databricks, Delta Tables, and modern data architectures
Practical knowledge of the Microsoft Azure ecosystem, including Azure Data Factory and Azure Event Hub
Experience building and maintaining scalable ETL/ELT pipelines
Advanced level of English
Interest in modern technologies and experience using AI-assisted development tools in everyday work
Mile widziane:
Familiarity with Elasticsearch
Strong analytical skills and a proactive approach to solving complex data-related challenges
O projekcie:
We are looking for a Senior Big Data Developer to join our team in building a modern data platform using Databricks and the Microsoft Azure ecosystem. In this role, you will be responsible for designing and developing scalable data solutions, implementing and optimizing ETL/ELT pipelines, and integrating data from multiple sources. If you are passionate about modern data engineering, AI-assisted development, and creating impactful data solutions, don't hesitate to apply!
Zakres obowiązków:
Design and develop data solutions using Databricks, Python, and PySpark
Build and optimize ETL/ELT pipelines for batch and streaming data processing
Implement and maintain medallion architecture using Delta Tables
Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub
Work with Azure services such as Azure Data Factory to support end-to-end data workflows
Utilize AI-powered development tools to improve code quality, testing, documentation, and productivity
Oferujemy:
Great Place to Work since 2015 - it’s thanks to feedback from our workers that we get this special title and constantly implement new ideas
Employment stability - revenue of PLN 2.1BN, no debts, since 2006 on the market
We share the profit with Workers - over PLN 76M has already been allocated for this aim since 2022
Attractive benefits package - private healthcare, benefits cafeteria platform, car discounts and more
Comfortable workplace – class A offices or remote work
Dozens of fascinating projects for prestigious brands from all over the world – you can change them thanks to Job Changer application
PLN 1 000 000 per year for your ideas - with this amount, we support the passions and voluntary actions of our workers
Investment in your growth – meetups, webinars, training platform and technology blog – you choose
Fantastic atmosphere created by all Sii Power People
🔍 Dekoder Ogłoszenia
🔴
Interest in modern technologies and experience using AI-assisted development tools in everyday work
Firma może oczekiwać, że będziesz eksperymentować z nowymi narzędziami AI, a nie tylko ich używać.
🔴
Proven experience with Databricks, Delta Tables, and modern data architectures
Może oznaczać, że oczekiwana jest głęboka wiedza teoretyczna i praktyczna, a nie tylko podstawowe użycie.
🔴
Practical knowledge of the Microsoft Azure ecosystem, including Azure Data Factory and Azure Event Hub
Może oznaczać, że będziesz musiał samodzielnie rozwiązywać problemy związane z konfiguracją i integracją usług Azure.
🟡
Strong analytical skills and a proactive approach to solving complex data-related challenges
Oczekuje się, że będziesz samodzielnie identyfikować problemy i proponować rozwiązania, a nie tylko wykonywać polecenia.
🟡
building a modern data platform using Databricks and the Microsoft Azure ecosystem
Projekt może być na wczesnym etapie rozwoju, co wiąże się z potencjalnymi zmianami i nieprzewidzianymi wyzwaniami.