Senior Data Engineer – automotive sector (f/m/x)
⚲ Wrocław
Do uzgodnienia
Wymagania
- MS Azure Databricks
- Python
- ETL
- Apache Spark
- IICS (Informatica Intelligent Cloud Services)
- Informatica
Opis stanowiska
We are looking for an experienced Senior Data Engineer to join a data team working on global data platforms within the financial services domain.
You will be part of a large-scale transformation initiative aimed at building a modern, cloud-based data ecosystem and enabling the organization to become fully data-driven. The project focuses on developing and maintaining Data Lake solutions, integrating multiple data sources, and delivering high-quality datasets for global analytics use cases.
Your tasks
• Design, build, and optimize scalable data pipelines (batch & real-time)
• Develop and maintain ETL processes and integrate data from multiple sources (including migrations)
• Create and manage data structures in Azure SQL and develop Databricks solutions (PySpark, Spark SQL)
• Ensure data quality, governance, and optimize performance (SQL, processing)
• Collaborate with cross-functional teams and implement CI/CD, automation, and Agile best practices
Requirements
• Bachelor’s degree in Computer Science, Engineering, or related field
• At least 5 years of experience in Data Engineering with a strong ETL background
• Hands-on experience with Azure Data Factory, Azure Databricks, Azure SQL, ADLS
• Proficiency in Python, Scala, or Java and strong SQL skills
• Experience with big data frameworks, CI/CD, and Agile methodologies, plus strong communication skills
• Very good command in English
• Fluent Polish required
• Residing in Poland required
You will be part of a large-scale transformation initiative aimed at building a modern, cloud-based data ecosystem and enabling the organization to become fully data-driven. The project focuses on developing and maintaining Data Lake solutions, integrating multiple data sources, and delivering high-quality datasets for global analytics use cases.
Your tasks
• Design, build, and optimize scalable data pipelines (batch & real-time)
• Develop and maintain ETL processes and integrate data from multiple sources (including migrations)
• Create and manage data structures in Azure SQL and develop Databricks solutions (PySpark, Spark SQL)
• Ensure data quality, governance, and optimize performance (SQL, processing)
• Collaborate with cross-functional teams and implement CI/CD, automation, and Agile best practices
Requirements
• Bachelor’s degree in Computer Science, Engineering, or related field
• At least 5 years of experience in Data Engineering with a strong ETL background
• Hands-on experience with Azure Data Factory, Azure Databricks, Azure SQL, ADLS
• Proficiency in Python, Scala, or Java and strong SQL skills
• Experience with big data frameworks, CI/CD, and Agile methodologies, plus strong communication skills
• Very good command in English
• Fluent Polish required
• Residing in Poland required
🔍 Dekoder Ogłoszenia
🔴
join a data team working on global data platforms within the financial services domain
Mimo że ogłoszenie wspomina o sektorze motoryzacyjnym w tytule, opis jasno wskazuje na pracę w obszarze usług finansowych, co może być pomyłką lub celowym zabiegiem.
🔴
aimed at building a modern, cloud-based data ecosystem
Może oznaczać, że obecny system jest przestarzały i wymaga gruntownej przebudowy, co wiąże się z potencjalnymi wyzwaniami i niepewnością.
🔴
enabling the organization to become fully data-driven
Sugeruje, że firma jest na wczesnym etapie wdrażania kultury opartej na danych, co może oznaczać opór ze strony organizacji i potrzebę edukacji.
🔴
integrating multiple data sources (including migrations)
Migracje danych często są skomplikowane, czasochłonne i mogą wiązać się z nieprzewidzianymi problemami technicznymi.
🟡
Agile best practices
Może oznaczać zarówno efektywne stosowanie zwinnych metodyk, jak i ich powierzchowne lub niekonsekwentne wdrażanie.