Senior Data Engineer
⚲ Wrocław
25 200 - 30 240 PLN netto (B2B)
Wymagania
- Azure
- Databricks
- Azure Services
Opis stanowiska
Key responsibilities:
• Collaborate with business stakeholders to understand requirements and translate them into data engineering solutions.
• Design, build, and maintain end-to-end data pipelines for ingestion, transformation, and processing using Azure services, Databricks, IICS, and Azure Synapse.
• Develop advanced transformation logic in Databricks and IICS to support complex business use cases.
• Knowledge of modern Data Modeling and Design concepts
• Set up and manage DevOps environments, including configurations, CI/CD pipelines, releases, deployments, and hotfix management.
• Write clean, efficient, and maintainable code in SQL, Python, PySpark, and scripting languages.
• Actively contribute in an Agile environment, ensuring transparency, collaboration, and continuous improvement.
Required skills:
• 5 years of experience in Data Engineering.
• Strong hands-on experience with Databricks, Azure Services (Azure Data Factory, Azure SQL Database, Azure Key Vault), IICS, and Azure Synapse.
• Advanced programming skills in Python, PySpark, and SQL.
• Experience designing and implementing CI/CD pipelines and managing Azure DevOps environments.
• Knowledge of API integrations and enterprise data architecture, theoretical AI knowledge
• Experience working in Agile/Scrum teams.
• Strong analytical and problem-solving skills
• Collaborate with business stakeholders to understand requirements and translate them into data engineering solutions.
• Design, build, and maintain end-to-end data pipelines for ingestion, transformation, and processing using Azure services, Databricks, IICS, and Azure Synapse.
• Develop advanced transformation logic in Databricks and IICS to support complex business use cases.
• Knowledge of modern Data Modeling and Design concepts
• Set up and manage DevOps environments, including configurations, CI/CD pipelines, releases, deployments, and hotfix management.
• Write clean, efficient, and maintainable code in SQL, Python, PySpark, and scripting languages.
• Actively contribute in an Agile environment, ensuring transparency, collaboration, and continuous improvement.
Required skills:
• 5 years of experience in Data Engineering.
• Strong hands-on experience with Databricks, Azure Services (Azure Data Factory, Azure SQL Database, Azure Key Vault), IICS, and Azure Synapse.
• Advanced programming skills in Python, PySpark, and SQL.
• Experience designing and implementing CI/CD pipelines and managing Azure DevOps environments.
• Knowledge of API integrations and enterprise data architecture, theoretical AI knowledge
• Experience working in Agile/Scrum teams.
• Strong analytical and problem-solving skills
🔍 Dekoder Ogłoszenia
🔴
Collaborate with business stakeholders to understand requirements and translate them into data engineering solutions.
Może oznaczać, że będziesz musiał spędzać dużo czasu na spotkaniach z ludźmi, którzy nie do końca wiedzą, czego chcą, i będziesz musiał sam to rozgryźć.
🔴
Design, build, and maintain end-to-end data pipelines for ingestion, transformation, and processing using Azure services, Databricks, IICS, and Azure Synapse.
Chociaż wymieniono wiele technologii, może to oznaczać, że będziesz musiał pracować z różnymi, potencjalnie nie do końca zintegrowanymi narzędziami, co może generować dodatkową pracę.
🔴
Develop advanced transformation logic in Databricks and IICS to support complex business use cases.
Może sugerować, że będziesz musiał radzić sobie z bardzo skomplikowanymi i potencjalnie słabo udokumentowanymi istniejącymi procesami.
🔴
Set up and manage DevOps environments, including configurations, CI/CD pipelines, releases, deployments, and hotfix management.
Oznacza to, że oprócz pracy inżyniera danych, będziesz również odpowiedzialny za całą infrastrukturę DevOps, co może być znacznym obciążeniem.
🟡
Theoretical AI knowledge
To stwierdzenie jest bardzo ogólne i może oznaczać, że oczekuje się od Ciebie podstawowej wiedzy, a nie praktycznego zastosowania AI w projektach.