Senior Data Engineer
⚲ Kraków, Grzegórzki
20 300–32 000 zł / mies. (zal. od umowy)
Wymagania
- AWS S3
- Glue
- Athena
- Apache Spark
- Python
- SQL
- Airflow
- Dagster
- Perfect
- PySpark
- AWS Data Engineering
- Terraform
- CloudFormation
- AWS
- Kafka
- Kinesis
- Databricks
- Unity Catalog
- Delta Lake
- Lakehouse architecture
Opis stanowiska
Nasze wymagania:
Master’s degree in computer science, Data Engineering, AI, or a related field
6+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines
Proven experience with AWS platform and AWS Data Engineering stack (S3, Glue, Athena and other)
Strong experience with Apache Spark (PySpark), including performance optimization, and large-scale data processing
Proficiency in Python and SQL for data transformations and analytics workloads
Experience with data pipeline orchestration (Airflow, Dagster, Prefect or similar)
Strong problem-solving skills and ability to work independently
Fluency in English, both written and spoken
Mile widziane:
Databricks experience (Unity Catalog, Delta Lake and Lakehouse architecture)
Experience with Infrastructure as Code (Terraform, CloudFormation)
Data Engineer certificate (AWS or Databricks)
Experience with streaming tools like Kafka, Kinesis or similar
O projekcie:
At Grape Up, we transform businesses by unlocking the potential of AI and data through innovative software solutions.
We partner with industry leaders, from the automotive and finance industry, to build sophisticated Data & Analytics platforms that transform how organizations manage and leverage their data assets. As an AWS Partner, we work closely with AWS teams to deliver solutions built on the AWS ecosystem. Our solutions provide comprehensive capabilities spanning data storage, management, advanced analytics, machine learning, and AI, enabling enterprises to accelerate innovation and make data-driven decisions.
Zakres obowiązków:
Implement a scalable architecture capable of handling the high volume of simulation data
Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform
Optimize and enhance system setup and improve data structures following industry best practices
Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs
Collaborate with business stakeholders and technical teams to understand data requirements, translate business needs into technical solutions
Oferujemy:
Non-corporate work environment among experienced engineers
Individual growth & development plan supported by cyclical feedback sessions
Access to knowledge platforms (e.g. Pluralsight)
Equipment of your choice
Financing of conferences, external trainings, and certifications
Language lessons (English, German and Polish for foreigners)
LuxMed private medical care
Weekly Lunch & Learn where we meet up in the office, lunch together, and share our knowledge
Employee referral program
Rewards for the success of the month and year awarded by our employees
Special rewards for your years with us (G-Man)
Integration activities
Master’s degree in computer science, Data Engineering, AI, or a related field
6+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines
Proven experience with AWS platform and AWS Data Engineering stack (S3, Glue, Athena and other)
Strong experience with Apache Spark (PySpark), including performance optimization, and large-scale data processing
Proficiency in Python and SQL for data transformations and analytics workloads
Experience with data pipeline orchestration (Airflow, Dagster, Prefect or similar)
Strong problem-solving skills and ability to work independently
Fluency in English, both written and spoken
Mile widziane:
Databricks experience (Unity Catalog, Delta Lake and Lakehouse architecture)
Experience with Infrastructure as Code (Terraform, CloudFormation)
Data Engineer certificate (AWS or Databricks)
Experience with streaming tools like Kafka, Kinesis or similar
O projekcie:
At Grape Up, we transform businesses by unlocking the potential of AI and data through innovative software solutions.
We partner with industry leaders, from the automotive and finance industry, to build sophisticated Data & Analytics platforms that transform how organizations manage and leverage their data assets. As an AWS Partner, we work closely with AWS teams to deliver solutions built on the AWS ecosystem. Our solutions provide comprehensive capabilities spanning data storage, management, advanced analytics, machine learning, and AI, enabling enterprises to accelerate innovation and make data-driven decisions.
Zakres obowiązków:
Implement a scalable architecture capable of handling the high volume of simulation data
Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform
Optimize and enhance system setup and improve data structures following industry best practices
Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs
Collaborate with business stakeholders and technical teams to understand data requirements, translate business needs into technical solutions
Oferujemy:
Non-corporate work environment among experienced engineers
Individual growth & development plan supported by cyclical feedback sessions
Access to knowledge platforms (e.g. Pluralsight)
Equipment of your choice
Financing of conferences, external trainings, and certifications
Language lessons (English, German and Polish for foreigners)
LuxMed private medical care
Weekly Lunch & Learn where we meet up in the office, lunch together, and share our knowledge
Employee referral program
Rewards for the success of the month and year awarded by our employees
Special rewards for your years with us (G-Man)
Integration activities
🔍 Dekoder Ogłoszenia
🟡
building production-grade data platforms and pipelines
Oczekuje się, że kandydat będzie budował i utrzymywał systemy danych, które są stabilne, skalowalne i gotowe do pracy w środowisku produkcyjnym.
🟡
Strong problem-solving skills and ability to work independently
Oczekuje się, że kandydat będzie potrafił samodzielnie rozwiązywać złożone problemy techniczne bez ciągłego nadzoru.
🟢
At Grape Up, we transform businesses by unlocking the potential of AI and data through innovative software solutions.
Firma pozycjonuje się jako innowacyjny partner technologiczny, który pomaga klientom wykorzystywać dane i AI do rozwoju biznesu.
🟡
we work closely with AWS teams to deliver solutions built on the AWS ecosystem.
Firma ma silne partnerstwo z AWS, co może oznaczać dostęp do najnowszych technologii i szkoleń, ale także potencjalne naciski na wykorzystanie konkretnych rozwiązań AWS.