Databricks Architect (Data Engineering)
⚲ Wrocław
23 520 - 31 920 PLN (B2B)
Wymagania
- Data engineering
- Apache Spark
- Spark SQL
- UNITY
- Cloud
- Azure
- AWS
- Azure Data Factory
- Airflow
- Databricks (nice to have)
- CD pipelines (nice to have)
- Git (nice to have)
- SQL (nice to have)
- Python (nice to have)
- Stakeholder management (nice to have)
- Kafka (nice to have)
- IaC (nice to have)
- AI (nice to have)
Opis stanowiska
O projekcie:
About the role
We are looking for an experienced Databricks Architect to design and lead modern data platforms built on the Databricks ecosystem. In this role you will define architecture standards, establish engineering best practices, and support development teams in delivering scalable, secure and high-performing data solutions.
About Spyrosoft
Spyrosoft is an authentic, cutting-edge software engineering company, established in 2016. In 2021 and 2022, we were among the fastest growing technology companies in Europe, according to the Financial Times. We were founded by a group of tech experts with established backgrounds in software engineering, who created an ‘engineer-to-engineer’ workplace, powered by enthusiasm, fairness and authentic relationships. Having a unique offering, which bridge the gap between technology and business, we specialise in technology solutions for industry 4.0, automotive, geospatial, healthcare & life sciences, employee experience & education and financial services industries.
Wymagania:
- 7+ years of experience in Data Engineering- 3+ years of hands-on experience with Databricks- Strong expertise in Apache Spark (PySpark and/or Spark SQL)- Excellent knowledge of Delta Lake and Lakehouse Architecture- Experience designing enterprise-scale data platforms- Strong understanding of Medallion Architecture- Experience with Unity Catalog and data governance- Experience with cloud platforms (Azure, AWS or GCP)- Knowledge of orchestration tools (Azure Data Factory, Airflow, Databricks Workflows or similar)- Experience with CI/CD pipelines and Git-based development- Strong SQL and Python skills- Excellent communication and stakeholder management skills- Fluent EnglishNice to have- Databricks certifications- Experience with dbt- Experience with Kafka or other streaming technologies- Terraform or other IaC tools- Experience designing AI/ML-ready data platforms
Codzienne zadania:
- Design end-to-end Data Lakehouse architectures based on Databricks
- Define data platform architecture, integration patterns and governance standards
- Lead architecture decisions around ETL/ELT, batch and streaming data processing
- Design scalable solutions using Delta Lake, Unity Catalog and Medallion Architecture
- Collaborate with Data Engineers, Data Scientists, Architects and business stakeholders
- Define security, data governance and access management strategies
- Optimize platform performance and cloud costs
- Support CI/CD implementation and Infrastructure as Code practices
- Review solution designs and mentor engineering teams
- Drive adoption of modern Data Engineering best practices
About the role
We are looking for an experienced Databricks Architect to design and lead modern data platforms built on the Databricks ecosystem. In this role you will define architecture standards, establish engineering best practices, and support development teams in delivering scalable, secure and high-performing data solutions.
About Spyrosoft
Spyrosoft is an authentic, cutting-edge software engineering company, established in 2016. In 2021 and 2022, we were among the fastest growing technology companies in Europe, according to the Financial Times. We were founded by a group of tech experts with established backgrounds in software engineering, who created an ‘engineer-to-engineer’ workplace, powered by enthusiasm, fairness and authentic relationships. Having a unique offering, which bridge the gap between technology and business, we specialise in technology solutions for industry 4.0, automotive, geospatial, healthcare & life sciences, employee experience & education and financial services industries.
Wymagania:
- 7+ years of experience in Data Engineering- 3+ years of hands-on experience with Databricks- Strong expertise in Apache Spark (PySpark and/or Spark SQL)- Excellent knowledge of Delta Lake and Lakehouse Architecture- Experience designing enterprise-scale data platforms- Strong understanding of Medallion Architecture- Experience with Unity Catalog and data governance- Experience with cloud platforms (Azure, AWS or GCP)- Knowledge of orchestration tools (Azure Data Factory, Airflow, Databricks Workflows or similar)- Experience with CI/CD pipelines and Git-based development- Strong SQL and Python skills- Excellent communication and stakeholder management skills- Fluent EnglishNice to have- Databricks certifications- Experience with dbt- Experience with Kafka or other streaming technologies- Terraform or other IaC tools- Experience designing AI/ML-ready data platforms
Codzienne zadania:
- Design end-to-end Data Lakehouse architectures based on Databricks
- Define data platform architecture, integration patterns and governance standards
- Lead architecture decisions around ETL/ELT, batch and streaming data processing
- Design scalable solutions using Delta Lake, Unity Catalog and Medallion Architecture
- Collaborate with Data Engineers, Data Scientists, Architects and business stakeholders
- Define security, data governance and access management strategies
- Optimize platform performance and cloud costs
- Support CI/CD implementation and Infrastructure as Code practices
- Review solution designs and mentor engineering teams
- Drive adoption of modern Data Engineering best practices
🔍 Dekoder Ogłoszenia
🔴
design and lead modern data platforms built on the Databricks ecosystem
Oczekuje się, że będziesz samodzielnie projektować i nadzorować wdrożenie platform danych, a nie tylko implementować istniejące rozwiązania.
🔴
define architecture standards, establish engineering best practices
Będziesz odpowiedzialny za tworzenie i egzekwowanie standardów, co może oznaczać konieczność przekonywania innych do swoich pomysłów.
🔴
support development teams in delivering scalable, secure and high-performing data solutions
Twoja rola będzie polegać na pomocy innym zespołom, co może oznaczać mniej bezpośredniego wpływu na kod i więcej pracy konsultacyjnej.
🟡
engineer-to-engineer’ workplace, powered by enthusiasm, fairness and authentic relationships
Firma podkreśla kulturę opartą na relacjach i entuzjazmie, co może sugerować mniej formalne podejście do procesów i większą elastyczność.
🟡
bridge the gap between technology and business
Oczekuje się, że będziesz rozumieć potrzeby biznesowe i potrafić je przełożyć na rozwiązania technologiczne, co może oznaczać dodatkowe obowiązki komunikacyjne.