Senior Data Engineer
⚲ Warsaw
Do uzgodnienia
Wymagania
- Security
- CI/CD
- training
- Scrum
- Web Services
- Documentation
- Agile
- Python
- strategy
- API (Application Programming Interface)
Opis stanowiska
We are looking for a Senior Data & Infrastructure Automation Engineer with strong expertise in AWS, Matillion, DataOps, and Infrastructure as Code to design, build, and scale highly automated data platform solutions.
In this role, you will act as a technical leader and solutions architect, driving automation strategies, API enablement, and modern data architectures such as Data Mesh. You will work closely with international, cross-functional teams to deliver scalable, secure, and cost-efficient data products that support global business objectives.
Key Responsibilities
• Design and implement automation strategies for onboarding new customers into the data platform, significantly improving operational efficiency and scalability.
• Lead the architecture and development of service APIs, enabling seamless platform integration and automation of external and internal processes.
• Champion and implement Data Mesh principles, fostering decentralized, scalable, and domain-oriented data solutions.
• Act as a Solutions Architect specialized in Data, DataOps, and API integration, ensuring robust, resilient, and future-proof architectures.
• Automate, provision, and manage large-scale AWS environments (8,000+ resources) using Terraform, CI/CD pipelines, Jenkins, and APIs.
• Own and evolve core data products, contributing to the organization’s long-term data platform strategy and transformation roadmap.
• Collaborate with international and cross-functional teams (Data Engineering, Platform, Product, Security) to align technical solutions with business priorities.
• Ensure high standards of performance, security, reliability, and cost optimization across cloud infrastructure.
• Drive CI/CD best practices across data and infrastructure layers.
• Deliver internal technical training and upskilling sessions, mentoring engineers and promoting engineering excellence.
• Act as a technical reference and hands-on Tech Lead, influencing architectural decisions and technology adoption.
Required Technical Skills
• Strong hands-on experience with Amazon Web Services (AWS) in large-scale production environments
• Advanced expertise in Infrastructure as Code (Terraform)
• Proven experience with Matillion for cloud-based data transformation
• Solid background in Data Engineering and DataOps practices
• Experience designing and consuming RESTful APIs
• Strong knowledge of CI/CD pipelines (e.g. Jenkins)
• Proficiency in Python for automation and integration
• Experience with Snowflake and modern cloud data warehouses
• Practical experience implementing or supporting Data Mesh architectures
• Strong understanding of automation, monitoring, and cloud cost optimization
Soft Skills & Leadership
• Proven ability to operate as Tech Lead / Senior Individual Contributor
• Strong communication skills for working with distributed, international teams
• Ability to translate business requirements into scalable technical solutions
• Proactive mindset with strong ownership and accountability
• Passion for automation, innovation, and engineering best practices
• Experience sharing knowledge through training, mentoring, and documentation
Nice to Have
• Experience in product-oriented data platforms
• Exposure to Agile / Scrum methodologies
• Prior participation in award-winning or large-scale transformation initiatives
• Background in platform engineering or internal developer platforms
In this role, you will act as a technical leader and solutions architect, driving automation strategies, API enablement, and modern data architectures such as Data Mesh. You will work closely with international, cross-functional teams to deliver scalable, secure, and cost-efficient data products that support global business objectives.
Key Responsibilities
• Design and implement automation strategies for onboarding new customers into the data platform, significantly improving operational efficiency and scalability.
• Lead the architecture and development of service APIs, enabling seamless platform integration and automation of external and internal processes.
• Champion and implement Data Mesh principles, fostering decentralized, scalable, and domain-oriented data solutions.
• Act as a Solutions Architect specialized in Data, DataOps, and API integration, ensuring robust, resilient, and future-proof architectures.
• Automate, provision, and manage large-scale AWS environments (8,000+ resources) using Terraform, CI/CD pipelines, Jenkins, and APIs.
• Own and evolve core data products, contributing to the organization’s long-term data platform strategy and transformation roadmap.
• Collaborate with international and cross-functional teams (Data Engineering, Platform, Product, Security) to align technical solutions with business priorities.
• Ensure high standards of performance, security, reliability, and cost optimization across cloud infrastructure.
• Drive CI/CD best practices across data and infrastructure layers.
• Deliver internal technical training and upskilling sessions, mentoring engineers and promoting engineering excellence.
• Act as a technical reference and hands-on Tech Lead, influencing architectural decisions and technology adoption.
Required Technical Skills
• Strong hands-on experience with Amazon Web Services (AWS) in large-scale production environments
• Advanced expertise in Infrastructure as Code (Terraform)
• Proven experience with Matillion for cloud-based data transformation
• Solid background in Data Engineering and DataOps practices
• Experience designing and consuming RESTful APIs
• Strong knowledge of CI/CD pipelines (e.g. Jenkins)
• Proficiency in Python for automation and integration
• Experience with Snowflake and modern cloud data warehouses
• Practical experience implementing or supporting Data Mesh architectures
• Strong understanding of automation, monitoring, and cloud cost optimization
Soft Skills & Leadership
• Proven ability to operate as Tech Lead / Senior Individual Contributor
• Strong communication skills for working with distributed, international teams
• Ability to translate business requirements into scalable technical solutions
• Proactive mindset with strong ownership and accountability
• Passion for automation, innovation, and engineering best practices
• Experience sharing knowledge through training, mentoring, and documentation
Nice to Have
• Experience in product-oriented data platforms
• Exposure to Agile / Scrum methodologies
• Prior participation in award-winning or large-scale transformation initiatives
• Background in platform engineering or internal developer platforms
🔍 Dekoder Ogłoszenia
🔴
design, build, and scale highly automated data platform solutions
Może oznaczać zarówno budowanie od podstaw, jak i pracę nad istniejącymi, potencjalnie problematycznymi systemami.
🔴
act as a technical leader and solutions architect
Oczekuje się, że będziesz podejmować decyzje architektoniczne i kierować technicznymi aspektami projektów, często bez formalnego zespołu podległego.
🔴
significantly improving operational efficiency and scalability
Może sugerować, że obecne procesy są nieefektywne i wymagają gruntownych zmian, co może być trudne.
🔴
Own and evolve core data products
Oznacza pełną odpowiedzialność za kluczowe produkty danych, w tym za ich utrzymanie i rozwój, co może wiązać się z rozwiązywaniem problemów i reagowaniem na awarie.
🟡
collaborate with international, cross-functional teams
Wymaga dobrej komunikacji i umiejętności pracy z różnymi kulturami i zespołami, co może być wyzwaniem.