Senior Data Engineer
⚲ Kraków, Warszawa, Poznań, Lublin, Szczecin
5 600 - 7 400 USD netto (B2B)
Wymagania
- Python
- Snowflake
- SQL
- Docker
- CI/CD
Opis stanowiska
ID71670
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
Why join us
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! :)
About the role
We are looking for a Senior Data Engineer to architect, build, and scale a modern data platform — designing production-grade ETL/ELT pipelines, optimizing Snowflake data warehouse schemas, and establishing robust DataOps practices. You will orchestrate workflows using Airflow, Prefect, or Dagster, implement data quality and lineage frameworks, integrate third-party REST APIs and event-driven sources, and apply software engineering standards including CI/CD, Docker, and automated testing to data repositories. The role prioritizes clean, well-tested Python code and a deep commitment to data reliability and accessibility.
What you will do
• Design, build, and maintain reliable, scalable ETL/ELT workflows that process batch and streaming data from diverse sources;
• Design production-ready normalized and denormalized schemas in Snowflake to optimize query performance and support enterprise analytics;
• Connect and ingest data from third-party REST APIs, event-driven streams, and batch sources into core data storage platforms;
• Maintain and expand workflow orchestration pipelines using Airflow, Prefect, or Dagster;
• Implement automated data testing, validation, lineage tracking, and proactive alerting frameworks to ensure data accuracy and system uptime;
• Drive CI/CD best practices, maintain codebases using Git and Docker, and adopt Infrastructure-as-Code patterns;
• Apply modern software engineering standards, including design patterns, automated unit and integration testing, and clear documentation.
Must haves
•
4+ years of experience as a Data Engineer;
• Strong proficiency in Python, including modular, maintainable, and well-tested code;
• Advanced knowledge of SQL, query optimization, database design principles, and normalization/denormalization patterns;
• Hands-on experience with Snowflake;
• Production experience with workflow orchestration tools such as Apache Airflow, Prefect, or Dagster;
• Experience working with REST APIs, event-driven architectures, and batch and streaming pipelines;
• Experience implementing automated data quality checks, data lineage, and alerting mechanisms;
• Strong experience with Git, Docker, CI/CD automation, and Infrastructure-as-Code fundamentals;
• Upper-intermediate English level.
Nice to haves
• Experience with dbt for data transformations;
• Familiarity with major cloud platforms such as AWS, GCP, or Azure;
• Experience with message streaming technologies such as Apache Kafka or AWS Kinesis.
The benefits of joining us
•
Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
•
Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
•
A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
•
Flextime
Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
Meet Our Recruitment Process
Asynchronous stage – An automated, self-paced track that helps us move faster and give you quicker feedback:• Short online form to confirm basic requirements
• 30–60 minute skills assessment via Codility – a platform founded in Poland that helps us provide quicker feedback and streamline this stage of the process.
• 5-minute introduction video
Synchronous stage – Live interviews
• Technical interview with our engineering team (scheduled at your convenience)
• Final interview with your future teammates
If it’s a match — you’ll get an offer!
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.
Why join us
If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you! :)
About the role
We are looking for a Senior Data Engineer to architect, build, and scale a modern data platform — designing production-grade ETL/ELT pipelines, optimizing Snowflake data warehouse schemas, and establishing robust DataOps practices. You will orchestrate workflows using Airflow, Prefect, or Dagster, implement data quality and lineage frameworks, integrate third-party REST APIs and event-driven sources, and apply software engineering standards including CI/CD, Docker, and automated testing to data repositories. The role prioritizes clean, well-tested Python code and a deep commitment to data reliability and accessibility.
What you will do
• Design, build, and maintain reliable, scalable ETL/ELT workflows that process batch and streaming data from diverse sources;
• Design production-ready normalized and denormalized schemas in Snowflake to optimize query performance and support enterprise analytics;
• Connect and ingest data from third-party REST APIs, event-driven streams, and batch sources into core data storage platforms;
• Maintain and expand workflow orchestration pipelines using Airflow, Prefect, or Dagster;
• Implement automated data testing, validation, lineage tracking, and proactive alerting frameworks to ensure data accuracy and system uptime;
• Drive CI/CD best practices, maintain codebases using Git and Docker, and adopt Infrastructure-as-Code patterns;
• Apply modern software engineering standards, including design patterns, automated unit and integration testing, and clear documentation.
Must haves
•
4+ years of experience as a Data Engineer;
• Strong proficiency in Python, including modular, maintainable, and well-tested code;
• Advanced knowledge of SQL, query optimization, database design principles, and normalization/denormalization patterns;
• Hands-on experience with Snowflake;
• Production experience with workflow orchestration tools such as Apache Airflow, Prefect, or Dagster;
• Experience working with REST APIs, event-driven architectures, and batch and streaming pipelines;
• Experience implementing automated data quality checks, data lineage, and alerting mechanisms;
• Strong experience with Git, Docker, CI/CD automation, and Infrastructure-as-Code fundamentals;
• Upper-intermediate English level.
Nice to haves
• Experience with dbt for data transformations;
• Familiarity with major cloud platforms such as AWS, GCP, or Azure;
• Experience with message streaming technologies such as Apache Kafka or AWS Kinesis.
The benefits of joining us
•
Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
•
Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
•
A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
•
Flextime
Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
Meet Our Recruitment Process
Asynchronous stage – An automated, self-paced track that helps us move faster and give you quicker feedback:• Short online form to confirm basic requirements
• 30–60 minute skills assessment via Codility – a platform founded in Poland that helps us provide quicker feedback and streamline this stage of the process.
• 5-minute introduction video
Synchronous stage – Live interviews
• Technical interview with our engineering team (scheduled at your convenience)
• Final interview with your future teammates
If it’s a match — you’ll get an offer!
🔍 Dekoder Ogłoszenia
🔴
architect, build, and scale a modern data platform
Oznacza to, że będziesz odpowiedzialny za stworzenie i rozwój platformy od podstaw, co może wiązać się z dużą niepewnością i koniecznością podejmowania kluczowych decyzji architektonicznych.
🟡
production-grade ETL/ELT pipelines
Wymaga to nie tylko umiejętności tworzenia pipeline'ów, ale także zapewnienia ich stabilności, wydajności i skalowalności w środowisku produkcyjnym.
🔴
establish robust DataOps practices
Może oznaczać konieczność wdrożenia nowych procesów i narzędzi DataOps od zera, co wymagać będzie proaktywności i umiejętności przekonywania.
🟡
orchestrate workflows using Airflow, Prefect, or Dagster
Wymaga biegłości w co najmniej jednym z tych narzędzi, a potencjalnie także umiejętności porównania i wyboru najlepszego rozwiązania dla projektu.
🟢
apply software engineering standards including CI/CD, Docker, and automated testing to data repositories
Oznacza to, że praca z danymi będzie traktowana jak rozwój oprogramowania, co wymagać będzie dyscypliny i stosowania najlepszych praktyk inżynierskich.