Data Engineer
⚲ Remote
27 552 - 31 920 PLN (B2B)
Wymagania
- AWS
- Data engineering
- Databricks
- ETL
- Python
- SQL
- CI/CD
- IaC
- Data science (nice to have)
- AI (nice to have)
Opis stanowiska
O projekcie:
🔹 For our Client from pharmaceutical industry we are looking for Senior Data Engineer🔹
We are seeking a hands-on Senior Data Engineer with experience building, maintaining, and migrating data pipelines, as well as AWS Cloud to support our data platforms. Our organization has recently decommissioned multiple data sources, created new data sources and data lakes, and we now need expert assistance to ensure the new architecture is correctly built, integrated, and operational.
You will help us connect to Databricks, implement and maintain AWS-based data pipelines, and execute data migration and integration activities to ensure reliable ingestion, processing, and availability of data for downstream use cases.
Wymagania:
- Strong experience in building and maintaining ETL/data pipelines using Databricks, Python, SQL, and AWS.- Hands-on experience with data migration, cloud-based data processing, and pipeline monitoring.- Good knowledge of CI/CD, Infrastructure as Code (CDK), and AWS security concepts, including IAM.- Understanding of data quality, reliability, and observability best practices.- Ability to work independently, collaborate with cross-functional teams, and contribute to technical documentation.
✔️Optional Qualifications:
- Prior experience in regulated environments (e.g., healthcare/pharma) is a plus- Data science and insights generation is a plus- Experience with AI and agentic coding is a plus
Codzienne zadania:
- Lead the design, development, and maintenance of data pipelines (ingestion, transformation orchestration, monitoring)
- Re-write ETL flows using Databricks
- Integrate and configure connectivity to Databricks for data processing and/or pipeline execution
- Support data migration from decommissioned sources to new data sources/data lakes
- Strong scripting/programming skills (Python, SQL)
- Build and optimize AWS cloud infrastructure related to data ingestion and processing
- Ensure data quality, reliability, and observability (logging/monitoring, error handling, retries)
- Experience with CI/CD and infrastructure-as-code (CDK)
- Implement and manage networking/access patterns for secure data movement (e.g., IAM roles, policies, least privilege)
- Collaborate with engineering and stakeholders to validate end-to-end data flows and delivery timelines
- Contribute to documentation and knowledge transfer
- Working independently
🔹 For our Client from pharmaceutical industry we are looking for Senior Data Engineer🔹
We are seeking a hands-on Senior Data Engineer with experience building, maintaining, and migrating data pipelines, as well as AWS Cloud to support our data platforms. Our organization has recently decommissioned multiple data sources, created new data sources and data lakes, and we now need expert assistance to ensure the new architecture is correctly built, integrated, and operational.
You will help us connect to Databricks, implement and maintain AWS-based data pipelines, and execute data migration and integration activities to ensure reliable ingestion, processing, and availability of data for downstream use cases.
Wymagania:
- Strong experience in building and maintaining ETL/data pipelines using Databricks, Python, SQL, and AWS.- Hands-on experience with data migration, cloud-based data processing, and pipeline monitoring.- Good knowledge of CI/CD, Infrastructure as Code (CDK), and AWS security concepts, including IAM.- Understanding of data quality, reliability, and observability best practices.- Ability to work independently, collaborate with cross-functional teams, and contribute to technical documentation.
✔️Optional Qualifications:
- Prior experience in regulated environments (e.g., healthcare/pharma) is a plus- Data science and insights generation is a plus- Experience with AI and agentic coding is a plus
Codzienne zadania:
- Lead the design, development, and maintenance of data pipelines (ingestion, transformation orchestration, monitoring)
- Re-write ETL flows using Databricks
- Integrate and configure connectivity to Databricks for data processing and/or pipeline execution
- Support data migration from decommissioned sources to new data sources/data lakes
- Strong scripting/programming skills (Python, SQL)
- Build and optimize AWS cloud infrastructure related to data ingestion and processing
- Ensure data quality, reliability, and observability (logging/monitoring, error handling, retries)
- Experience with CI/CD and infrastructure-as-code (CDK)
- Implement and manage networking/access patterns for secure data movement (e.g., IAM roles, policies, least privilege)
- Collaborate with engineering and stakeholders to validate end-to-end data flows and delivery timelines
- Contribute to documentation and knowledge transfer
- Working independently
🔍 Dekoder Ogłoszenia
🔴
hands-on Senior Data Engineer
Oczekuje się, że będziesz aktywnie kodować i rozwiązywać problemy, a nie tylko zarządzać zespołem.
🔴
ensure the new architecture is correctly built, integrated, and operational
Prawdopodobnie będziesz musiał naprawiać błędy i problemy po poprzednich wdrożeniach.
🔴
Ability to work independently
Może oznaczać brak wsparcia lub jasnych wytycznych, co wymaga samodzielności w rozwiązywaniu problemów.
🔴
contribute to technical documentation
Może oznaczać, że dokumentacja jest słaba lub nie istnieje, a Ty będziesz musiał ją tworzyć od podstaw.
🔴
Prior experience in regulated environments (e.g., healthcare/pharma) is a plus
Chociaż jest to 'plus', może oznaczać, że jest to nieformalny wymóg, a brak takiego doświadczenia może Cię dyskwalifikować.