Submit

Data Engineer AWS Glue

Amadora

Job description

The focus of the service is for collaboration in one of the many data engineering projects, namely designing, developing, and maintaining data pipelines and architectures that support our Data platforms.
You will work closely with cross-functional teams to ensure data is accessible, reliable, and efficiently processed to meet business needs.

Key Responsibilities for the service:
  • Design and develop scalable data pipelines using AWS Glue.
  • Implement and manage data storage solutions using Snowflake and other databases.
  • Develop and maintain ETL processes to ingest, transform, and load data from various sources.
  • Utilize Apache Airflow for workflow orchestration and scheduling.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Ensure data quality, integrity, and security across all data pipelines and storage solutions.
  • Monitor and optimize data pipeline performance and troubleshoot issues as they arise.

Requirements

  • Senior Level - Fluency in English, written and spoken, is mandatory.
  • Senior Level - At least 3 years of direct professional experience working with AWS data services, especially AWS Glue, S3, and Lambda. This is mandatory
  • Senior Level - Professional experience with Snowflake for data warehousing and analytics. This is mandatory.
  • Senior Level - Professional experience with Apache Airflow for workflow orchestration.
  • Senior Level - Professional experience in SQL and Python for data manipulation and analysis is mandatory.
  • Senior Level - Professional experience with Git for version control and CI/CD
  • Mid-Level - Experience with Terraform for infrastructure as code.
  • Junior Level - Knowledge of Neo4j and Cypher is a plus


Want to apply?
Position
Name*
Email*
Phone number*
Country*
City*
Linkedin
Faça upload do seu CV* (max. 4MB)
Upload your photo or video (max. 4MB)
Submit