Submit

Tech Lead Data Engineering

Porto

Job description

The role is for a senior Tech Lead in real-time data engineering, with 10+ years of experience.

The profile must have strong hands-on experience with Apache Flink, Apache Kafka, AWS, APIs, microservices and event-driven architecture. The role covers the full lifecycle of real-time data products, from ingestion and processing to API delivery and production support.

The Tech Lead will also guide architecture decisions, technical reviews, engineering standards, mentoring, data quality, security, testing, observability and CI/CD.

Goals and deliverables

Design and build streaming data products using Apache Flink, Apache Kafka and event-driven architecture.
Develop ingestion, processing, transformation and delivery pipelines for real-time and batch workloads.
Build REST, OpenAPI and streaming interfaces, as well as microservices for data consumers.
Use AWS services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS, EKS, S3 and IAM.
Define data quality controls, schema management, validation processes and automated tests.
Implement CI/CD pipelines with GitLab CI, GitHub Actions or equivalent tools.
Set up monitoring, logging, metrics and tracing with tools such as CloudWatch, Prometheus, Grafana and OpenTelemetry.
Support production services, incident resolution, performance improvements and root-cause analysis.
Apply security practices covering authentication, authorisation, encryption, secrets management and access control.
Lead technical designs, code reviews, architecture discussions, documentation and knowledge sharing.

Requirements

10+ years of experience in software engineering, data engineering or a related technical field.
Proven experience delivering real-time data products in production.
Strong hands-on experience with Apache Flink and Apache Kafka.
Experience with streaming pipelines, event-driven systems, APIs, microservices and distributed systems.
Production experience with AWS data and application services.
Experience with data quality, schema governance, automated testing and CI/CD.
Knowledge of observability, cloud security and production support.
Experience leading technical discussions, reviewing code and mentoring engineers.
Bilingual English proficiency for work with international technical and business teams.

Want to apply?

Position

Name*

Email*

Phone number*

Country*

City*

Faça upload do seu CV* (max. 4MB)

Upload your photo or video (max. 4MB)

By using this form you agree with the storage and handling of your data by Multivision in accordance with our Privacy Policy.

Inclusion in Multivision's database of candidates to be used, according to the analysis of the recruitment teams, for the purpose of current and future recruitment processes for any opportunity of Multivision and its Clients.

Sending communications about services, recruitment processes and other initiatives and marketing actions developed by Multivision, such as webinars, training, and events, among others.

Submit