Tech Lead Data Engineering

• Design and build streaming data products using Apache Flink, Apache Kafka and event-driven architecture.
  
• Develop ingestion, processing, transformation and delivery pipelines for real-time and batch workloads.
  
• Build REST, OpenAPI and streaming interfaces, as well as microservices for data consumers.
  
• Use AWS services such as MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS, EKS, S3 and IAM.
  
• Define data quality controls, schema management, validation processes and automated tests.
  
• Implement CI/CD pipelines with GitLab CI, GitHub Actions or equivalent tools.
  
• Set up monitoring, logging, metrics and tracing with tools such as CloudWatch, Prometheus, Grafana and OpenTelemetry.
  
• Support production services, incident resolution, performance improvements and root-cause analysis.
  
• Apply security practices covering authentication, authorisation, encryption, secrets management and access control.
  
• Lead technical designs, code reviews, architecture discussions, documentation and knowledge sharing.
  

Requirements

• 10+ years of experience in software engineering, data engineering or a related technical field.
  
• Proven experience delivering real-time data products in production.
  
• Strong hands-on experience with Apache Flink and Apache Kafka.
  
• Experience with streaming pipelines, event-driven systems, APIs, microservices and distributed systems.
  
• Production experience with AWS data and application services.
  
• Experience with data quality, schema governance, automated testing and CI/CD.
  
• Knowledge of observability, cloud security and production support.
  
• Experience leading technical discussions, reviewing code and mentoring engineers.
  
• Bilingual English proficiency for work with international technical and business teams.