Senior Python Data Platform Engineer
Alfragide
Job description
About the Role
We are seeking a Senior Python Data Platform Engineer to join our integration engineering team powering our core Data Platform Service. Built on a tightly integrated modern stack consisting of AWS, Confluent Cloud, Kubernetes, and Snowflake, this platform serves as an operational data mesh. It delivers source- and consumer-aligned data products exposed via event streams, serverless REST APIs, and high-performance data stores to drive mission-critical, real-time transactional and operational workloads.
In addition to hands-on software development, you will serve as a technical pillar within the team—guiding technical standards, conducting rigorous code reviews, and acting as the primary backup to the lead developer.
What You Will Do
Microservices Development (Python & Kafka): Build, optimize, and maintain Python-based containerized event-processing services deployed as headless AWS ECS Fargate tasks consuming from Kafka.
Serverless API Engineering: Design, implement, and maintain scalable AWS Lambda functions exposing clean REST APIs for data product consumption, implementing robust API versioning and alias routing strategies.
Real-Time Data Integration: Connect high-throughput event pipelines using Confluent Cloud (Kafka) to feed operational data stores and analytical engines like Snowflake.
Architecture Backup & Code Quality: Partner closely with the lead developer as their primary backup, contributing to architectural decisions and enforcing high standards through active code reviews.
CI/CD & DevOps Standards: Maintain reliable deployment pipelines using advanced Git workflows, automated testing, and continuous integration practices.
Mandatory Requirements
Senior-Level Python Engineering:
Mastery of advanced object-oriented Python, classes, and metaprogramming.
Deep experience with data classes, type validation, and algorithmic design patterns.
Proven track record building REST APIs, AWS Lambda handlers, transformation services, and automation scripts.
Advanced Version Control & Delivery:
Strong expertise with Git workflows, merge requests, conventional commits, and CI/CD pipelines.
Data Platform & Database Foundations:
Solid practical experience with database operations (both relational and non-relational), database design, and advanced SQL.
Extensive experience handling semi-structured data structures (JSON, XML).
Preferred & Complementary Skills
Cloud Infrastructure (AWS): Working experience with core AWS services, including EC2, S3, RDS, VPC, IAM, and CloudWatch.
Streaming & Event-Driven Systems: Familiarity with Confluent Cloud / Apache Kafka concepts (topics, partition handling, producer/consumer design).
Containers & Serverless Orchestration: Hands-on exposure to AWS ECS / Fargate container orchestration, AWS Lambda runtime configuration, or Kubernetes.
Modern Data Stack: Familiarity with Snowflake or distributed data mesh principles is a plus.


