We are looking for a highly skilled Technical Lead Engineer with deep expertise in AWS cloud-native architecture and event-driven data platform engineering. This role leads the design and delivery of a complex AWS modernization program, migrating a legacy event pipeline to a modern architecture built on Amazon DynamoDB Streams, Amazon MSK (Kafka), and Amazon EKS. The Technical Lead will own end-to-end technical delivery — from architecture and pipeline design through integration testing, CI/CD setup, and documentation handoff.
Key Responsibilities
·
Architecture & Design:
Drive end-to-end technical design and hands-on delivery of event-driven data pipelines on AWS; define service boundaries, integration patterns, and technical approach in close collaboration with the engineering team.
·
Event Pipeline Engineering:
Build and configure Amazon DynamoDB Streams producers and AWS Lambda connector functions; implement Amazon MSK (Kafka) entity linkages and own topic schema validation.
·
Backfill Pipeline Engineering:
Build and lead execution of S3 and Lambda-orchestrated backfill pipelines; define per-stage validation criteria and rollback strategies.
·
Integration Testing:
Own end-to-end integration testing to validate data fidelity across distributed pipeline components; define acceptance criteria and sign off on fidelity targets.
·
Container Migration:
Lead migration of services from AWS Lambda to Amazon EKS; build and maintain CircleCI and ArgoCD CI/CD pipelines for containerised deployments.
·
Technical Leadership:
Contribute to and review all engineering deliverables; define Definition of Done criteria per phase; champion code quality, test coverage, and security standards across the team.
·
Documentation & Handoff:
Produce deployment runbooks, pipeline documentation, architecture diagrams, and AWS Well-Architected alignment summaries.