We are looking for a highly skilled Technical Lead Engineer with deep expertise in AWS cloud-native architecture and event-driven data platform engineering. This role leads the design and delivery of a complex AWS modernization program, migrating a legacy event pipeline to a modern architecture built on Amazon DynamoDB Streams, Amazon MSK (Kafka), and Amazon EKS.
The Technical
Lead will own end-to-end technical delivery — from architecture and pipeline design through integration testing, CI/CD setup, and documentation handoff.
Key Responsibilities
- Architecture & Design: Drive end-to-end technical design and hands-on delivery of event-driven data pipelines on AWS; define service boundaries, integration patterns, and technical approach in close collaboration with the engineering team.
- Event Pipeline Engineering: Build and configure Amazon DynamoDB Streams producers and AWS Lambda connector functions; implement Amazon MSK (Kafka) entity linkages and own topic schema validation.
- Backfill Pipeline Engineering: Build and lead execution of S3 and Lambda-orchestrated backfill pipelines; define per-stage validation criteria and rollback strategies.
- Integration Testing: Own end-to-end integration testing to validate data fidelity across distributed pipeline components; define acceptance criteria and sign off on fidelity targets.
- Container Migration: Lead migration of services from AWS Lambda to Amazon EKS; build and maintain CircleCI and ArgoCD CI/CD pipelines for containerised deployments.
- Technical Leadership: Contribute to and review all engineering deliverables; define Definition of Done criteria per phase; champion code quality, test coverage, and security standards across the team.
- Documentation & Handoff: Produce deployment runbooks, pipeline documentation, architecture diagrams, and AWS Well-Architected alignment summaries.
- Stakeholder Coordination: Coordinate cross-team technical dependencies; liaise with client engineering and AWS platform teams; escalate blockers promptly.
Technical Requirements (Must Have)
- Strong hands-on experience on TypeScript
- Strong hands-on experience on Python
- Strong hands-on experience on Dynamo DB streaming and AWS Lamda
- Strong hands-on experience on ArgoCD / Helm
- Experience with any CI/CD pipeline tooling (preferably CircleCI, , Jenkins, or GitHub Actions) · Infrastructure as Code
- Experience with Observability tools like New Relic
Good to Have
- Experience on GoLang
- Experience on Kafka, Amazon SNS , Amazon SQS
- Hands-on experience with Kafka schema registry and topic governance.
- Familiar with AWS architecture best practices
- New Relic or Splunk for EKS service observability.
Education & Experience
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 6+ years of backend or cloud engineering experience.
- 3+ years in a technical lead or senior engineer role with end-to-end delivery ownership.
- Strong written communication — architecture documents and stakeholder-ready reports.