19 oct
|
Agileengine
|
México
19 oct
Agileengine
México
About the Role
We are looking for a Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform, including its build, deployment, and monitoring infrastructure.
The mandatory requirements are 4+ years of hands-on production Kafka experience, strong Linux and Python scripting, CI/CD, Docker or Podman, infrastructure-as-code, and strong English communication skills.
What you will do
• Own the Kafka estate — topic design and naming standards, partitioning and keying strategy, replication, retention and compaction policy, consumer group and offset management, quotas, and broker configuration and upgrades.
• Ensure platform resilience and reliability — keep the integration platform available when the upstream vendor SaaS platform is degraded or unavailable, absorb traffic spikes without overloading it, and ensure events remain replayable and auditable through a correctly sized, configured and operated Kafka infrastructure.
• Engineer the platform's delivery guarantees in practice: at-least-once and exactly-once semantics,
idempotent producers, transactional writes where warranted, dead-letter topics, and self-service replay tooling for recovering from downstream failures.
• Build streaming observability: consumer lag, queue depth, throughput and rebalance monitoring; end-to-end correlation-ID tracing across topics; dashboards, service level objectives and alerting.
• Plan capacity, cost and retention for a durable log with regulatory audit retention requirements, and tune it as adoption scales across the firm.
• Evaluate and integrate vendor-native streaming and change-data-capture mechanisms as the platform's ingress and egress paths mature.
• Own and evolve the build and release pipeline — automated Jenkins pipelines producing packaged application installs for multiple enterprise Linux generations, signed container images, and generated documentation, promoted through internal artifact and image distribution service
📌 Infrastructure Engineer (México)
🏢 Agileengine
📍 México