Technology Engineer - Redis & Kafka

We are seeking an experienced Technology Engineer with strong expertise in Redis, Kafka, and cloud-native platform engineering to join our Technology Engineering team. The ideal candidate will be responsible for designing, implementing, administering, and optimizing enterprise Redis and Kafka platforms supporting high-performance, real-time, mission-critical applications.

The role requires strong experience in distributed systems, platform engineering, automation, DevOps, cloud technologies, CI/CD, and production support. The successful candidate will work closely with development, infrastructure, security, and operations teams to ensure platform scalability, resilience, performance, and security.

Requirements

Key Responsibilities

• Design, implement, configure, and manage Enterprise Redis and Open Source Redis clusters.
• Deploy, administer, and optimize Apache Kafka clusters for high-throughput, real-time streaming environments.
• Ensure high availability, scalability, resilience, disaster recovery, and security of Redis and Kafka platforms.
• Perform Redis and Kafka performance tuning, capacity planning, health monitoring, and optimization.
• Troubleshoot complex production issues across distributed platform environments.
• Manage platform upgrades, patching, configuration management, and lifecycle maintenance.
• Build and maintain CI/CD pipelines using Git, Jenkins, ArgoCD, and GitOps methodologies.
• Automate infrastructure provisioning and deployment using modern cloud automation tools.
• Support cloud-native platform deployments across AWS, Azure, OCI, and OpenShift environments.
• Collaborate with development teams to support caching, messaging, streaming, and distributed application requirements.
• Implement monitoring, alerting, logging, and operational best practices for production environments.
• Drive platform governance, engineering standards, security compliance, and operational excellence.
• Work closely with Infrastructure, DevOps, Security, Architecture, and Application Engineering teams.
• Support Agile delivery methodologies and participate in sprint planning, backlog refinement, and technical discussions.
• Research, evaluate, and benchmark new platform technologies and engineering best practices.
• Ensure platform compliance with organizational security, regulatory, encryption, anonymization, and data integrity standards.

Required Technical Skills

Redis

• Strong hands-on experience with Enterprise Redis and Open Source Redis.
• Redis Cluster design, deployment, administration, and management.
• Redis performance tuning and optimization.
• High Availability (HA), replication, clustering, backup, and disaster recovery.
• Redis security and production support.

Apache Kafka

• Kafka installation, setup, configuration, and administration.
• High-throughput messaging platforms.
• Kafka cluster management.
• Kafka monitoring and troubleshooting.
• Event-driven architecture implementation.

DevOps & Platform Engineering

• OpenShift.
• Jenkins.
• ArgoCD.
• Git.
• GitOps.
• CI/CD pipeline implementation.
• Infrastructure automation.
• Production platform support.

Cloud Technologies

Experience working with one or more public cloud platforms:

• AWS
• Microsoft Azure
• Oracle Cloud Infrastructure (OCI)

Distributed Systems

Strong understanding of:

• Distributed systems architecture
• Distributed services resiliency
• Network fundamentals
• Host-level routing
• Streaming platforms
• Distributed caching
• Performance tuning
• Large-scale platform operations

Streaming Technologies

Experience with:

• Kafka
• Streaming datasets at scale

Good to have:

• Kafka Streams
• Apache Flink
• Apache Beam
• Apache Spark
• Similar streaming technologies

Software Engineering

• Design patterns
• Automated unit testing
• Integration testing
• Production troubleshooting
• Platform monitoring
• Cloud-native application architecture

Security & Compliance

Strong understanding of:

• Security engineering practices
• Infrastructure security
• Encryption
• Data anonymization
• Data integrity
• Regulatory compliance
• Secure logging practices
• PII handling
• Memory data protection
• Vulnerability management

Functional Skills

• Experience working in Agile/Scrum environments.
• Strong analytical and problem-solving skills.
• Experience designing enterprise platform architectures.
• Technology research and benchmarking.
• Ability to influence engineering decisions across multiple teams.
• Strong ownership mindset with minimal supervision.
• Excellent troubleshooting and production support capabilities.

Soft Skills

• Excellent verbal and written communication skills.
• Strong stakeholder management and collaboration skills.
• Strategic thinking with an innovation and R&D mindset.
• Self-motivated and proactive approach to problem-solving.
• Ability to work effectively in cross-functional and geographically distributed teams.
• Strong presentation and interpersonal skills.

Nice to Have

• Apache Flink
• Apache Beam
• Kafka Streams
• Apache Spark
• Event-driven microservices
• Cloud-native architectures
• Infrastructure as Code (IaC)
• Kubernetes
• Container orchestration
• Large-scale financial services or enterprise platform experience

Preferred Experience

• Enterprise Platform Engineering
• Technology Platforms
• Data Platforms
• Real-Time Streaming Platforms
• Cloud Infrastructure
• High-Availability Distributed Systems
• Banking or Financial Services domain (preferred)