Kafka Admin- Pan India

Job Summary:

We are looking for a skilled and proactive Kafka Administrator to manage, monitor, and optimize our Apache Kafka infrastructure. You will play a key role in ensuring high availability, performance, scalability, and security of Kafka clusters used across mission-critical applications.

Key Responsibilities:

• Install, configure, upgrade, and manage Apache Kafka clusters (including Confluent Platform, if applicable).

• Monitor Kafka health and performance using tools like Prometheus, Grafana, Confluent Control Center, or similar.

• Manage Kafka topics, partitions, ACLs, brokers, and zookeeper nodes.

• Troubleshoot Kafka-related issues in production and non-production environments.

• Perform regular capacity planning, tuning, and optimization of Kafka clusters.

• Ensure fault tolerance and disaster recovery strategies are in place and tested.

• Automate Kafka operations using scripting tools (e.g., Bash, Python) or Ansible/Terraform.

• Work closely with application developers and DevOps teams to support Kafka integrations and data pipelines.

• Implement Kafka security best practices including TLS encryption, authentication, and RBAC.

• Maintain clear documentation for Kafka infrastructure and processes.

Required Skills & Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or related field.

• Strong hands-on experience administering Apache Kafka (including Kafka Streams, Connect) in a production environment.

• Experience with Kafka monitoring, alerting, and performance tuning.

• Solid understanding of Linux operating systems, networking, and distributed systems.

• Familiarity with Kafka security mechanisms (SSL, SASL, Kerberos, RBAC).

• Proficiency in scripting languages (e.g., Bash, Python) for automation and tooling.

• Experience with Zookeeper management and maintenance.

• Familiar with CI/CD pipelines and infrastructure automation tools (e.g., Ansible, Terraform, Jenkins).

Preferred Qualifications:

• Experience with Confluent Kafka ecosystem and commercial support tools.

• Knowledge of cloud platforms like AWS, Azure, or GCP - especially using MSK (Managed Streaming for Kafka).

• Familiarity with schema registry, Kafka Connect, and Kafka REST Proxy.

• Certification in Kafka administration (e.g., Confluent Certified Administrator).

• Understanding of stream processing frameworks like Apache Flink, ksqlDB, or Apache Storm