Kafka Engineer - Mumbai

Job Summary:

We are seeking a skilled and motivated Kafka Engineer to design, implement, and maintain robust event-driven data pipelines and real-time streaming applications. The ideal candidate will have a deep understanding of Apache Kafka, data streaming architectures, and distributed systems, and will play a critical role in ensuring the high availability, performance, and scalability of our data infrastructure.

Key Responsibilities:

• Design, develop, and manage Kafka-based data streaming solutions.

• Set up, configure, and maintain Kafka clusters, brokers, topics, and schemas.

• Monitor, optimize, and ensure the availability and performance of Kafka services.

• Implement Kafka Connect, Kafka Streams, and Schema Registry as needed.

• Develop producers and consumers for real-time data ingestion and processing.

• Collaborate with DevOps, Data Engineering, and Backend teams to integrate Kafka with other systems (e.g., Spark, Flink, MongoDB, PostgreSQL).

• Automate deployment, scaling, and recovery of Kafka components.

• Implement monitoring and alerting tools (e.g., Prometheus, Grafana, Splunk).

• Ensure data security, compliance, and governance across Kafka pipelines.

• Participate in on-call rotations and provide support for production systems.

Required Skills & Qualifications:

• 2+ years of hands-on experience with Apache Kafka in production environments.

• Strong programming skills in Java, Scala, or Python.

• Experience with Kafka Connect, Kafka Streams, and Kafka REST Proxy.

• Solid understanding of distributed systems, messaging systems, and real-time data processing.

• Familiarity with Docker, Kubernetes, and CI/CD pipelines.

• Experience with monitoring tools like Confluent Control Center, Prometheus, Grafana, or Datadog.

• Proficiency with Linux/Unix systems and scripting.