Kafka Developer

Key Responsibilities

• Design, develop, and maintain real-time data streaming solutions using Apache Kafka.
• Develop Kafka producers, consumers, and streaming applications to support business requirements.
• Configure and manage Kafka topics, partitions, replication, and consumer groups.
• Build scalable and fault-tolerant event-driven architectures.
• Integrate Kafka with databases, microservices, and third-party applications.
• Monitor Kafka clusters, optimize performance, and troubleshoot production issues.
• Collaborate with development, DevOps, and data engineering teams to ensure reliable data pipelines.
• Implement security, high availability, and disaster recovery best practices for Kafka environments.
• Prepare technical documentation and support production deployments.

Required Skills

• 5+ years of experience in software development with Apache Kafka.
• Strong hands-on experience with Apache Kafka, Kafka Streams, and Kafka Connect.
• Proficiency in Java, Spring Boot, and Microservices architecture.
• Experience with messaging systems, event-driven architecture, and asynchronous communication.
• Strong knowledge of Kafka cluster administration, topic configuration, partitioning, replication, and performance tuning.
• Experience with REST APIs, JSON, and Avro serialization.
• Familiarity with Docker, Kubernetes, and CI/CD pipelines.
• Good understanding of SQL/NoSQL databases such as PostgreSQL, Oracle, MongoDB, or Cassandra.
• Experience with monitoring tools such as Prometheus, Grafana, ELK Stack, or Splunk.
• Strong troubleshooting, analytical, and communication skills.

Preferred Skills

• Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP).
• Knowledge of Apache Spark, Flink, or other stream-processing frameworks.
• Familiarity with Schema Registry, Confluent Platform, and Kafka security (SSL, SASL, ACLs).
• Experience working in Agile/Scrum environments.
• Relevant Kafka or cloud certifications are an added advantage.