| Job Description |
Key Responsibilities:
Design and develop event streaming solutions using Apache Kafka and Confluent Kafka. Build producers, consumers, and Kafka Streams applications using Java, Python, or Scala. Create and manage Kafka topics, schemas (Avro/Protobuf/JSON), and partitions for performance and scalability. Implement Kafka Connect to integrate with data sources (e.g., databases, S3, etc.). Use Confluent Schema Registry to enforce data serialization standards. Manage Kafka infrastructure (Confluent Cloud or On-prem), ensuring high availability and failover. Monitor and optimize Kafka performance, troubleshoot lag, throughput issues, and errors. Work with DevOps teams to automate deployments using CI/CD tools. Document solutions, best practices, and integration patterns. Collaborate with backend engineers, data engineers, and architects to deliver reliable streaming systems.
|
