Integration / Apache Kafka Interview questions
What is a consumer group in Kafka?
A consumer group is a set of consumers, identified by a shared group.id, that cooperatively read a topic by splitting its partitions among themselves — each partition is consumed by exactly one member of the group at a time, so the group as a whole processes the topic in parallel, but no two consumers in the same group ever read the same partition simultaneously.
group.id=order-processors
This is the mechanism behind Kafka's horizontal consumer scaling: adding more consumers to a group (up to the number of partitions) increases parallel throughput, while different, independently-named consumer groups can each read the exact same topic from their own separate offsets without affecting each other — which is how one topic can simultaneously feed, say, a fraud-detection service and an analytics pipeline, each processing at their own pace.
More Related questions...
