This repository was archived by the owner on Dec 7, 2018. It is now read-only.
This repository was archived by the owner on Dec 7, 2018. It is now read-only.
Question > How Kafka partitions are managed by Axon #86
Description
Currently it seems there is no documentation on how Kafka partitions are managed Axon.
Example of questions:
- what is the strategy to assign an event to a Kafka partition inside a topic (producer side)? How to override this? Is it advised to override this?
- Where does Axon store the offset for a given partition? Does it uses Kafka in order to store the offsets or does it store it internally?
- How are Kafka partitions related to Axon segments?
- Is it possible to have a dynamic number of segments? I would like the number of segments to be automatically aligned with the number of partitions.
- How is this related to the SequencingPolicy? Is the result of the SequencingPolicy used in order to assign a message to a partition?
- How are segments assigned to node? It is written in the documentation that nodes compete for segments. Are the segments automatically rebalanced when new node join the group?
- How to increase the number of segments after it has been defined? (create new tracking event processor with a different initialSegmentCount?)
Could you please provide some insight on this? Would be nice to have a paragraph in the documentation explaining the general integration of Axon with Kafka.