Kafka List all partition with no leader
up vote
0
down vote
favorite
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
asked Nov 22 at 15:21
Hackaholic
12.1k12440
add a comment |
up vote
0
down vote
favorite
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
asked Nov 22 at 15:21
Hackaholic
12.1k12440
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
asked Nov 22 at 15:21
Hackaholic
12.1k12440
In my kafka Cluster there are more than 2k topics and each topic has 5 partitions. I want list only that partitions which has no leader.
I can go can check for each topic using the below syntax:
kafka-topics.sh --describe --topic <topic_name> --zookeeper <zookeeper_ip>:port
But the problem is there are 2k+ topics, can't be done manually. I can also write a script to loop over each topic and get the partition with no leader. But i am interested in some efficient way to get the information.
apache-kafka apache-zookeeper
apache-kafka apache-zookeeper
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
asked Nov 22 at 15:21
Hackaholic
12.1k12440
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
asked Nov 22 at 15:21
Hackaholic
12.1k12440
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
edited Nov 22 at 20:29
Anony-Mousse
56.8k796159
56.8k796159
asked Nov 22 at 15:21
Hackaholic
12.1k12440
asked Nov 22 at 15:21
Hackaholic
12.1k12440
asked Nov 22 at 15:21
Hackaholic
12.1k12440
12.1k12440
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
up vote
2
down vote
accepted
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 at 15:38
Mickael Maison
6,73032529
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 at 16:08
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
2
down vote
accepted
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 at 15:38
Mickael Maison
6,73032529
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 at 16:08
add a comment |
up vote
2
down vote
accepted
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 at 15:38
Mickael Maison
6,73032529
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 at 16:08
add a comment |
up vote
2
down vote
accepted
up vote
2
down vote
accepted
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 at 15:38
Mickael Maison
6,73032529
Using kafka-topics.sh you can specify the --unavailable-partitions flag to only list partitions that currently don't have a leader and hence cannot be used by Consumers or Producers.
For example:
kafka-topics.sh --describe --unavailable-partitions --zookeeper <zookeeper_ip>:port
answered Nov 22 at 15:38
Mickael Maison
6,73032529
answered Nov 22 at 15:38
Mickael Maison
6,73032529
answered Nov 22 at 15:38
Mickael Maison
6,73032529
answered Nov 22 at 15:38
Mickael Maison
6,73032529
6,73032529
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 at 16:08
add a comment |
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have--unavailable-partitionsit lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).
– Carr0t
Nov 22 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 at 16:08
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 at 15:43
Ah thanks for the answer. I have seen that options in topics.sh but was not aware that i can do my job, thanks once agin for pointing it out.
– Hackaholic
Nov 22 at 15:43
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 at 15:50
I tried the above, but it listing everything one with no leader and also which has leader
– Hackaholic
Nov 22 at 15:50
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have
--unavailable-partitions it lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).– Carr0t
Nov 22 at 16:00
What's your Kafka version? We're running on 2.0.0 and the above command works correctly for us, i.e. when we don't have
--unavailable-partitions it lists every partition on the cluster, when we do have it it outputs nothing (as all our partitions are healthy).– Carr0t
Nov 22 at 16:00
kafka version is 1.1
– Hackaholic
Nov 22 at 16:08
kafka version is 1.1
– Hackaholic
Nov 22 at 16:08
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53434014%2fkafka-list-all-partition-with-no-leader%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
