All the consumers get stuck for a broker after enabled transaction

Open

#14,889 opened on Mar 26, 2022 6 comments 0 reactions 0 assignees View on GitHub

area/transaction lifecycle/stale Stale type/bug

Dominant language: Java
Stars: 15.3k
Forks: 3.8k
Avg merge: 1d 14h
Merged PRs (30d): 160

Description

**Describe the bug**
The pulsar cluster has 3 brokers and 3 bookies, and the broker enables the transaction.
When I use a program to publish and consume messages with transactions on a partitioned topic with 10 partitions

The consumer stats show only 3 partitions work well for consumption, after unloading the topic, the message consumption recovered

```
17:18:22.639 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-2] [sub] [07360] Prefetched messages: 0 --- Consume throughput received: 4.87 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 4.87 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.652 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-6] [sub] [07360] Prefetched messages: 0 --- Consume throughput received: 5.53 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.67 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.677 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-8] [sub] [07360] Prefetched messages: 0 --- Consume throughput received: 4.77 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 4.83 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.726 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-2] [sub] [0767a] Prefetched messages: 0 --- Consume throughput received: 4.60 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 4.67 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.752 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-6] [sub] [0767a] Prefetched messages: 0 --- Consume throughput received: 5.37 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.37 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.772 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-8] [sub] [0767a] Prefetched messages: 0 --- Consume throughput received: 4.87 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.33 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.813 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-2] [sub] [309f0] Prefetched messages: 0 --- Consume throughput received: 4.60 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 4.60 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.821 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-6] [sub] [309f0] Prefetched messages: 0 --- Consume throughput received: 4.60 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 4.60 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.874 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-8] [sub] [309f0] Prefetched messages: 0 --- Consume throughput received: 5.07 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.07 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.903 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-2] [sub] [7d455] Prefetched messages: 0 --- Consume throughput received: 5.03 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.03 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.909 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-6] [sub] [7d455] Prefetched messages: 0 --- Consume throughput received: 5.27 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.27 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.912 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-8] [sub] [7d455] Prefetched messages: 0 --- Consume throughput received: 4.93 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 4.93 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.945 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-2] [sub] [d54cd] Prefetched messages: 0 --- Consume throughput received: 4.87 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 4.87 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.957 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-6] [sub] [d54cd] Prefetched messages: 0 --- Consume throughput received: 5.13 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.13 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
17:18:22.969 [pulsar-timer-5-1:org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl@148] INFO org.apache.pulsar.client.impl.ConsumerStatsRecorderImpl - [persistent://public/default/s_topic-partition-8] [sub] [d54cd] Prefetched messages: 0 --- Consume throughput received: 5.07 msgs/s --- 0.00 Mbit/s --- Ack sent rate: 5.07 ack/s --- Failed messages: 0 --- batch messages: 0 ---Failed acks: 0
```

After checking the topic ownership

```
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-0 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6650"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-1 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6651"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-2 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6652"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-3 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6650"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-4 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6650"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-5 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6651"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-6 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6652"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-7 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6650"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-8 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6650"
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
~/Downloads/geo-cluster/cluster-a (branch-0.8.1*) » bin/pulsar-admin topics lookup s_topic-partition-9 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
"pulsar://127.0.0.1:6651"
```

You can see partition 2,6,8 is owned by `pulsar://127.0.0.1:6652`. Other partitions are distributed to `pulsar://127.0.0.1:6650` and `pulsar://127.0.0.1:6651`, but all of them get stucked.

The internal stats and stats:

```
~/Downloads/geo-cluster/cluster-a-1 (branch-0.8.1*) » bin/pulsar-admin topics stats s_topic-partition-0 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
{
"msgRateIn" : 49.6341807476304,
"msgThroughputIn" : 2779.5141218673025,
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesInCounter" : 22151660,
"msgInCounter" : 401744,
"bytesOutCounter" : 1333622,
"msgOutCounter" : 24921,
"averageMsgSize" : 56.0,
"msgChunkPublished" : false,
"storageSize" : 20814910,
"backlogSize" : 20814910,
"offloadedStorageSize" : 0,
"lastOffloadLedgerId" : 0,
"lastOffloadSuccessTimeStamp" : 0,
"lastOffloadFailureTimeStamp" : 0,
"publishers" : [ {
"accessMode" : "Shared",
"msgRateIn" : 4.966751606728177,
"msgThroughputIn" : 278.13808997677796,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 10,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.57512+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-37",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.966751588764786,
"msgThroughputIn" : 278.138088970828,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 11,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.579051+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-38",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.966751579658919,
"msgThroughputIn" : 278.13808846089944,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 12,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.577037+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-39",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.966751137776072,
"msgThroughputIn" : 278.13806371546,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 17,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.585829+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-44",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.933417219186362,
"msgThroughputIn" : 276.2713642744362,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 18,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.593333+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-45",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.966751083472002,
"msgThroughputIn" : 278.13806067443215,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 19,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.589781+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-46",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.9667516437311106,
"msgThroughputIn" : 278.1380920489422,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 13,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.578721+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-40",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.9667516367775395,
"msgThroughputIn" : 278.1380916595422,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 14,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.580607+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-41",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.966751629327285,
"msgThroughputIn" : 278.1380912423279,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 15,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.582231+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-42",
"address" : "/127.0.0.1:50789"
}, {
"accessMode" : "Shared",
"msgRateIn" : 4.966751622208152,
"msgThroughputIn" : 278.1380908436565,
"averageMsgSize" : 56.0,
"chunkedMessageRate" : 0.0,
"producerId" : 16,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.583925+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"producerName" : "cluster-a-0-43",
"address" : "/127.0.0.1:50789"
} ],
"waitingPublishers" : 0,
"subscriptions" : {
"sub" : {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 1333622,
"msgOutCounter" : 24921,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0,
"msgBacklog" : 376760,
"backlogSize" : 0,
"msgBacklogNoDelayed" : 376760,
"blockedSubscriptionOnUnackedMsgs" : false,
"msgDelayed" : 0,
"unackedMessages" : 0,
"type" : "Shared",
"msgRateExpired" : 0.0,
"totalMsgExpired" : 0,
"lastExpireTimestamp" : 0,
"lastConsumedFlowTimestamp" : 1648277422510,
"lastConsumedTimestamp" : 0,
"lastAckedTimestamp" : 0,
"lastMarkDeleteAdvancedTimestamp" : 1648276627087,
"consumers" : [ {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "2a2ae",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:21.096862+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "6b4c9",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:21.216076+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "6c798",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:21.864061+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "9dda8",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:21.968646+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "7bf7b",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.113426+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "07360",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.218797+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "0767a",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.309638+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "309f0",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.377575+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "7d455",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.44303+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
}, {
"msgRateOut" : 0.0,
"msgThroughputOut" : 0.0,
"bytesOutCounter" : 0,
"msgOutCounter" : 0,
"msgRateRedeliver" : 0.0,
"chunkedMessageRate" : 0.0,
"consumerName" : "d54cd",
"availablePermits" : 1000,
"unackedMessages" : 0,
"avgMessagesPerEntry" : 0,
"blockedConsumerOnUnackedMsgs" : false,
"lastAckedTimestamp" : 0,
"lastConsumedTimestamp" : 0,
"metadata" : { },
"connectedSince" : "2022-03-26T14:50:22.496425+08:00",
"clientVersion" : "2.10.0-SNAPSHOT",
"address" : "/127.0.0.1:50789"
} ],
"isDurable" : true,
"isReplicated" : false,
"allowOutOfOrderDelivery" : false,
"consumersAfterMarkDeletePosition" : { },
"nonContiguousDeletedMessagesRanges" : 0,
"nonContiguousDeletedMessagesRangesSerializedSize" : 18,
"replicated" : false,
"durable" : true
}
},
"replication" : { },
"deduplicationStatus" : "Disabled",
"nonContiguousDeletedMessagesRanges" : 0,
"nonContiguousDeletedMessagesRangesSerializedSize" : 18,
"compaction" : {
"lastCompactionRemovedEventCount" : 0,
"lastCompactionSucceedTimestamp" : 0,
"lastCompactionFailedTimestamp" : 0,
"lastCompactionDurationTimeInMills" : 0
}
}

~/Downloads/geo-cluster/cluster-a-1 (branch-0.8.1*) » bin/pulsar-admin transactions transaction-buffer-stats -t s_topic-partition-0 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
{
"state" : "Ready",
"maxReadPosition" : "1203:25701",
"lastSnapshotTimestamps" : 1648285007055
}

~/Downloads/geo-cluster/cluster-a-1 (branch-0.8.1*) » bin/pulsar-admin topics stats-internal s_topic-partition-0 lipenghui@lipenghuideMacBook-Pro-2
Warning: Nashorn engine is planned to be removed from a future JDK release
{
"entriesAddedCounter" : 397642,
"numberOfEntries" : 372860,
"totalSize" : 20596510,
"currentLedgerEntries" : 22860,
"currentLedgerSize" : 1280160,
"lastLedgerCreatedTimestamp" : "2022-03-26T16:48:08.177+08:00",
"lastLedgerCreationFailureTimestamp" : "2022-03-26T14:37:11.86+08:00",
"waitingCursorsCount" : 0,
"pendingAddEntriesCount" : 0,
"lastConfirmedEntry" : "1203:22859",
"state" : "LedgerOpened",
"ledgers" : [ {
"ledgerId" : 860,
"entries" : 50000,
"size" : 2687610,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 921,
"entries" : 50000,
"size" : 2700000,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 974,
"entries" : 50000,
"size" : 2746290,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 1017,
"entries" : 50000,
"size" : 2782450,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 1070,
"entries" : 50000,
"size" : 2800000,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 1097,
"entries" : 50000,
"size" : 2800000,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 1150,
"entries" : 50000,
"size" : 2800000,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 1203,
"entries" : 0,
"size" : 0,
"offloaded" : false,
"underReplicated" : false
} ],
"cursors" : {
"sub" : {
"markDeletePosition" : "669:24781",
"readPosition" : "669:24782",
"waitingReadOp" : false,
"pendingReadOps" : 0,
"messagesConsumedCounter" : 24782,
"cursorLedger" : 681,
"cursorLedgerLastEntry" : 479,
"individuallyDeletedMessages" : "[]",
"lastLedgerSwitchTimestamp" : "2022-03-26T14:28:42.614+08:00",
"state" : "Open",
"numberOfEntriesSinceFirstNotAckedMessage" : 1,
"totalNonContiguousDeletedMessagesRange" : 0,
"subscriptionHavePendingRead" : true,
"subscriptionHavePendingReplayRead" : false,
"properties" : { }
},
"transaction-buffer-sub" : {
"markDeletePosition" : "669:-1",
"readPosition" : "669:0",
"waitingReadOp" : false,
"pendingReadOps" : 0,
"messagesConsumedCounter" : 0,
"cursorLedger" : -1,
"cursorLedgerLastEntry" : -1,
"individuallyDeletedMessages" : "[]",
"lastLedgerSwitchTimestamp" : "2022-03-26T14:28:42.765+08:00",
"state" : "Uninitialized",
"numberOfEntriesSinceFirstNotAckedMessage" : 1,
"totalNonContiguousDeletedMessagesRange" : 0,
"subscriptionHavePendingRead" : false,
"subscriptionHavePendingReplayRead" : false,
"properties" : { }
}
},
"schemaLedgers" : [ {
"ledgerId" : 69,
"entries" : 1,
"size" : 103,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 88,
"entries" : 1,
"size" : 129,
"offloaded" : false,
"underReplicated" : false
}, {
"ledgerId" : 78,
"entries" : 1,
"size" : 85,
"offloaded" : false,
"underReplicated" : false
} ],
"compactedLedger" : {
"ledgerId" : -1,
"entries" : -1,
"size" : -1,
"offloaded" : false,
"underReplicated" : false
}
}

```

From the topic stats, looks like the consumer connects to the topic and never gets any messages, the `msgOutCounter` is 0, the `lastConsumedFlowTimestamp` is `2022-03-26 14:50:22` and the connect time is `2022-03-26T14:50:21.096862+08:00`.

From the broker side:

```
14:50:21.092 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.097 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.097 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 0
14:50:21.097 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.207 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.216 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.216 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 10
14:50:21.216 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.859 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.864 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.864 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 20
14:50:21.864 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.965 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.968 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.968 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 30
14:50:21.968 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.109 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.113 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.113 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 40
14:50:22.113 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.203 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 50
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.291 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 60
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.373 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.377 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.377 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 70
14:50:22.377 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.433 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.443 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.443 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 80
14:50:22.443 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.490 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.496 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.496 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 90
14:50:22.496 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.564 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=10
14:50:22.565 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=11
14:50:22.567 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=12
14:50:22.569 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=13
14:50:22.571 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=14
14:50:22.572 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=15
14:50:22.572 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=16
14:50:22.574 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=17
14:50:22.574 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=18
14:50:22.574 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=19
14:50:22.575 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-37, producerId=10}
14:50:22.577 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-39, producerId=12}
14:50:22.578 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-40, producerId=13}
14:50:22.579 [BookKeeperClientWorker-OrderedExecutor-6-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-38, producerId=11}
14:50:22.580 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-41, producerId=14}
14:50:22.582 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-42, producerId=15}
14:50:22.584 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-43, producerId=16}
14:50:22.585 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-44, producerId=17}
14:50:22.590 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-46, producerId=19}
14:50:22.593 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-45, producerId=18}
15:06:04.289 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-0] Closing ledger 860 for being full
15:06:04.382 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating a new ledger after closed
15:06:04.401 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 48], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
15:06:04.590 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Created new ledger 921
15:06:04.647 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-0, name=sub, ackPos=669:24781, readPos=669:24782} does not exist in the managed-ledger.
15:06:04.647 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-0, ackPos=669:-1, readPos=669:0} does not exist in the managed-ledger.
15:23:05.346 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-0] Closing ledger 921 for being full
15:23:05.460 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating a new ledger after closed
15:23:05.490 [BookKeeperClientWorker-OrderedExecutor-1-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 48], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
15:23:05.780 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Created new ledger 974
15:23:05.900 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-0, name=sub, ackPos=669:24781, readPos=669:24782} does not exist in the managed-ledger.
15:23:05.930 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-0, ackPos=669:-1, readPos=669:0} does not exist in the managed-ledger.
15:40:05.625 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-0] Closing ledger 974 for being full
15:40:05.740 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating a new ledger after closed
15:40:05.777 [BookKeeperClientWorker-OrderedExecutor-5-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 48], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
15:40:06.049 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Created new ledger 1017
15:40:06.151 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-0, name=sub, ackPos=669:24781, readPos=669:24782} does not exist in the managed-ledger.
15:40:06.178 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-0, ackPos=669:-1, readPos=669:0} does not exist in the managed-ledger.
15:57:06.683 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-0] Closing ledger 1017 for being full
15:57:06.800 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating a new ledger after closed
15:57:06.824 [BookKeeperClientWorker-OrderedExecutor-0-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 48], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
15:57:07.055 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Created new ledger 1070
15:57:07.170 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-0, name=sub, ackPos=669:24781, readPos=669:24782} does not exist in the managed-ledger.
15:57:07.194 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-0, ackPos=669:-1, readPos=669:0} does not exist in the managed-ledger.
16:14:07.387 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-0] Closing ledger 1070 for being full
16:14:07.507 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating a new ledger after closed
16:14:07.550 [BookKeeperClientWorker-OrderedExecutor-3-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 48], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
16:14:07.798 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Created new ledger 1097
16:14:07.917 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-0, name=sub, ackPos=669:24781, readPos=669:24782} does not exist in the managed-ledger.
16:14:07.941 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-0, ackPos=669:-1, readPos=669:0} does not exist in the managed-ledger.
16:31:08.874 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-0] Closing ledger 1097 for being full
16:31:08.991 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating a new ledger after closed
16:31:09.017 [BookKeeperClientWorker-OrderedExecutor-2-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 48], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
16:31:09.248 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Created new ledger 1150
16:31:09.373 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-0, name=sub, ackPos=669:24781, readPos=669:24782} does not exist in the managed-ledger.
16:31:09.398 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-0, ackPos=669:-1, readPos=669:0} does not exist in the managed-ledger.
16:48:07.475 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-0] Closing ledger 1150 for being full
16:48:07.764 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating a new ledger
16:48:07.788 [BookKeeperClientWorker-OrderedExecutor-11-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 48], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
16:48:08.063 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-0] Created new ledger 1203
16:48:08.178 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-0, name=sub, ackPos=669:24781, readPos=669:24782} does not exist in the managed-ledger.
16:48:08.201 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-0, ackPos=669:-1, readPos=669:0} does not exist in the managed-ledger.
16:54:55.202 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:54:55 +0800] "GET /admin/v2/persistent/public/default/s_topic-partition-0/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 200 8996 "-" "Pulsar-Java-v2.9.2" 112
16:55:04.903 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:55:04 +0800] "GET /admin/v2/persistent/public/default/s_topic-partition-0/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 200 8996 "-" "Pulsar-Java-v2.9.2" 19
16:55:50.078 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:55:49 +0800] "GET /admin/v2/persistent/public/default/s_topic-partition-0/internalStats?metadata=false HTTP/1.1" 200 2442 "-" "Pulsar-Java-v2.9.2" 82
16:56:28.289 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:56:28 +0800] "GET /admin/v3/transactions/transactionBufferStats/public/default/s_topic-partition-0 HTTP/1.1" 200 87 "-" "Pulsar-Java-v2.9.2" 161
16:56:38.145 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:56:38 +0800] "GET /admin/v3/transactions/transactionBufferStats/public/default/s_topic-partition-0 HTTP/1.1" 200 87 "-" "Pulsar-Java-v2.9.2" 2
16:56:47.635 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:56:47 +0800] "GET /admin/v3/transactions/transactionBufferStats/public/default/s_topic-partition-0 HTTP/1.1" 200 87 "-" "Pulsar-Java-v2.9.2" 2
16:57:09.046 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:57:09 +0800] "GET /admin/v2/persistent/public/default/s_topic-partition-0/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 200 8998 "-" "Pulsar-Java-v2.9.2" 3
16:58:43.952 [pulsar-web-49-18] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:16:58:43 +0800] "GET /lookup/v2/topic/persistent/public/default/s_topic-partition-0 HTTP/1.1" 200 129 "-" "Pulsar-Java-v2.9.2" 88
```

The broker jstack, looks like don't have any dead lock
[broker-0.jstack.log](https://github.com/apache/pulsar/files/8355081/broker-0.jstack.log)

The broker heap dump
https://drive.google.com/file/d/1hE11yv-IjPm9Jm0x_rF9Djp9LAb9at-f/view?usp=sharing

The logs of broker 0

[pulsar-broker-lipenghuideMacBook-Pro-2.local.log.zip](https://github.com/apache/pulsar/files/8355114/pulsar-broker-lipenghuideMacBook-Pro-2.local.log.zip)

```
14:50:20.819 [pulsar-transaction-executor-7-1] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/t_topic-partition-4] Opened new cursor: NonDurableCursorImpl{ledger=public/default/persistent/t_topic-partition-4, ackPos=863:3879, readPos=890:0}
14:50:20.819 [pulsar-transaction-executor-6-1] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/t_topic-partition-8] Opened new cursor: NonDurableCursorImpl{ledger=public/default/persistent/t_topic-partition-8, ackPos=862:3870, readPos=892:0}
14:50:20.819 [pulsar-transaction-executor-7-1] INFO org.apache.pulsar.broker.transaction.buffer.impl.TopicTransactionBuffer - [persistent://public/default/t_topic-partition-4]Transaction buffer snapshot recover cursor close complete.
14:50:20.819 [pulsar-transaction-executor-6-1] INFO org.apache.pulsar.broker.transaction.buffer.impl.TopicTransactionBuffer - [persistent://public/default/t_topic-partition-8]Transaction buffer snapshot recover cursor close complete.
14:50:20.820 [main-EventThread] INFO org.apache.bookkeeper.client.MetadataUpdateLoop - UpdateLoop(ledgerId=888,loopId=1ab44f33) conflict writing metadata to store, update local value and try again
14:50:20.820 [main-EventThread] INFO org.apache.bookkeeper.client.MetadataUpdateLoop - UpdateLoop(ledgerId=888,loopId=2de2b706) conflict writing metadata to store, update local value and try again
14:50:20.820 [main-EventThread] INFO org.apache.bookkeeper.client.MetadataUpdateLoop - UpdateLoop(ledgerId=888,loopId=26fc3867) conflict writing metadata to store, update local value and try again
14:50:20.822 [pulsar-io-16-10] INFO org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/default/__transaction_buffer_snapshot] [reader-b10d436bc7] Closed consumer
14:50:20.822 [BookKeeperClientWorker-OrderedExecutor-0-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/t_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-36, producerId=4}
14:50:20.833 [BookKeeperClientWorker-OrderedExecutor-0-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/t_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-36, producerId=8}
14:50:20.843 [pulsar-io-16-10] INFO org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/default/__transaction_buffer_snapshot] [reader-190b0a0e71] Closed consumer
14:50:20.844 [pulsar-io-16-10] INFO org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/default/__transaction_buffer_snapshot][reader-34823a99fd] Successfully getLastMessageId 847:286
14:50:20.862 [pulsar-transaction-executor-13-1] INFO org.apache.bookkeeper.mledger.impl.NonDurableCursorImpl - [public/default/persistent/t_topic-partition-2] Created non-durable cursor read-position=889:0 mark-delete-position=879:2419
14:50:20.877 [pulsar-transaction-executor-13-1] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/t_topic-partition-2] Opened new cursor: NonDurableCursorImpl{ledger=public/default/persistent/t_topic-partition-2, ackPos=879:2419, readPos=889:0}
14:50:20.877 [pulsar-transaction-executor-13-1] INFO org.apache.pulsar.broker.transaction.buffer.impl.TopicTransactionBuffer - [persistent://public/default/t_topic-partition-2]Transaction buffer snapshot recover cursor close complete.
14:50:20.878 [pulsar-transaction-executor-13-1] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/t_topic-partition-2}, client=/127.0.0.1:50789, producerName=cluster-a-0-36, producerId=2}
14:50:20.879 [pulsar-io-16-10] INFO org.apache.pulsar.client.impl.ConsumerImpl - [persistent://public/default/__transaction_buffer_snapshot] [reader-34823a99fd] Closed consumer
14:50:20.892 [pulsar-io-16-10] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/t_topic-partition-6}, client=/127.0.0.1:50789, producerName=cluster-a-0-36, producerId=6}
14:50:21.092 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.096 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.097 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.097 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.097 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 0
14:50:21.097 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.100 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.102 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:21.102 [ForkJoinPool.commonPool-worker-13] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:21.103 [ForkJoinPool.commonPool-worker-13] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 4
14:50:21.103 [ForkJoinPool.commonPool-worker-13] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.105 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:21.105 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 7
14:50:21.105 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.105 [ForkJoinPool.commonPool-worker-13] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:21.105 [ForkJoinPool.commonPool-worker-13] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 3
14:50:21.105 [ForkJoinPool.commonPool-worker-13] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.106 [ForkJoinPool.commonPool-worker-25] INFO org.apache.bookkeeper.mledger.impl.ManagedCursorImpl - [public/default/persistent/s_topic-partition-8-sub] Rewind from 851:4829 to 851:2
14:50:21.107 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:21.107 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 8
14:50:21.107 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:21.207 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.210 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.212 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.216 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.216 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 10
14:50:21.216 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.217 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:21.217 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 13
14:50:21.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.219 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:21.220 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 14
14:50:21.220 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.614 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.614 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:21.617 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:21.617 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 18
14:50:21.617 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:21.618 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:21.618 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 17
14:50:21.618 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.859 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.864 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.864 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 20
14:50:21.864 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.865 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.868 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.869 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:21.869 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 23
14:50:21.869 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.871 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:21.871 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 24
14:50:21.871 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.873 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.874 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:21.877 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:21.877 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 28
14:50:21.877 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:21.878 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:21.878 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 27
14:50:21.878 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.965 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.968 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:21.968 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 30
14:50:21.968 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:21.970 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.971 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.973 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:21.974 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 34
14:50:21.974 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:21.975 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:21.975 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 33
14:50:21.975 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:21.975 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.977 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:21.980 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:21.980 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 37
14:50:21.980 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:21.982 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:21.982 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 38
14:50:21.982 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.109 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.113 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.113 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.113 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 40
14:50:22.113 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.115 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.117 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:22.117 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 43
14:50:22.117 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.119 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.119 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:22.119 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 44
14:50:22.119 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.120 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.122 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:22.122 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 47
14:50:22.122 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.123 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:22.123 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 48
14:50:22.124 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.203 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.206 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.207 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.210 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.211 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.216 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 54
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 53
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 50
14:50:22.218 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.225 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:22.225 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 58
14:50:22.225 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.226 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:22.226 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 57
14:50:22.226 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.291 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.292 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.293 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.296 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.297 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.306 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:22.306 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 68
14:50:22.306 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.307 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:22.307 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 67
14:50:22.307 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.308 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 64
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 63
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 60
14:50:22.309 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.373 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.377 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.377 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 70
14:50:22.377 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.377 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.378 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.381 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:22.381 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 74
14:50:22.381 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.381 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:22.381 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 73
14:50:22.381 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.382 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.383 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.386 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:22.386 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 77
14:50:22.386 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.388 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:22.388 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 78
14:50:22.388 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.433 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.435 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.435 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.438 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.439 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.442 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:22.442 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 83
14:50:22.442 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.443 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.443 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 80
14:50:22.443 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.445 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:22.445 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 84
14:50:22.445 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.447 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:22.448 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 88
14:50:22.448 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.448 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:22.448 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 87
14:50:22.448 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.490 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.493 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.494 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.496 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0] There are no replicated subscriptions on the topic
14:50:22.496 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-0][sub] Created new subscription for 90
14:50:22.496 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-0 / sub
14:50:22.497 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.498 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Subscribing on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.499 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4] There are no replicated subscriptions on the topic
14:50:22.499 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-4][sub] Created new subscription for 94
14:50:22.499 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-4 / sub
14:50:22.500 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3] There are no replicated subscriptions on the topic
14:50:22.500 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-3][sub] Created new subscription for 93
14:50:22.500 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-3 / sub
14:50:22.506 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8] There are no replicated subscriptions on the topic
14:50:22.506 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-8][sub] Created new subscription for 98
14:50:22.506 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-8 / sub
14:50:22.506 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7] There are no replicated subscriptions on the topic
14:50:22.506 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://public/default/s_topic-partition-7][sub] Created new subscription for 97
14:50:22.507 [ForkJoinPool.commonPool-worker-25] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created subscription on topic persistent://public/default/s_topic-partition-7 / sub
14:50:22.564 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=10
14:50:22.565 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=11
14:50:22.567 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=12
14:50:22.569 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=13
14:50:22.571 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=14
14:50:22.572 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=15
14:50:22.572 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=16
14:50:22.574 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=17
14:50:22.574 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=18
14:50:22.574 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-0] Creating producer. producerId=19
14:50:22.575 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-37, producerId=10}
14:50:22.577 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-39, producerId=12}
14:50:22.578 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-40, producerId=13}
14:50:22.579 [BookKeeperClientWorker-OrderedExecutor-6-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-38, producerId=11}
14:50:22.580 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-41, producerId=14}
14:50:22.582 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-42, producerId=15}
14:50:22.584 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-43, producerId=16}
14:50:22.585 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-44, producerId=17}
14:50:22.590 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-46, producerId=19}
14:50:22.593 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-0}, client=/127.0.0.1:50789, producerName=cluster-a-0-45, producerId=18}
14:50:22.614 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=22
14:50:22.615 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=23
14:50:22.618 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=26
14:50:22.619 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=27
14:50:22.620 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-37, producerId=22}
14:50:22.622 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-37, producerId=23}
14:50:22.628 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-37, producerId=26}
14:50:22.629 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-37, producerId=27}
14:50:22.880 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=31
14:50:22.880 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=32
14:50:22.883 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=35
14:50:22.883 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=36
14:50:22.886 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=40
14:50:22.886 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=41
14:50:22.889 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=44
14:50:22.889 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=45
14:50:22.891 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-39, producerId=31}
14:50:22.892 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=49
14:50:22.892 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=50
14:50:22.895 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=53
14:50:22.896 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=54
14:50:22.897 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-39, producerId=32}
14:50:22.899 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=58
14:50:22.899 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=59
14:50:22.901 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=62
14:50:22.901 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=63
14:50:22.903 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-39, producerId=35}
14:50:22.905 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=67
14:50:22.905 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=68
14:50:22.909 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=71
14:50:22.909 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=72
14:50:22.912 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=76
14:50:22.912 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=77
14:50:22.913 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-40, producerId=41}
14:50:22.915 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=80
14:50:22.916 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=81
14:50:22.919 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=85
14:50:22.919 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=86
14:50:22.920 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-40, producerId=44}
14:50:22.921 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=89
14:50:22.921 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=90
14:50:22.925 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=94
14:50:22.925 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=95
14:50:22.926 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-40, producerId=45}
14:50:22.926 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=98
14:50:22.926 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=99
14:50:22.930 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-3] Creating producer. producerId=103
14:50:22.932 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-4] Creating producer. producerId=104
14:50:22.935 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-38, producerId=50}
14:50:22.935 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-38, producerId=49}
14:50:22.940 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-39, producerId=36}
14:50:22.941 [BookKeeperClientWorker-OrderedExecutor-6-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-40, producerId=40}
14:50:22.944 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-7] Creating producer. producerId=107
14:50:22.945 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-38, producerId=53}
14:50:22.945 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-46, producerId=95}
14:50:22.946 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-46, producerId=99}
14:50:22.948 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-45, producerId=104}
14:50:22.948 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-42, producerId=72}
14:50:22.949 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-41, producerId=59}
14:50:22.949 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-43, producerId=77}
14:50:22.949 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-42, producerId=68}
14:50:22.949 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-44, producerId=85}
14:50:22.949 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-42, producerId=67}
14:50:22.950 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-4}, client=/127.0.0.1:50789, producerName=cluster-a-0-44, producerId=86}
14:50:22.950 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-41, producerId=58}
14:50:22.950 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-43, producerId=76}
14:50:22.950 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-43, producerId=80}
14:50:22.951 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-45, producerId=107}
14:50:22.951 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-42, producerId=71}
14:50:22.951 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-38, producerId=54}
14:50:22.951 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-43, producerId=81}
14:50:22.952 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-41, producerId=63}
14:50:22.952 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-46, producerId=98}
14:50:22.952 [pulsar-io-16-9] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789][persistent://public/default/s_topic-partition-8] Creating producer. producerId=108
14:50:22.953 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-41, producerId=62}
14:50:22.954 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-44, producerId=90}
14:50:22.954 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-7}, client=/127.0.0.1:50789, producerName=cluster-a-0-44, producerId=89}
14:50:22.954 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-46, producerId=94}
14:50:22.955 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-3}, client=/127.0.0.1:50789, producerName=cluster-a-0-45, producerId=103}
14:50:22.956 [BookKeeperClientWorker-OrderedExecutor-9-0] INFO org.apache.pulsar.broker.service.ServerCnx - [/127.0.0.1:50789] Created new producer: Producer{topic=PersistentTopic{topic=persistent://public/default/s_topic-partition-8}, client=/127.0.0.1:50789, producerName=cluster-a-0-45, producerId=108}
14:50:24.052 [pulsar-io-16-20] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Successfully connected to bookie: 127.0.0.1:3381 [id: 0x44cc2549, L:/127.0.0.1:50794 - R:/127.0.0.1:3381]
14:50:24.053 [pulsar-io-16-23] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Successfully connected to bookie: 127.0.0.1:3381 [id: 0xb590ca74, L:/127.0.0.1:50798 - R:/127.0.0.1:3381]
14:50:24.052 [pulsar-io-16-21] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Successfully connected to bookie: 127.0.0.1:3381 [id: 0xba986601, L:/127.0.0.1:50792 - R:/127.0.0.1:3381]
14:50:24.107 [pulsar-io-16-21] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - connection [id: 0xba986601, L:/127.0.0.1:50792 - R:/127.0.0.1:3381] authenticated as BookKeeperPrincipal{ANONYMOUS}
14:50:24.052 [pulsar-io-16-22] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Successfully connected to bookie: 127.0.0.1:3381 [id: 0xf191c511, L:/127.0.0.1:50793 - R:/127.0.0.1:3381]
14:50:24.087 [pulsar-io-16-23] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - connection [id: 0xb590ca74, L:/127.0.0.1:50798 - R:/127.0.0.1:3381] authenticated as BookKeeperPrincipal{ANONYMOUS}
14:50:24.061 [pulsar-io-16-20] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - connection [id: 0x44cc2549, L:/127.0.0.1:50794 - R:/127.0.0.1:3381] authenticated as BookKeeperPrincipal{ANONYMOUS}
14:50:24.132 [pulsar-io-16-22] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - connection [id: 0xf191c511, L:/127.0.0.1:50793 - R:/127.0.0.1:3381] authenticated as BookKeeperPrincipal{ANONYMOUS}
14:50:27.988 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:50:27 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:50:28.365 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change 34.412699937820435% exceeded threshold 10%; time since last report written is 415.005 seconds
14:50:28.418 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
14:50:28.447 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xd0000000_0xe0000000 is less than 2，skip split!
14:50:28.455 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:50:28.464 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:50:33.365 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change Infinity% exceeded threshold 10%; time since last report written is 4.997 seconds
14:50:33.446 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
14:50:33.461 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:50:33.478 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:50:33.895 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:50:33 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:50:39.647 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:50:39 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:50:45.151 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:50:45 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
14:50:45.795 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:50:45.812 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:50:50.790 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:50:50 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:50:55.422 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:50:55.440 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:50:56.582 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:50:56 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:02.035 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:02 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:07.406 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:07 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:12.798 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:12 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:18.182 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:18 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:23.431 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:23 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:28.739 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:28 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:33.366 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change 66.79973549312751% exceeded threshold 10%; time since last report written is 59.976 seconds
14:51:33.459 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
14:51:33.478 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:51:33.498 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:51:34.067 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:34 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:39.332 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:39 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:44.621 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:44 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:45.779 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:51:45.796 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:51:49.923 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:49 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:55.292 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:51:55 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:51:55.430 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:51:55.449 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:52:00.435 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:00 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:05.707 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:05 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:52:11.154 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:11 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:16.319 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:16 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:21.370 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:21 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
14:52:26.435 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:26 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:31.584 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:31 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:36.736 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:36 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:41.611 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:41 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:46.668 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:46 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:52:51.908 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:51 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:52:57.044 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:52:57 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:53:02.078 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:02 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 4
14:53:07.574 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:07 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:53:12.854 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:12 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:53:17.952 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:17 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:53:22.827 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:22 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:53:28.437 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:28 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:53:33.759 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:33 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:53:38.965 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:38 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:53:40.801 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:53:40.818 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:53:44.125 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:44 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:53:49.331 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:49 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:53:54.616 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:54 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:53:55.400 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:53:55.413 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:53:59.854 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:53:59 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:54:05.088 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:05 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:10.292 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:10 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:15.438 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:15 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:20.534 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:20 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:25.630 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:25 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:30.998 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:30 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:36.209 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:36 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:41.371 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:41 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:46.500 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:46 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 8
14:54:51.854 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:51 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:54:57.095 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:54:57 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:02.291 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:02 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:07.492 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:07 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:12.606 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:12 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:17.842 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:17 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:23.045 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:23 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:28.285 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:28 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:33.468 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:33 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:35.839 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:55:35.873 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:55:38.708 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:38 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:43.805 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:43 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
14:55:48.372 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change 10.324007272720337% exceeded threshold 10%; time since last report written is 254.99 seconds
14:55:48.452 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
14:55:48.455 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:55:48.455 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:55:49.166 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:49 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:50.811 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:55:50.829 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:55:54.477 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:54 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:55:59.581 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:55:59 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:04.661 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:04 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:56:09.719 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:09 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:15.056 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:15 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:20.606 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:20 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:25.632 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:25 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:30.743 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:30 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:56:35.880 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:35 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:56:41.034 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:41 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:46.044 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:46 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:51.344 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:51 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:56:56.547 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:56:56 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:01.687 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:01 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:06.717 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:06 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:11.880 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:11 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:17.005 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:17 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:22.280 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:22 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:27.256 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:27 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:32.430 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:32 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:37.478 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:37 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:57:42.658 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:42 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:43.374 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change 10.436341166496277% exceeded threshold 10%; time since last report written is 114.997 seconds
14:57:43.483 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
14:57:43.502 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:57:43.520 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:57:47.852 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:47 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:53.226 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:53 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:57:58.359 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:57:58 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:03.527 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:03 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:58:08.480 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:08 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:13.613 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:13 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:18.866 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:18 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:24.006 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:24 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:29.105 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:29 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
14:58:34.276 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:34 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:39.377 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:39 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:44.854 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:44 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
14:58:50.242 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:50 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:58:55.604 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:58:55 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:00.850 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:00 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:03.376 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change 29.04413342475891% exceeded threshold 10%; time since last report written is 79.986 seconds
14:59:03.460 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
14:59:03.478 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
14:59:03.496 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
14:59:05.940 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:05 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:11.004 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:11 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:16.469 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:16 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
14:59:21.724 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:21 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:26.910 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:26 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:32.145 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:32 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:37.218 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:37 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:42.276 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:42 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:47.346 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:47 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:52.542 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:52 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
14:59:57.699 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:14:59:57 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:00:02.819 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:02 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
15:00:05.443 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:00:05.467 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:00:08.068 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:08 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:00:13.054 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:13 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:00:18.107 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:18 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:00:23.278 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:23 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:00:28.560 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:28 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:00:30.822 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:00:30.839 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:00:33.701 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:33 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:00:38.709 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:38 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:00:43.761 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:43 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:00:48.802 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:48 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:00:54.009 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:54 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:00:59.129 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:00:59 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:04.200 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:04 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:09.262 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:09 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:14.406 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:14 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
15:01:19.416 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:19 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:24.647 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:24 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:29.736 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:29 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:34.795 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:34 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:39.860 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:39 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:44.985 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:44 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:01:50.101 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:50 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:01:55.354 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:01:55 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:02:00.804 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:00 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:02:05.436 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:02:05.461 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:02:05.874 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:05 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
15:02:10.937 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:10 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:02:16.086 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:16 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:02:21.267 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:21 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:02:25.778 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:02:25.796 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:02:26.267 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:26 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:02:31.406 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:31 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:02:36.492 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:36 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
15:02:41.674 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:41 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:02:46.687 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:46 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:02:51.746 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:51 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:02:56.954 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:02:56 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:03:02.021 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:02 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
15:03:07.285 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:07 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:03:08.385 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change 10.26315689086914% exceeded threshold 10%; time since last report written is 245.001 seconds
15:03:08.486 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
15:03:08.503 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:03:08.521 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:03:12.535 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:12 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:03:17.644 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:17 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:03:20.468 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:03:20.485 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:03:22.825 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:22 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
15:03:27.849 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:27 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:03:32.943 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:32 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:03:38.168 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:38 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:03:43.410 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:43 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:03:48.583 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:48 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:03:53.880 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:53 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:03:58.968 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:03:58 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:04:04.083 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:04 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:04:09.161 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:09 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:04:14.482 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:14 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 0
15:04:19.732 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:19 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:04:20.850 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:04:20.867 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:04:25.084 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:25 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:04:30.343 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:30 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:04:35.556 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:35 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:04:40.704 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:40 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:04:45.866 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:45 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:04:51.219 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:51 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:04:56.219 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:04:56 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:05:00.835 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:05:00.854 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:05:01.356 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:01 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 2
15:05:03.410 [pulsar-load-manager-1-1] INFO org.apache.pulsar.broker.loadbalance.impl.ModularLoadManagerImpl - Writing local data to metadata store because maximum change 10.400390625% exceeded threshold 10%; time since last report written is 115.022 seconds
15:05:03.474 [metadata-store-18-1] INFO org.apache.pulsar.metadata.coordination.impl.ResourceLockImpl - Acquired resource lock on /loadbalance/brokers/127.0.0.1:8081
15:05:03.492 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle pulsar/system/0x00000000_0x10000000 is less than 2，skip split!
15:05:03.517 [pulsar-modular-load-manager-41-1] INFO org.apache.pulsar.broker.loadbalance.BundleSplitStrategy - The count of topics on the bundle public/default/0xc0000000_0xd0000000 is less than 2，skip split!
15:05:06.290 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:06 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:05:11.233 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:11 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:05:16.212 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:16 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 3
15:05:21.327 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:21 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:05:26.459 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:26 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:05:31.636 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:31 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:05:36.653 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:36 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:05:38.950 [BookKeeperClientWorker-OrderedExecutor-7-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-8] Closing ledger 851 for being full
15:05:39.049 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-8] Creating a new ledger after closed
15:05:39.066 [BookKeeperClientWorker-OrderedExecutor-4-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-8] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 56], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
15:05:39.216 [main-EventThread] INFO org.apache.bookkeeper.client.LedgerCreateOp - Ensemble: [127.0.0.1:3381] for ledger: 918
15:05:39.236 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-8] Created new ledger 918
15:05:39.343 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: NonDurableCursorImpl{ledger=public/default/persistent/s_topic-partition-8, ackPos=671:-1, readPos=671:0} does not exist in the managed-ledger.
15:05:39.358 [pulsar-io-16-24] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - Successfully connected to bookie: 127.0.0.1:3381 [id: 0x92476037, L:/127.0.0.1:51751 - R:/127.0.0.1:3381]
15:05:39.387 [pulsar-io-16-24] INFO org.apache.bookkeeper.proto.PerChannelBookieClient - connection [id: 0x92476037, L:/127.0.0.1:51751 - R:/127.0.0.1:3381] authenticated as BookKeeperPrincipal{ANONYMOUS}
15:05:39.928 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-8] End TrimConsumedLedgers. ledgers=1 totalSize=2646
15:05:39.946 [bookkeeper-ml-scheduler-OrderedScheduler-7-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-8] Removing ledger 851 - size: 2687610
15:05:41.815 [pulsar-web-49-16] INFO org.eclipse.jetty.server.RequestLog - 127.0.0.1 - - [26/Mar/2022:15:05:41 +0800] "GET /admin/v2/persistent/public/default/__transaction_buffer_snapshot/stats?getPreciseBacklog=false&subscriptionBacklogSize=false HTTP/1.1" 307 0 "-" "Pulsar-Java-v2.9.2" 1
15:05:44.470 [BookKeeperClientWorker-OrderedExecutor-6-0] INFO org.apache.bookkeeper.mledger.impl.OpAddEntry - [public/default/persistent/s_topic-partition-7] Closing ledger 856 for being full
15:05:44.545 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-7] Creating a new ledger after closed
15:05:44.564 [BookKeeperClientWorker-OrderedExecutor-0-0] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-7] Creating ledger, metadata: {component=[109, 97, 110, 97, 103, 101, 100, 45, 108, 101, 100, 103, 101, 114], pulsar/managed-ledger=[112, 117, 98, 108, 105, 99, 47, 100, 101, 102, 97, 117, 108, 116, 47, 112, 101, 114, 115, 105, 115, 116, 101, 110, 116, 47, 115, 95, 116, 111, 112, 105, 99, 45, 112, 97, 114, 116, 105, 116, 105, 111, 110, 45, 55], application=[112, 117, 108, 115, 97, 114]} - metadata ops timeout : 60 seconds
15:05:44.656 [main-EventThread] INFO org.apache.bookkeeper.client.LedgerCreateOp - Ensemble: [127.0.0.1:3381] for ledger: 919
15:05:44.656 [main-EventThread] INFO org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - [public/default/persistent/s_topic-partition-7] Created new ledger 919
15:05:44.695 [bookkeeper-ml-scheduler-OrderedScheduler-6-0] WARN org.apache.bookkeeper.mledger.impl.ManagedLedgerImpl - Cursor: ManagedCursorImpl{ledger=public/default/persistent/s_topic-partition-7, name=sub,
```

**Additional context**
https://github.com/apache/pulsar/commit/f0a2171cbad894cec5bfb2d4de31cb8de32a3183

Contributor guide

Open the contributing guide

Research direction

Reproduce the reported setup with three brokers, three bookies, transactions enabled, and a ten-partition topic, then use the pulsar-admin topics lookup command and consumer stats to compare partition ownership and consumption. Done means all partitions continue consuming without requiring a topic unload, with a regression test or equivalent evidence covering the behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack: java
Domain: distributed-systems
Issue type: Bug
Difficulty: 4/5
Estimated time: 3-5 days
Activity status: Stale
Clarity: Mostly clear
Newbie friendliness: 38/100

All the consumers get stuck for a broker after enabled transaction

Description

Contributor guide

Research direction

Assessment

Get new issues in your inbox