Pulsar stats
Topic stats
The following table outlines the stats of a topic. For more details about how to get these stats, see Get stats.
note
All stats below are reset to 0 upon broker restart or topic unloading, except the stats marked with asterisks * (the values of them keep unchanged).
Stat | Description |
---|
msgRateIn | The sum of all local and replication publishers’ publish rates (message per second). |
msgThroughputIn | The sum of all local and replication publishers’ publish rates (byte per second). |
msgRateOut | The sum of all local and replication consumers’ dispatch rates (message per second). |
msgThroughputOut | The sum of all local and replication consumers’ dispatch rates (byte per second). |
averageMsgSize | The average size (bytes) of messages published within the last interval. |
storageSize | The sum of the ledgers’ storage size in BookKeeper and in tiered storage for a topic (in bytes). |
offloadedStorageSize | The sum of the storage size in tiered storage for a topic (in bytes).
Note: the total storage size of a topic = storageSize , includes offloadedStorageSize . |
earliestMsgPublishTimeInBacklogs | The publish time of the earliest message in the backlog (in milliseconds). |
bytesInCounter | The total bytes published to the topic. |
msgInCounter | The total messages published to the topic. |
bytesOutCounter | The total bytes delivered to consumers. |
msgOutCounter | The total messages delivered to consumers. |
msgChunkPublished | The topics that have chunked messages published on it. |
backlogSize | The estimated total unconsumed or backlog size (in bytes). |
oldestBacklogMessageAgeSeconds | The age of the oldest unacknowledged (i.e. backlog) message, measured by the time elapsed from its published time, in seconds. This value is recorded every backlog quota check interval, hence it represents the value seen in the last check. |
oldestBacklogMessageSubscriptionName | The name of the subscription containing the oldest unacknowledged message. This value is recorded every backlog quota check interval, hence it represents the value seen in the last check. |
backlogQuotaLimitSize | the size in bytes of the topic backlog quota. |
backlogQuotaLimitTime | the topic backlog age (time) quota, in seconds. |
waitingPublishers | The number of publishers waiting in a queue in exclusive access mode. |
deduplicationStatus | The status of message deduplication for the topic. |
topicEpoch | The topic epoch or empty if not set. |
filteredEntriesCount | The count of skipped entries for the topic. |
nonContiguousDeletedMessagesRanges | The number of non-contiguous deleted messages ranges. |
nonContiguousDeletedMessagesRangesSerializedSize | The serialized size of non-contiguous deleted messages ranges. |
ownerBroker | The broker that owns this topic. |
publishers | The list of all local publishers on the topic, ranging from zero to thousands. |
subscriptions | The list of all local subscriptions to the topic. |
replication | This section gives the stats for cross-colo replication of this topic. |
Producer stats
Stat | Description |
---|
producerId | The internal identifier for this producer on this topic. |
producerName | The internal identifier for this producer, generated by the client library. |
address | IP address and source port for the connection of this producer. |
connectedSince | The timestamp when this producer is created or reconnected last time. |
accessMode | The type of access to the topic that the producer requires. |
msgRateIn | The total rate of messages (message per second) published by this publisher. |
msgThroughputIn | The total throughput (byte per second) of the messages published by this publisher. |
averageMsgSize | The average message size in bytes from this publisher within the last interval. |
chunkedMessageRate | The total rate of chunked messages published by this publisher. |
clientVersion | The client library version of this producer. |
metadata | The metadata (key/value strings) associated with this publisher. |
Subscription stats
Stat | Description |
---|
my-subscription | The name of this subscription. It is defined by the client. |
msgRateOut | The total rate of messages (message per second) delivered on this subscription. |
msgThroughputOut | The total throughput (byte per second) delivered on this subscription. |
msgBacklog | The number of messages in the subscription backlog. |
type | This subscription type. |
msgRateExpired | The rate at which messages are discarded instead of dispatched from this subscription due to TTL. |
lastExpireTimestamp | The timestamp of the last message expiration. |
lastConsumedFlowTimestamp | The timestamp of the last flow command received. |
lastConsumedTimestamp | The latest timestamp of all the consumed timestamps of the consumers. |
lastAckedTimestamp | The latest timestamp of all the acknowledged timestamps of the consumers. |
msgRateRedeliver | The total rate of messages redelivered on this subscription (message per second). |
chunkedMessageRate | The chunked message dispatch rate. |
earliestMsgPublishTimeInBacklog | The publish time of the earliest message in the backlog for the subscription (in milliseconds). |
msgBacklogNoDelayed | The number of messages in the subscription backlog that do not contain the delay messages. |
blockedSubscriptionOnUnackedMsgs | The flag to verify if a subscription is blocked due to reaching the threshold of unacked messages. |
msgDelayed | The number of delayed messages that are currently tracked. |
unackedMessages | The number of unacknowledged messages for the subscription, where an unacknowledged message is one that has been sent to a consumer but not yet acknowledged. This field is only meaningful when using a subscription that tracks individual message acknowledgment. |
activeConsumerName | The name of the consumer that is active for single active consumer subscriptions (such as failover or exclusive). |
totalMsgExpired | The total messages expired on this subscription. |
lastMarkDeleteAdvancedTimestamp | The last MarkDelete position advanced timestamp. |
durable | Whether the subscription is durable or ephemeral (for example, from a reader). |
replicated | Mark that the subscription state is kept in sync across different regions. |
allowOutOfOrderDelivery | Whether out-of-order delivery is allowed on the Key_Shared subscription. |
keySharedMode | The options of the Key_Shared subscription mode include AUTO_SPLIT or STICKY . |
consumersAfterMarkDeletePosition | Get recentlyJoinedConsumers for the Key_Shared subscription. |
lastSentPosition | The position that all messages up to that position have been dispatched to the consumers. This is for Key_Shared subscription. |
individuallySentPositions | Set of individually sent ranges. This is for Key_Shared subscription. |
filterProcessedMsgCount | The number of messages processed by EntryFilter . |
filterAcceptedMsgCount | The number of messages accepted by EntryFilter . |
filterRejectedMsgCount | The number of messages rejected by EntryFilter . |
filterRescheduledMsgCount | The number of messages rescheduled by EntryFilter . |
bytesOutCounter | The total bytes delivered to a consumer. |
msgOutCounter | The total messages delivered to a consumer. |
backlogSize | The size of backlog for this subscription (in bytes). |
nonContiguousDeletedMessagesRanges | The number of non-contiguous deleted messages ranges. |
nonContiguousDeletedMessagesRangesSerializedSize | The serialized size of non-contiguous deleted messages ranges. |
consumers | The list of connected consumers for this subscription. |
Consumer stats
Stat | Description |
---|
consumerName | Internal identifier for this consumer, generated by the client library. |
msgRateOut | The total rate of messages (message per second) delivered to the consumer. |
msgThroughputOut | The total throughput (byte per second) delivered to the consumer. |
availablePermits | The number of messages that the consumer has space for in the client library’s listening queue. 0 means the client library’s queue is full and receive() isn’t called. A non-zero value means this consumer is ready for dispatched messages. |
unackedMessages | The number of unacknowledged messages for the consumer, where an unacknowledged message has been sent to the consumer but not yet acknowledged. This field is only meaningful when using a subscription that tracks individual message acknowledgment. |
blockedConsumerOnUnackedMsgs | The flag used to verify if the consumer is blocked due to reaching the threshold of the unacknowledged messages. |
lastConsumedTimestamp (Deprecated) | The timestamp when the consumer reads a message the last time. |
lastConsumedTime | The time when the consumer reads a message the last time. |
lastAckedTimestamp (Deprecated) | The timestamp when the consumer acknowledges a message the last time. |
lastAckedTime | The time when the consumer acknowledges a message the last time. |
address | The IP address and source port for the connection of this consumer. |
connectedSince | The timestamp when this consumer is created or reconnected last time. |
clientVersion | The client library version of this consumer. |
bytesOutCounter | The total bytes delivered to a consumer. |
msgOutCounter | The total messages delivered to a consumer. |
msgRateRedeliver | The total rate of messages redelivered by this consumer (message per second). |
chunkedMessageRate | The total rate of chunked messages delivered to this consumer. |
avgMessagesPerEntry | The number of average messages per entry for the consumer consumed. |
lastSentPositionWhenJoining | The last sent position of the cursor when the consumer joins. |
keyHashRanges | The hash ranges assigned to this consumer if it uses Key_Shared sub mode. |
metadata | The metadata (key/value strings) associated with this consumer. |
Replication stats
Stat | Description |
---|
msgRateIn | The total rate (message per second) of messages received from the remote cluster. |
msgThroughputIn | The total throughput (byte per second) received from the remote cluster. |
msgRateOut | The total rate of messages (message per second) delivered to the replication-subscriber. |
msgThroughputOut | The total throughput (byte per second) delivered to the replication-subscriber. |
msgRateExpired | The total rate of messages (message per second) expired. |
replicationBacklog | The number of messages pending to be replicated to remote cluster. |
connected | Whether the outbound replicator is connected. |
replicationDelayInSeconds | How long the oldest message has been waiting to be sent through the connection when connected. |
inboundConnection | The IP and port of the broker in the remote cluster’s publisher connection to this broker. |
inboundConnectedSince | The TCP connection used to publish messages to the remote cluster. If no local publishers are connected, this connection is automatically closed after a minute. |
outboundConnection | The address of the outbound replication connection. |
outboundConnectedSince | The timestamp of establishing an outbound connection. |
Topic internal stats
The following table outlines the internal stats inside a topic. For more details about how to get these stats, see Get stats.
Stat | Description |
---|
entriesAddedCounter | Messages published since this broker loads this topic. |
numberOfEntries | The total number of messages tracked. |
totalSize | The total storage size in bytes of all messages. |
currentLedgerEntries | The count of messages written to the ledger that is currently open for writing. |
currentLedgerSize | The size in bytes of messages written to the ledger that is currently open for writing. |
lastLedgerCreatedTimestamp | The time when the last ledger is created. |
lastLedgerCreationFailureTimestamp | The time when the last ledger is failed. |
waitingCursorsCount | The number of cursors that are caught up and waiting for a new message to be published. |
pendingAddEntriesCount | The number of messages that have write requests (asynchronous) waiting on completion. |
lastConfirmedEntry | The ledgerid:entryid of the last message that is written successfully. If the entryid is -1 , then the ledger is opened or is currently opened but has no entries written yet. |
state | The state of the cursor ledger. The state LedgerOpened means that a ledger is open for saving published messages. |
ledgers | The ordered list of all ledgers for this topic that holds its messages. |
cursors | The list of all cursors on this topic. Each subscription in the topic stats has a cursor. |
markDeletePosition | The ack position: the last message that the subscriber acknowledges. All messages before this position are acknowledged by the subscriber. |
readPosition | The latest position of the subscriber for reading messages. |
waitingReadOp | This is true when the subscription reads the latest message that is published to the topic and waits for new messages to be published. |
pendingReadOps | The count of outstanding read requests to the BookKeepers in progress. |
messagesConsumedCounter | The number of messages this cursor has acknowledged since this broker loads this topic. |
cursorLedger | The ledger used to persistently store the current markDeletePosition . |
cursorLedgerLastEntry | The last entryid used to persistently store the current markDeletePosition . |
individuallyDeletedMessages | The range of messages acknowledged between markDeletePosition and the readPosition when acknowledges are done out of order. |
lastLedgerSwitchTimestamp | The last time when the cursor ledger is rolled over. |
schemaLedgers | The ordered list of all ledgers for this topic schema. |
compactedLedger | The ledgers holding un-acked messages after topic compaction. |
ledgerId | The ID of this ledger. |
entries | The total number of entries that belong to this ledger. |
size | The size of messages written to this ledger (in bytes). |
offloaded | Whether this ledger is offloaded. The value is false for the compacted topic ledger. |
metadata | The ledger metadata. |