Pulsar configuration

您可以通过 Pulsar 安装包下的 conf 目录中的配置文件来管理 Pulsar 配置。

• BookKeeper
• Broker
• Client
• 服务发现
• Log4j
• Log4j shell
• Standalone
• WebSocket
• Pulsar 代理
• ZooKeeper

BookKeeper

BookKeeper 是一个冗余的日志存储系统，Pulsar 用它来持久化存储所有消息。

Broker

Pulsar broker 负责处理从生产者发出消息、向消费者派发消息、在集群间复制数据等。

<th>
  说明
</th>
<th>
  默认值
</th>

<td>
  Specify multiple advertised listeners for the broker.<br><br>The format is <code>&lt;listener_name&gt;:pulsar://&lt;host&gt;:&lt;port&gt;</code>.<br><br>If there are multiple listeners, separate them with commas.<br><br><strong x-id="1">Note</strong>: do not use this configuration with <code>advertisedAddress</code> and <code>brokerServicePort</code>. If the value of this configuration is empty, the broker uses <code>advertisedAddress</code> and <code>brokerServicePort</code>
</td>
<td>
  /
</td>

<td>
  Specify the internal listener name for the broker.<br><br><strong x-id="1">Note</strong>: the listener name must be contained in <code>advertisedListeners</code>.<br><br> If the value of this configuration is empty, the broker uses the first listener as the internal listener.
</td>
<td>
  /
</td>

<td>
  If this flag is set to <code>true</code>, the broker authenticates the original Auth data; else it just accepts the originalPrincipal and authorizes it (if required).
</td>
<td>
  false
</td>

<td>
  Whether persistent topics are enabled on the broker
</td>
<td>
  true
</td>

<td>
  Whether non-persistent topics are enabled on the broker
</td>
<td>
  true
</td>

<td>
  Whether the Pulsar Functions worker service is enabled in the broker
</td>
<td>
  false
</td>

<td>
  Whether to enable topic level metrics.
</td>
<td>
  true
</td>

<td>
</td>
<td>
  60
</td>

<td>
</td>
<td>
  60
</td>

<td>
  Zookeeper quorum connection string
</td>
<td>
</td>

<td>
  ZooKeeper 缓存过期时间（秒）
</td>
<td>
  300
</td>

<td>
  配置存储连接字符串（以逗号分隔的列表）
</td>
<td>
</td>

<td>
  Broker data port
</td>
<td>
  6650
</td>

<td>
  Broker data port for TLS
</td>
<td>
  6651
</td>

<td>
  Port to use to server HTTP request
</td>
<td>
  8080
</td>

<td>
  Port to use to server HTTPS request
</td>
<td>
  8443
</td>

<td>
  Enable the WebSocket API service in broker
</td>
<td>
  false
</td>

<td>
  The number of IO threads in Pulsar Client used in WebSocket proxy.
</td>
<td>
  8
</td>

<td>
  The number of connections per Broker in Pulsar Client used in WebSocket proxy.
</td>
<td>
  8
</td>

<td>
  Time in milliseconds that idle WebSocket session times out.
</td>
<td>
  300000
</td>

<td>
  The maximum size of a text message during parsing in WebSocket proxy.
</td>
<td>
  1048576
</td>

<td>
  Whether to enable topic level metrics.
</td>
<td>
  true
</td>

<td>
  Whether to enable consumer level metrics.
</td>
<td>
  false
</td>

<td>
  Classname of Pluggable JVM GC metrics logger that can log GC specific metrics.
</td>
<td>
  N/A
</td>

<td>
  Hostname or IP address the service binds on, default is 0.0.0.0.
</td>
<td>
  0.0.0.0
</td>

<td>
  服务对外发布的主机名或 IP 地址。 如果未设置，将使用 <code>InnetAddress.getLocalHost().getHostName()</code> 的值。
</td>
<td>
</td>

<td>
  Name of the cluster to which this broker belongs to
</td>
<td>
</td>

<td>
  The maximum number of tenants that can be created in each Pulsar cluster. 当租户的数量达到阈值时， broker会拒绝创建新租户的请求。 The default value 0 disables the check.
</td>
<td>
  0
</td>

<td>
  The maximum number of namespaces that can be created in each tenant. When the number of namespaces reaches this threshold, the broker rejects the request of creating a new tenant. The default value 0 disables the check.
</td>
<td>
  0
</td>

<td>
  Sets the default behavior for message deduplication in the broker. If enabled, the broker will reject messages that were already stored in the topic. This setting can be overridden on a per-namespace basis.
</td>
<td>
  false
</td>

<td>
  The maximum number of producers for which information will be stored for deduplication purposes.
</td>
<td>
  10000
</td>

<td>
  去重快照生成后，允许存储的去重信息数量。 A larger interval will lead to fewer snapshots being taken, though this would also lengthen the topic recovery time (the time required for entries published after the snapshot to be replayed).
</td>
<td>
  1000
</td>

<td>
  The time period after which a deduplication informational snapshot is taken. It runs simultaneously with <code>brokerDeduplicationEntriesInterval</code>.
</td>
<td>
  120
</td>

<td>
  The time of inactivity (in minutes) after which the broker will discard deduplication information related to a disconnected producer.
</td>
<td>
  360
</td>

<td>
  The default messages per second dispatch throttling-limit for every replicator in replication. The value of <code>0</code> means disabling replication message dispatch-throttling
</td>
<td>
  0
</td>

<td>
  The default bytes per second dispatch throttling-limit for every replicator in replication. The value of <code>0</code> means disabling replication message-byte dispatch-throttling
</td>
<td>
  0
</td>

<td>
  Zookeeper session timeout in milliseconds
</td>
<td>
  30000
</td>

<td>
  等待 broker 关闭的时长。 达到本设置时间之后，将会直接关掉进程。
</td>
<td>
  60000
</td>

<td>
  Flag to skip broker shutdown when broker handles Out of memory error.
</td>
<td>
  false
</td>

<td>
  打开 backlog 配额检查。 当某个 Topic 已经达到配额，将会采取强制行动。
</td>
<td>
  true
</td>

<td>
  How often to check for topics that have reached the quota
</td>
<td>
  60
</td>

<td>
  The default per-topic backlog quota limit. Being less than 0 means no limitation. By default, it is -1.
</td>
<td>
  -1
</td>

<td>
  The defaulted backlog quota retention policy. By Default, it is <code>producer_request_hold</code>. <li>'producer_request_hold'保持生产者的发送请求，直到资源可用（或保持时间过长）的策略。</li> <li>'producer_exception' Policy which throws `javax.jms.ResourceAllocationException` to the producer </li><li>'consumer_backlog_eviction' 驱逐最慢的消费者积压的最旧信息的策略</li>
</td>
<td>
  producer_request_hold
</td>

<td>
  Enable topic auto creation if a new producer or consumer connected
</td>
<td>
  true
</td>

<td>
  The type of topic that is allowed to be automatically created.(partitioned/non-partitioned)
</td>
<td>
  non-partitioned
</td>

<td>
  Enable subscription auto creation if a new consumer connected
</td>
<td>
  true
</td>

<td>
  The number of partitioned topics that is allowed to be automatically created if <code>allowAutoTopicCreationType</code> is partitioned
</td>
<td>
  1
</td>

<td>
  Enable the deletion of inactive topics
</td>
<td>
  true
</td>

<td>
  How often to check for inactive topics
</td>
<td>
  60
</td>

<td>
  Set the mode to delete inactive topics. <li> <code>delete_when_no_subscriptions</code>: 删除没有订阅或活动生产者的主题。 <li> <code>delete_when_subscriptions_caught_up</code>: delete the topic whose subscriptions have no backlogs and which has no active producers or consumers.
</td>
<td>
  <code>delete_when_no_subscriptions</code>
</td>

<td>
  Set the maximum duration for inactive topics. If it is not specified, the <code>brokerDeleteInactiveTopicsFrequencySeconds</code> parameter is adopted.
</td>
<td>
  N/A
</td>

<td>
  Enable you to delete a tenant forcefully.
</td>
<td>
  false
</td>

<td>
  Enable you to delete a namespace forcefully.
</td>
<td>
  false
</td>

<td>
  The frequency of proactively checking and purging expired messages.
</td>
<td>
  5
</td>

<td>
  Interval between checks to determine whether topics with compaction policies need compaction.
</td>
<td>
  60
</td>

brokerServiceCompactionThresholdInBytes|If the estimated backlog size is greater than this threshold, compression is triggered.

Set this threshold to 0 means disabling the compression check.|N/A |delayedDeliveryEnabled| Whether to enable the delayed delivery for messages. 如果禁用，消息将被立即发送，并且没有跟踪开销。|true||delayedDeliveryTickTimeMillis|控制延迟发送时重试的时间，这将影响投递时间与预定时间相比的准确性。 默认情况下，它是 1 秒.|1000| |ActiveConsumerFailoverDelayTimeMillis| 当活动消费者改变时，延时多长时间才能延迟光标和发送消息。 |1000| |clientLibraryVersionCheckEnabled|启用允许的最小客户端库版本检查|false| |clientLibraryVersionCheckAllowUnversioned|允许没有版本信息的客户端库|true| ||statusFilePath|在响应服务发现健康检查时用于确定代理的rotation状态的文件路径| |preferLaterVersions|如果为真。(并且正在使用ModularLoadManagerImpl），负载管理器将尝试只使用运行最新软件版本的broker（以尽量减少对bundle的影响）|false| |maxNumPartitionsPerPartitionedTopic|每个分区主题的最大分区数 使用0或负数来禁用检查。 | maxSubscriptionsPerTopic | 一个主题允许订阅的最大订阅数。 一旦达到这个限制， broker就会拒绝新的订阅，直到订阅的数量减少。 当值设置为 0时，发布限制将被禁用。 | 0 | | maxProducersPerTopic | 允许生产者连接到主题的最大数量。 Once this limit reaches, the broker rejects new producers until the number of connected producers decreases. 当值设置为 0时，发布限制将被禁用。 | 0 | | maxConsumersPerTopic | 允许消费者连接到主题的最大数量。 Once this limit reaches, the broker rejects new consumers until the number of connected consumers decreases. 当值设置为 0时，发布限制将被禁用。 | 0 | | maxConsumersPerTopic | 允许连接到一个订阅的最大消费者数量。 Once this limit reaches, the broker rejects new consumers until the number of connected consumers decreases. 当值设置为 0时，发布限制将被禁用。 | 0 | |tlsEnabled|Deprecated - Use

webServicePortTls and brokerServicePortTls instead. |false| |tlsCertificateFilePath| Path for the TLS certificate file || |tlsKeyFilePath| Path for the TLS private key file || |tlsTrustCertsFilePath| Path for the trusted TLS certificate file. 此证书用于验证通过连接客户端提供的任何证书由证书机构签名。 If this verification fails, then the certs are untrusted and the connections are dropped. || |tlsAllowInsecureConnection|接受来自客户端的不被信任的TLS证书。 If it is set to true, a client with a cert which cannot be verified with the ‘tlsTrustCertsFilePath’ cert will be allowed to connect to the server, though the cert will not be used for client authentication. |false| |tlsProtocol|指定broker在TLS Handake期间将使用的 tls 协议。 Multiple values can be specified, separated by commas. Example:- TLSv1.3, TLSv1.2 || |tlsCiphers|Specify the tls cipher the broker will use to negotiate during TLS Handshake. Multiple values can be specified, separated by commas. Example:- TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256|| |tlsEnabledWithKeyStore| Enable TLS with KeyStore type configuration in broker |false| |tlsProvider| TLS Provider for KeyStore type || |tlsKeyStoreType| LS KeyStore type configuration in broker: JKS, PKCS12 |JKS| |tlsKeyStore| TLS KeyStore path in broker || |tlsKeyStorePassword| TLS KeyStore password for broker || |brokerClientTlsEnabledWithKeyStore| Whether internal client use KeyStore type to authenticate with Pulsar brokers |false| |brokerClientSslProvider| The TLS Provider used by internal client to authenticate with other Pulsar brokers || |brokerClientTlsTrustStoreType| TLS TrustStore type configuration for internal client: JKS, PKCS12, used by the internal client to authenticate with Pulsar brokers |JKS| |brokerClientTlsTrustStore| TLS TrustStore path for internal client, used by the internal client to authenticate with Pulsar brokers || |brokerClientTlsTrustStorePassword| TLS TrustStore password for internal client, used by the internal client to authenticate with Pulsar brokers || |brokerClientTlsCiphers| Specify the tls cipher the internal client will use to negotiate during TLS Handshake. (逗号分隔的密码列表），例如：[TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256]||。 |brokerClientTlsProtocols|指定broker在TLS握手期间将使用的TLS协议。 (逗号分隔的协议名称列表)。 e.g. TLSv1.3, TLSv1.2 || |ttlDurationDefaultInSeconds|The default Time to Live (TTL) for namespaces if the TTL is not configured at namespace policies. When the value is set to 0, TTL is disabled. By default, TTL is disabled. |0| |tokenSettingPrefix| Configure the prefix of the token related setting like tokenSecretKey, tokenPublicKey, tokenAuthClaim, tokenPublicAlg, tokenAudienceClaim, and tokenAudience. || |tokenSecretKey| Configure the secret key to be used to validate auth tokens. The key can be specified like: tokenSecretKey=data:;base64,xxxxxxxxx or tokenSecretKey=file:///my/secret.key. Note: key file must be DER-encoded.|| |tokenPublicKey| Configure the public key to be used to validate auth tokens. The key can be specified like: tokenPublicKey=data:;base64,xxxxxxxxx or tokenPublicKey=file:///my/secret.key. 注意：密钥文件必须是 DER-encoded.|| |tokenPublicAlg| 配置用于验证认证令牌的算法。 这可以是Java JWT 支持的任意一种非对称算法 (https://github.com/jwtk/jjwt#signature-algorithms-keys) |RS256| |tokenAuthClaim| Specify which of the token’s claims will be used as the authentication “principal” or “role”. 如果这里留空，则默认的”sub” claim 会被使用 || |tokenAudienceClaim| 令牌受众的 “claim” 名称，比如”aud”会用于从令牌获取受众。 If not set, audience will not be verified. || |tokenAudience| 该 broker 的令牌受众。 The field tokenAudienceClaim of a valid token, need contains this. || |maxUnackedMessagesPerConsumer|允许共享订阅中的消费者接收的未确认信息的最大数量。 Broker will stop sending messages to consumer once, this limit reaches until consumer starts acknowledging messages back. 使用0，就是禁用未确认消息限制检查，消费者可以不受任何限制地接收消息。 |maxUnackedMessagesPerSubscription|每个共享订阅允许的未确认信息的最大数量。 Broker will stop dispatching messages to all consumers of the subscription once this limit reaches until consumer starts acknowledging messages back and unack count reaches to limit/2. 使用 0 值，禁用 unackedMessage-limit 检查且调度器可以不受任何限制地发送消息 |200000| |subscriptionRedeliveryTrackerEnabled| 启用订阅消息重送跟踪 |true| subscriptionExpirationTimeMinutes | 删除上次消费后非活动订阅的时间。

Setting this configuration to a value greater than 0 deletes inactive subscriptions automatically.
Setting this configuration to 0 does not delete inactive subscriptions automatically.

Since this configuration takes effect on all topics, if there is even one topic whose subscriptions should not be deleted automatically, you need to set it to 0.
Instead, you can set a subscription expiration time for each namespace using the pulsar-admin namespaces set-subscription-expiration-time options command. | 0 | |maxConcurrentLookupRequest| 最大的并发查询请求数， broker允许节制大量的传入查询流量 |50000| |maxConcurrentTopicLoadRequest| 最大并发主题加载请求数，代理允许控制zk-operations的数量 |5000| |authenticationEnabled|启用认证|false| |authenticationProviders| 认证提供者名称列表，是以逗号分隔的类名列表。 |认证更新检查时间|检查过期认证凭证的时间间隔|60| |authorizationEnabled| 强制授权|false| |superUserRoles|被视为 “超级用户 “的角色名称，这意味着他们将能够进行所有的管理操作，并从所有主题发布/消费|| |brokerClientAuthenticationPlugin| broker本身的认证设置。 Used when the broker connects to other brokers, either in same or other clusters || |brokerClientAuthenticationParameters||| |athenzDomainNames| Supported Athenz provider domain names(comma separated) for authentication || |exposePreciseBacklogInPrometheus| Enable expose the precise backlog stats, set false to use published counter and consumed counter to calculate, this would be more efficient but may be inaccurate. |false| |schemaRegistryStorageClassName|The schema storage implementation used by this broker.|org.apache.pulsar.broker.service.schema.BookkeeperSchemaStorageFactory| |isSchemaValidationEnforced|Enforce schema validation on following cases: if a producer without a schema attempts to produce to a topic with schema, the producer will be failed to connect. PLEASE be carefully on using this, since non-java clients don’t support schema. If this setting is enabled, then non-java clients fail to produce.|false| | topicFencingTimeoutSeconds | If a topic remains fenced for a certain time period (in seconds), it is closed forcefully. 如果设置为 0 或负数，则围栏主题不会关闭。 | 0 | |offloadersDirectory|所有卸载器实现的目录，|./offloaders|。 |bookkeeperMetadataServiceUri|元数据服务URI，bookkeeper用于加载相应的元数据驱动并解析其元数据服务位置。 This value can be fetched using bookkeeper shell whatisinstanceid command in BookKeeper cluster. 例如： zk+hierarchical://localhost:2181/ledgers。 元数据服务URI列表也可以是分号分隔的值，如下所示。zk+hierarchical://zk1:2181;zk2:2181;zk3:2181/ledgers || |bookkeeperClientAuthenticationPlugin| 连接bookies时使用的认证插件 || |bookkeeperClientAuthenticationParametersName| BookKeeper auth插件实施的具体参数名称和值|| |bookkeeperClientAuthenticationParameters|||| |bookkeeperClientNumWorkerThreads|| BookKeeper客户端工作线程的数量。 默认为Runtime.getRuntime().availableProcessors() || |bookkeeperClientTimeoutInSeconds|BK添加/读取操作的超时|30| |bookkeeperClientSpeculativeReadTimeoutInMillis|如果读取请求在一定时间内没有完成，就会启动推测性读取 使用0值，就是禁用推测性读取|0| |bookkeeperNumberOfChannelsPerBookie|每个bookie的通道数量 |16| |bookkeeperClientHealthCheckEnabled| 启用bookie健康检查。 Bookies that have more than the configured number of failure within the interval will be quarantined for some time. During this period, new ledgers won’t be created on these bookies |true| |bookkeeperClientHealthCheckIntervalSeconds||60| |bookkeeperClientHealthCheckErrorThresholdPerInterval||5| |bookkeeperClientHealthCheckQuarantineTimeInSeconds ||1800| |bookkeeperClientRackawarePolicyEnabled| Enable rack-aware bookie selection policy. BK will chose bookies from different racks when forming a new bookie ensemble |true| |bookkeeperClientRegionawarePolicyEnabled| Enable region-aware bookie selection policy. BK will chose bookies from different regions and racks when forming a new bookie ensemble. 如果启用，bookkeeperClientRackawarePolicyEnabled的值将被忽略|false| |bookkeeperClientMinNumRacksPerWriteQuorum|每个写入法定数的最小机架数。 BK rack-aware bookie selection policy will try to get bookies from at least ‘bookkeeperClientMinNumRacksPerWriteQuorum’ racks for a write quorum. |2| |bookkeeperClientEnforceMinNumRacksPerWriteQuorum|执行机架感知的bookies选择策略，从’bookkeeperClientMinNumRacksPerWriteQuorum’机架中挑选bookies进行写入Quorum。 If BK can’t find bookie then it would throw BKNotEnoughBookiesException instead of picking random one. |false| |bookkeeperClientReorderReadSequenceEnabled| 启用/禁用在读取条目时重新安排读取顺序。 |false| |bookkeeperClientIsolationGroups| Enable bookie isolation by specifying a list of bookie groups to choose from. Any bookie outside the specified groups will not be used by the broker || |bookkeeperClientSecondaryIsolationGroups| Enable bookie secondary-isolation group if bookkeeperClientIsolationGroups doesn’t have enough bookie available. || |bookkeeperClientMinAvailableBookiesInIsolationGroups| Minimum bookies that should be available as part of bookkeeperClientIsolationGroups else broker will include bookkeeperClientSecondaryIsolationGroups bookies in isolated list. || |bookkeeperClientGetBookieInfoIntervalSeconds| Set the interval to periodically check bookie info |86400| |bookkeeperClientGetBookieInfoRetryIntervalSeconds| Set the interval to retry a failed bookie info lookup |60| |bookkeeperEnableStickyReads | Enable/disable having read operations for a ledger to be sticky to a single bookie. If this flag is enabled, the client will use one single bookie (by preference) to read all entries for a ledger. | true | |managedLedgerDefaultEnsembleSize| Number of bookies to use when creating a ledger |2| |managedLedgerDefaultWriteQuorum| Number of copies to store for each message |2| |managedLedgerDefaultAckQuorum| Number of guaranteed copies (acks to wait before write is complete) |2| |managedLedgerCacheSizeMB| Amount of memory to use for caching data payload in managed ledger. This memory is allocated from JVM direct memory and it’s shared across all the topics running in the same broker. By default, uses 1/5th of available direct memory || |managedLedgerCacheCopyEntries| Whether we should make a copy of the entry payloads when inserting in cache| false| |managedLedgerCacheEvictionWatermark| Threshold to which bring down the cache level when eviction is triggered |0.9| |managedLedgerCacheEvictionFrequency| Configure the cache eviction frequency for the managed ledger cache (evictions/sec) | 100.0 | |managedLedgerCacheEvictionTimeThresholdMillis| All entries that have stayed in cache for more than the configured time, will be evicted | 1000 | |managedLedgerCursorBackloggedThreshold| Configure the threshold (in number of entries) from where a cursor should be considered ‘backlogged’ and thus should be set as inactive. | 1000| |managedLedgerDefaultMarkDeleteRateLimit| 限制由消费者确认消息产生的每秒写入频率 |1.0| |managedLedgerMaxEntriesPerLedger| 在触发倒转前追加至 ledger 的最大条目数。 A ledger rollover is triggered after the min rollover time has passed and one of the following conditions is true:

• 已达到最大滚动时间
• The max entries have been written to the ledger
• The max ledger size has been written to the ledger

|50000| |managedLedgerMinLedgerRolloverTimeMinutes| Minimum time between ledger rollover for a topic |10| |managedLedgerMaxLedgerRolloverTimeMinutes| Maximum time before forcing a ledger rollover for a topic |240| |managedLedgerCursorMaxEntriesPerLedger| Max number of entries to append to a cursor ledger |50000| |managedLedgerCursorRolloverTimeInSeconds| Max time before triggering a rollover on a cursor ledger |14400| |managedLedgerMaxUnackedRangesToPersist| Max number of “acknowledgment holes” that are going to be persistently stored. When acknowledging out of order, a consumer will leave holes that are supposed to be quickly filled by acking all the messages. The information of which messages are acknowledged is persisted by compressing in “ranges” of messages that were acknowledged. After the max number of ranges is reached, the information will only be tracked in memory and messages will be redelivered in case of crashes. |1000| |autoSkipNonRecoverableData| Skip reading non-recoverable/unreadable data-ledger under managed-ledger’s list.It helps when data-ledgers gets corrupted at bookkeeper and managed-cursor is stuck at that ledger. |false| |loadBalancerEnabled| Enable load balancer |true| |loadBalancerPlacementStrategy| Strategy to assign a new bundle weightedRandomSelection || |loadBalancerReportUpdateThresholdPercentage| Percentage of change to trigger load report update |10| |loadBalancerReportUpdateMaxIntervalMinutes| maximum interval to update load report |15| |loadBalancerHostUsageCheckIntervalMinutes| Frequency of report to collect |1| |loadBalancerSheddingIntervalMinutes| Load shedding interval. Broker periodically checks whether some traffic should be offload from some over-loaded broker to other under-loaded brokers |30| |loadBalancerSheddingGracePeriodMinutes| Prevent the same topics to be shed and moved to other broker more than once within this timeframe |30| |loadBalancerBrokerMaxTopics| Usage threshold to allocate max number of topics to broker |50000| |loadBalancerBrokerUnderloadedThresholdPercentage| Usage threshold to determine a broker as under-loaded |1| |loadBalancerBrokerOverloadedThresholdPercentage| Usage threshold to determine a broker as over-loaded |85| |loadBalancerResourceQuotaUpdateIntervalMinutes| Interval to update namespace bundle resource quota |15| |loadBalancerBrokerComfortLoadLevelPercentage| Usage threshold to determine a broker is having just right level of load |65| |loadBalancerAutoBundleSplitEnabled| enable/disable namespace bundle auto split |false| |loadBalancerNamespaceBundleMaxTopics| maximum topics in a bundle, otherwise bundle split will be triggered |1000| |loadBalancerNamespaceBundleMaxSessions| maximum sessions (producers + consumers) in a bundle, otherwise bundle split will be triggered |1000| |loadBalancerNamespaceBundleMaxMsgRate| maximum msgRate (in + out) in a bundle, otherwise bundle split will be triggered |1000| |loadBalancerNamespaceBundleMaxBandwidthMbytes| maximum bandwidth (in + out) in a bundle, otherwise bundle split will be triggered |100| |loadBalancerNamespaceMaximumBundles| maximum number of bundles in a namespace |128| |replicationMetricsEnabled| Enable replication metrics |true| |replicationConnectionsPerBroker| Max number of connections to open for each broker in a remote cluster More connections host-to-host lead to better throughput over high-latency links. |16| |replicationProducerQueueSize| Replicator producer queue size |1000| |replicatorPrefix| Replicator prefix used for replicator producer name and cursor name pulsar.repl|| |replicationTlsEnabled| Enable TLS when talking with other clusters to replicate messages |false| |brokerServicePurgeInactiveFrequencyInSeconds|Deprecated. Use brokerDeleteInactiveTopicsFrequencySeconds.|60| |transactionCoordinatorEnabled|Whether to enable transaction coordinator in broker.|true| |transactionMetadataStoreProviderClassName| |org.apache.pulsar.transaction.coordinator.impl.InMemTransactionMetadataStoreProvider| |defaultRetentionTimeInMinutes| Default message retention time |0| |defaultRetentionSizeInMB| Default retention size |0| |keepAliveIntervalSeconds| How often to check whether the connections are still alive |30| |bootstrapNamespaces| The bootstrap name. | N/A | |loadManagerClassName| Name of load manager to use |org.apache.pulsar.broker.loadbalance.impl.SimpleLoadManagerImpl| |supportedNamespaceBundleSplitAlgorithms| Supported algorithms name for namespace bundle split |[range_equally_divide,topic_count_equally_divide]| |defaultNamespaceBundleSplitAlgorithm| Default algorithm name for namespace bundle split |range_equally_divide| |managedLedgerOffloadDriver| The directory for all the offloader implementations offloadersDirectory=./offloaders. Driver to use to offload old data to long term storage (Possible values: S3, aws-s3, google-cloud-storage). When using google-cloud-storage, Make sure both Google Cloud Storage and Google Cloud Storage JSON API are enabled for the project (check from Developers Console -> Api&auth -> APIs). || |managedLedgerOffloadMaxThreads| Maximum number of thread pool threads for ledger offloading |2| |managedLedgerOffloadPrefetchRounds|The maximum prefetch rounds for ledger reading for offloading.|1| |managedLedgerUnackedRangesOpenCacheSetEnabled| Use Open Range-Set to cache unacknowledged messages |true| |managedLedgerOffloadDeletionLagMs|Delay between a ledger being successfully offloaded to long term storage and the ledger being deleted from bookkeeper | 14400000| |managedLedgerOffloadAutoTriggerSizeThresholdBytes|The number of bytes before triggering automatic offload to long term storage |-1 (disabled)| |s3ManagedLedgerOffloadRegion| For Amazon S3 ledger offload, AWS region || |s3ManagedLedgerOffloadBucket| For Amazon S3 ledger offload, Bucket to place offloaded ledger into || |s3ManagedLedgerOffloadServiceEndpoint| For Amazon S3 ledger offload, Alternative endpoint to connect to (useful for testing) || |s3ManagedLedgerOffloadMaxBlockSizeInBytes| For Amazon S3 ledger offload, Max block size in bytes. (64MB by default, 5MB minimum) |67108864| |s3ManagedLedgerOffloadReadBufferSizeInBytes| For Amazon S3 ledger offload, Read buffer size in bytes (1MB by default) |1048576| |gcsManagedLedgerOffloadRegion|For Google Cloud Storage ledger offload, region where offload bucket is located. Go to this page for more details: https://cloud.google.com/storage/docs/bucket-locations .|N/A| |gcsManagedLedgerOffloadBucket|For Google Cloud Storage ledger offload, Bucket to place offloaded ledger into.|N/A| |gcsManagedLedgerOffloadMaxBlockSizeInBytes|For Google Cloud Storage ledger offload, the maximum block size in bytes. (64MB by default, 5MB minimum)|67108864| |gcsManagedLedgerOffloadReadBufferSizeInBytes|For Google Cloud Storage ledger offload, Read buffer size in bytes. (1MB by default)|1048576| |gcsManagedLedgerOffloadServiceAccountKeyFile|For Google Cloud Storage, path to json file containing service account credentials. For more details, see the “Service Accounts” section of https://support.google.com/googleapi/answer/6158849 .|N/A| |fileSystemProfilePath|For File System Storage, file system profile path.|../conf/filesystem_offload_core_site.xml| |fileSystemURI|For File System Storage, file system uri.|N/A| |s3ManagedLedgerOffloadRole| For Amazon S3 ledger offload, provide a role to assume before writing to s3 || |s3ManagedLedgerOffloadRoleSessionName| For Amazon S3 ledger offload, provide a role session name when using a role |pulsar-s3-offload| | acknowledgmentAtBatchIndexLevelEnabled | Enable or disable the batch index acknowledgement. | false | |enableReplicatedSubscriptions|Whether to enable tracking of replicated subscriptions state across clusters.|true| |replicatedSubscriptionsSnapshotFrequencyMillis|The frequency of snapshots for replicated subscriptions tracking.|1000| |replicatedSubscriptionsSnapshotTimeoutSeconds|The timeout for building a consistent snapshot for tracking replicated subscriptions state.|30| |replicatedSubscriptionsSnapshotMaxCachedPerSubscription|The maximum number of snapshot to be cached per subscription.|10| |maxMessagePublishBufferSizeInMB|The maximum memory size for a broker to handle messages that are sent by producers. If the processing message size exceeds this value, the broker stops reading data from the connection. The processing messages refer to the messages that are sent to the broker but the broker has not sent response to the client. Usually the messages are waiting to be written to bookies. It is shared across all the topics running in the same broker. The value -1 disables the memory limitation. By default, it is 50% of direct memory.|N/A| |messagePublishBufferCheckIntervalInMillis|Interval between checks to see if message publish buffer size exceeds the maximum. Use 0 or negative number to disable the max publish buffer limiting.|100| |retentionCheckIntervalInSeconds|Check between intervals to see if consumed ledgers need to be trimmed. Use 0 or negative number to disable the check.|120| | maxMessageSize | Set the maximum size of a message. | 5242880 | | preciseTopicPublishRateLimiterEnable | Enable precise topic publish rate limiting. | false | | lazyCursorRecovery | Whether to recover cursors lazily when trying to recover a managed ledger backing a persistent topic. It can improve write availability of topics. The caveat is now when recovered ledger is ready to write we’re not sure if all old consumers’ last mark delete position(ack position) can be recovered or not. So user can make the trade off or have custom logic in application to checkpoint consumer state.| false |
|haProxyProtocolEnabled | Enable or disable the HAProxy protocol. |false| | maxTopicsPerNamespace | The maximum number of persistent topics that can be created in the namespace. When the number of topics reaches this threshold, the broker rejects the request of creating a new topic, including the auto-created topics by the producer or consumer, until the number of connected consumers decreases. The default value 0 disables the check. | 0 | |subscriptionTypesEnabled| Enable all subscription types, which are exclusive, shared, failover, and key_shared. | Exclusive, Shared, Failover, Key_Shared | / managedLedgerInfoCompressionType / ManagedLedgerInfo compression type, option values (NONE, LZ4, ZLIB, ZSTD, SNAPPY), if value is NONE or invalid, the managedLedgerInfo will not be compressed. Notice, after enable this configuration, if you want to degrade broker, you should change the configuration to NONE and make sure all ledger metadata are saved without compression. | None |

Client

You can use the pulsar-client CLI tool to publish messages to and consume messages from Pulsar topics. You can use this tool in place of a client library.

服务发现

Log4j

您可以在 log4j2.yaml 文件中设置日志级别和配置。 以下日志配置参数是可用的：

注意：log4j2.appender 中的“topic”是可配置的。 - 如果你想要将所有日志追加到单个主题，请设置相同的主题名称。 - 如果你想要将日志追加到不同的主题，你可以设置不同的主题名称。

Log4j shell

Standalone

WebSocket

Pulsar 代理

The Pulsar proxy can be configured in the conf/proxy.conf file.

ZooKeeper

ZooKeeper handles a broad range of essential configuration- and coordination-related tasks for Pulsar. The default configuration file for ZooKeeper is in the conf/zookeeper.conf file in your Pulsar installation. The following parameters are available:

In addition to the parameters in the table above, configuring ZooKeeper for Pulsar involves adding a server.N line to the conf/zookeeper.conf file for each node in the ZooKeeper cluster, where N is the number of the ZooKeeper node. Here’s an example for a three-node ZooKeeper cluster:

server.1=zk1.us-west.example.com:2888:3888
server.2=zk2.us-west.example.com:2888:3888
server.3=zk3.us-west.example.com:2888:3888

We strongly recommend consulting the ZooKeeper Administrator’s Guide for a more thorough and comprehensive introduction to ZooKeeper configuration