Managing Brokers

Brokers - 图1tip

This page only shows some frequently used operations.

  • For the latest and complete information about Pulsar admin, including commands, flags, descriptions, and more information, see Pulsar admin doc.

  • For the latest and complete information about REST API, including parameters, responses, samples, and more, see REST API doc.

  • For the latest and complete information about Java admin API, including classes, methods, descriptions, and more, see Java admin API doc.

Pulsar brokers consist of two components:

  1. An HTTP server exposing a REST interface administration and topic lookup.
  2. A dispatcher that handles all Pulsar message transfers.

Brokers can be managed via:

  • The brokers command of the pulsar-admin tool
  • The /admin/v2/brokers endpoint of the admin REST API
  • The brokers method of the PulsarAdmin object in the Java API

In addition to being configurable when you start them up, brokers can also be dynamically configured.

For a full listing of broker-specific configuration parameters, see the Configuration page.

Brokers resources

List active brokers

Fetch all available active brokers that are serving traffic with cluster name.

  • pulsar-admin
  • REST API
  • Java
  1. pulsar-admin brokers list use

Example output:

  1. localhost:8080

GET /admin/v2/brokers/:cluster/getActiveBrokers

  1. admin.brokers().getActiveBrokers(clusterName)

Get the information of the leader broker

Fetch the information of the leader broker, for example, the service url.

  • pulsar-admin
  • REST API
  • Java
  1. pulsar-admin brokers leader-broker

Example output:

  1. {
  2.   "serviceUrl" : "http://localhost:8080"
  3. }

GET /admin/v2/brokers/leaderBroker/getLeaderBroker

  1. admin.brokers().getLeaderBroker()

For the detail of the code above, see here

list of namespaces owned by a given broker

It finds all namespaces which are owned and served by a given broker.

  • pulsar-admin
  • REST API
  • Java
  1. pulsar-admin brokers namespaces use \
  2.     --url localhost:8080

Example output:

  1. public/default/0x00000000_0x40000000    [broker_assignment=shared is_controlled=false is_active=true]
  2. public/default/0xc0000000_0xffffffff    [broker_assignment=shared is_controlled=false is_active=true]
  3. public/functions/0x40000000_0x80000000    [broker_assignment=shared is_controlled=false is_active=true]
  4. public/functions/0x00000000_0x40000000    [broker_assignment=shared is_controlled=false is_active=true]
  5. pulsar/standalone/localhost:8080/0x00000000_0xffffffff    [broker_assignment=shared is_controlled=false is_active=true]
  6. pulsar/localhost:8080/0x00000000_0xffffffff    [broker_assignment=shared is_controlled=false is_active=true]
  7. public/functions/0x80000000_0xc0000000    [broker_assignment=shared is_controlled=false is_active=true]
  8. public/default/0x80000000_0xc0000000    [broker_assignment=shared is_controlled=false is_active=true]

GET /admin/v2/brokers/:cluster/:broker/ownedNamespaces/getOwnedNamespaes

  1. admin.brokers().getOwnedNamespaces(cluster,brokerUrl);

Dynamic broker configuration

One way to configure a Pulsar broker is to supply a configuration when the broker is started up.

But since all broker configuration in Pulsar is stored in ZooKeeper, configuration values can also be dynamically updated while the broker is running. When you update broker configuration dynamically, ZooKeeper will notify the broker of the change and the broker will then override any existing configuration values.

  • The brokers command for the pulsar-admin tool has a variety of subcommands that enable you to manipulate a broker’s configuration dynamically, enabling you to update config values and more.
  • In the Pulsar admin REST API, dynamic configuration is managed through the /admin/v2/brokers/configuration endpoint.

Update dynamic configuration

  • pulsar-admin
  • REST API
  • Java

The update-dynamic-config subcommand will update existing configuration. It takes two arguments: the name of the parameter and the new value using the config and value flag respectively. Here’s an example of the brokerShutdownTimeoutMs parameter:

  1. pulsar-admin brokers update-dynamic-config --config brokerShutdownTimeoutMs --value 100

POST /admin/v2/brokers/configuration/:configName/:configValue/updateDynamicConfiguration

  1. admin.brokers().updateDynamicConfiguration(configName, configValue);

List updated values

Fetch a list of all potentially updatable configuration parameters.

  • pulsar-admin
  • REST API
  • Java
  1. pulsar-admin brokers list-dynamic-config

Example output:

  1. forceDeleteNamespaceAllowed
  2. loadBalancerMemoryResourceWeight
  3. allowAutoTopicCreation
  4. brokerDeleteInactivePartitionedTopicMetadataEnabled
  5. managedLedgerInactiveLedgerRolloverTimeSeconds
  6. loadBalancerNamespaceBundleMaxMsgRate
  7. resourceUsageTransportPublishIntervalInSecs
  8. # omit...

GET /admin/v2/brokers/configuration/getDynamicConfigurationName

  1. admin.brokers().getDynamicConfigurationNames();

List all

Fetch a list of all parameters that have been dynamically updated.

  • pulsar-admin
  • REST API
  • Java
  1. pulsar-admin brokers get-all-dynamic-config

Example output:

  1. brokerShutdownTimeoutMs    100

GET /admin/v2/brokers/configuration/values/getAllDynamicConfigurations

  1. admin.brokers().getAllDynamicConfigurations();