This section describes how to configure the scheduling rate limit at the store level.

TiKV balance regions by the command sent by PD. The commands are called scheduling operators. PD makes scheduling operators based on the information gathered from TiKV and scheduling configurations.

*-schedule-limit in pd-ctl is usually used to set limits of the total number of various operators, but it may cause performance bottlenecks because it applies to the entire cluster. In this section, we will learn how to configure the rate limit at the store level.

Configure scheduling rate limits on stores

PD provides two methods to configure scheduling rate limits on stores, listed below:

  1. Permanently set scheduling rate limits by store-balance-rate in pd-ctl.

    The configuration change only applies to the stores started afterward, thus will be applied to all stores in the cluster only if you restart all TiKV. If you want to apply this change immediately, see the workaround below.

    store-balance-rate specifies the maximum number of scheduling tasks allowed for each store per minute. The scheduling step includes adding peers or learners.

    1. » config set store-balance-rate 20

  2. Temporarily set scheduling rate limits by limit in pd-ctl.

    The scheduling rate limit set by this method will be lost after restarting TiKV, and then the value previously set by method 1 will be used.

    • stores set limit <rate>

      1. # Set the maximum number of scheduling operators per minute to be 20. Apply to all stores.
      2. » stores set limit 20

    • store limit <store_id> <rate>

      1. # Set the maximum number of scheduling operators per minute to be 20. Apply to store 2.
      2. » store limit 2 10

Read current scheduling rate limits on stores

  • store show limit

    1. » stores show limit
    2. {
    3.     "4": {
    4.         "rate": 15
    5.     },
    6.     "5": {
    7.         "rate": 15
    8.     },
    9.     # ...
    10. }

Workaround

  • Combining method 1 and method 2, permanently modify the rate limit to 20 and applies immediately.

    1. » config set store-balance-rate 20
    2. » stores set limit 20