Recyler is a Doris Compute-storage decoupled component that cleans up expired metadata. The configuration field in DorisDisaggregatedMetaService is recyler.

The Recyler service is a stateless service and is usually deployed in active-standby mode. The simplest configuration is as follows:

  1. spec:
  2.   recycler:
  3.     image: {recylerImage}
  4.     replicas: 2

Among them, {recylerImage} is the image for deploying the Recyler service. Recyler and MS are different ways to start the same program of the metadata management service. Recycler does not have a separate image name, please fill in the image of MS.

Update the modified configuration to the [Compute-storage decoupled metadata management resource](/docs/3.0/install/cluster-deployment/k8s-deploy/compute-storage-decoupled/install-quickstart#Install DorisDisaggregatedMetaService) that needs to be deployed.

Configure resources

Add resource usage restrictions to the Recycler service. Take the 4c 4Gi configuration as an example:

  1. spec:
  2.   recyler:
  3.     requests:
  4.       cpu: 4
  5.       memory: 4Gi
  6.     limits:
  7.       cpu: 4
  8.       memory: 4Gi

Update the modified configuration to the [Compute-storage decoupled metadata management resource](/docs/3.0/install/cluster-deployment/k8s-deploy/compute-storage-decoupled/install-quickstart#Install DorisDisaggregatedMetaService) that needs to be deployed.

Customized configuration file

ConfigMap is used to mount the configuration file on K8s. Doris-Operator automates the configuration of mutual perception between Compute-storage decoupled components. When deploying MS services using customized configuration files, please do not configure FDB related configuration.

Use ConfigMap to mount the configuration file to deploy the Recycler service:

ConfigMap:

  1. apiVersion: v1
  2. data:
  3.   doris_cloud.conf: |
  4.     brpc_listen_port = 5000
  5.     brpc_num_threads = -1
  6.     brpc_idle_timeout_sec = 30
  7.     http_token = greedisgood9999
  9.     # // doris txn config
  10.     label_keep_max_second = 259200
  11.     expired_txn_scan_key_nums = 1000
  13.     # // logging
  14.     log_dir = ./log/
  15.     # info warn error
  16.     log_level = info
  17.     log_size_mb = 1024
  18.     log_filenum_quota = 10
  19.     log_immediate_flush = false
  20.     # log_verbose_modules = *
  21.     # // recycler config
  22.     recycle_interval_seconds = 3600
  23.     retention_seconds = 259200
  24.     recycle_concurrency = 16
  25. kind: ConfigMap
  26. metadata:
  27.   name: doris-metaservice

The Recycler configuration using the above ConfigMap is as follows:

  1. spec:
  2.   recyler:
  3.     image: {recylerImage}
  4.     configMaps:
  5.     - name: doris-metaservice
  6.       mountPath: /etc/doris

In actual deployment, configure the name and namespace of ConfigMap as needed, and configure the configuration information in the [Compute-storage decoupled Metadata Management Resource](/docs/3.0/install/cluster-deployment/k8s-deploy/compute-storage-decoupled/install-quickstart#Install DorisDisaggregatedMetaService) to be deployed according to the above sample format. The startup configuration file used by the Recycler service is named doris_cloud.conf, so the key of the ConfigMap for mounting the startup configuration must also be doris_cloud.conf. The startup configuration must be mounted to the /etc/doris directory, that is, the mountPath is /etc/doris.

Config and install Recycler - 图1Tip

The Recyler service needs to use FDB as the backend metadata storage. The FDB service must be deployed when deploying the Recyler service.