Register object storage

To deploy a Compute-storage decoupled cluster, you need to plan the object storage to be used in advance, and configure the object storage information through ConfigMap to the Namespace where the Doris Compute-storage decoupled cluster needs to be deployed.

The following shows the ConfigMap format composed of the required configuration information of the object storage of the Compute-storage decoupled cluster using the S3 protocol:

  1. apiVersion: v1
  2. data:
  3.   instance.conf: |
  4.     {
  5.       "instance_id": "disaggregated-test-cluster3",
  6.       "name": "instance-name",
  7.       "user_id": "test_user",
  8.       "vault": {
  9.         "obj_info": {
  10.           "ak": "test_ak",
  11.           "sk": "test_sk",
  12.           "bucket": "test_bucket",
  13.           "prefix": "test-prefix",
  14.           "endpoint": "cos.ap-beijing.myqcloud.com",
  15.           "external_endpoint": "cos.ap-beijing.myqcloud.com",
  16.           "region": "ap-beijing",
  17.           "provider": "COS"
  18.         }
  19.       }
  20.     }
  21. kind: ConfigMap
  22. metadata:
  23.   name: vault-test
  24.   namespace: default

Object storage information is configured in JSON format. When using ConfigMap as the configuration carrier, instance.conf must be used as the key and the object storage information in JSON format as a whole as the value. For detailed configuration of object storage, please refer to the [Compute-storage decoupled document](/docs/3.0/install/cluster-deployment/k8s-deploy/compute-storage-decoupled/install-quickstart#Install DorisDisaggregatedCluster).

DorisDisaggregatedCluster uses the above configuration as the backend object storage configuration as follows:

  1. apiVersion: disaggregated.cluster.doris.com/v1
  2. kind: DorisDisaggregatedCluster
  3. metadata:
  4.   name: test-disaggregated-cluster
  5.   namespace: default
  6. spec:
  7.   instanceConfigMap: vault-test

During deployment, update the configuration as described above and update it to the [Compute-storage decoupled resources to be deployed](/docs/3.0/install/cluster-deployment/k8s-deploy/compute-storage-decoupled/install-quickstart#Install DorisDisaggregatedCluster).

Cluster dependency association configuration - 图1Tip

  1. The configuration information in the above ConfigMap is to show the required key-value pairs. All value values are fictitious and cannot be used in the real environment. Please fill in the actual information of the object storage that actually supports the S3 protocol according to the Compute-storage decoupled document.
  2. ConfigMap must be deployed in advance to the namespace where the Compute-storage decoupled cluster is expected to be deployed.

Configure metadata resource information

To deploy a Compute-storage decoupled cluster, you need to specify the metadata resource information to be used. Before deploying DorisDisaggregatedCluster, you need to plan and deploy the DorisDisaggregatedMetaService resource to be used. Fill in the following configuration as needed and update it to the [Compute-storage decoupled resource to be deployed](/docs/3.0/install/cluster-deployment/k8s-deploy/compute-storage-decoupled/install-quickstart#Install DorisDisaggregatedCluster).

  1. spec:
  2.   disMS:
  3.     namespace: {metaServiceNamespace}
  4.     name: {metaServiceName}

Fill in the above information according to the actual resources used. {metaServiceNamespace} is the namespace where the DorisDisaggregatedMetaService resource is deployed, and {metaServiceName} is the name of the DorisDisaggregatedMetaService resource used.

Update the filled information to the [Compute-storage decoupled resources to be deployed](/docs/3.0/install/cluster-deployment/k8s-deploy/compute-storage-decoupled/install-quickstart#Install DorisDisaggregatedCluster).