Deploy Apps in a Multi-cluster Project Using a Jenkinsfile

Prerequisites

Create a Docker Hub Access Token

  1. Log in to Docker Hub and select Account Settings from the menu in the top right corner.

    dockerhub-settings

  2. Click Security and New Access Token.

    dockerhub-create-token

  3. Enter the token name and click Create.

    dockerhub-token-ok

  4. Click Copy and Close and remember to save the access token.

    dockerhub-token-copy

Create Credentials

You need to create credentials in KubeSphere for the access token created so that the pipeline can interact with Docker Hub for imaging pushing. Besides, you also need to create kubeconfig credentials for the access to the Kubernetes cluster.

  1. Log in to the web console of KubeSphere as project-regular. Go to your DevOps project and click Create in Credentials.

    create-dockerhub-id

  2. In the dialog that appears, set a Credential ID, which will be used later in the Jenkinsfile, and select Account Credentials for Type. Enter your Docker Hub account name for Username and the access token just created for Token/Password. When you finish, click OK.

    credential-docker-create

    Tip

    For more information about how to create credentials, see Credential Management.

  3. Click Create again and select kubeconfig for Type. Note that KubeSphere automatically populates the Content field, which is the kubeconfig of the current user account. Set a Credential ID and click OK.

    create-kubeconfig

Create a Pipeline

With the above credentials ready, you can create a pipeline using an example Jenkinsfile as below.

  1. To create a pipeline, click Create on the Pipelines page.

    create-pipeline

  2. Set a name in the pop-up window and click Next directly.

    set-pipeline-name

  3. In this tutorial, you can use default values for all the fields. In Advanced Settings, click Create directly.

    create-pipeline-2

Edit the Jenkinsfile

  1. In the pipeline list, click this pipeline to go to its detail page. Click Edit Jenkinsfile to define a Jenkinsfile and your pipeline runs based on it.

    edit-jenkinsfile

  2. Copy and paste all the content below to the pop-up window as an example Jenkinsfile for your pipeline. You must replace the value of DOCKERHUB_USERNAME, DOCKERHUB_CREDENTIAL, KUBECONFIG_CREDENTIAL_ID, MULTI_CLUSTER_PROJECT_NAME, and MEMBER_CLUSTER_NAME with yours. When you finish, click OK.

    1. pipeline {
    2.   agent {
    3.     node {
    4.       label 'maven'
    5.     }
    7.   }
    9.   environment {
    10.     REGISTRY = 'docker.io'
    11.     // username of dockerhub
    12.     DOCKERHUB_USERNAME = 'yuswift'
    13.     APP_NAME = 'devops-go-sample'
    14.     // ‘dockerhubid’ is the dockerhub credential id you created on ks console
    15.     DOCKERHUB_CREDENTIAL = credentials('dockerhubid')
    16.     // the kubeconfig credential id you created on ks console
    17.     KUBECONFIG_CREDENTIAL_ID = 'multi-cluster'
    18.     // mutli-cluster project name under your own workspace
    19.     MULTI_CLUSTER_PROJECT_NAME = 'devops-with-go'
    20.     // the member cluster name you want to deploy app on
    21.     // in this tutorial, you are assumed to deploy app on host and only one member cluster
    22.     // for more member clusters, please edit manifest/multi-cluster-deploy.yaml
    23.     MEMBER_CLUSTER_NAME = 'c9'
    24.   }  
    26.   stages {
    27.     stage('docker login') {
    28.       steps {
    29.         container('maven') {
    30.           sh 'echo $DOCKERHUB_CREDENTIAL_PSW  | docker login -u $DOCKERHUB_CREDENTIAL_USR --password-stdin'
    31.         }
    33.       }
    34.     }
    36.     stage('build & push') {
    37.       steps {
    38.         container('maven') {
    39.           sh 'git clone https://github.com/yuswift/devops-go-sample.git'
    40.           sh 'cd devops-go-sample && docker build -t $REGISTRY/$DOCKERHUB_USERNAME/$APP_NAME .'
    41.           sh 'docker push $REGISTRY/$DOCKERHUB_USERNAME/$APP_NAME'
    42.         }
    43.       }
    44.     }
    46.     stage('deploy app to multi cluster') {
    47.       steps {
    48.         container('maven') {
    49.           script {
    50.             withCredentials([
    51.               kubeconfigFile(
    52.                 credentialsId: 'multi-cluster',
    53.                 variable: 'KUBECONFIG')
    54.               ]) {
    55.               sh 'envsubst < devops-go-sample/manifest/multi-cluster-deploy.yaml | kubectl apply -f -'
    56.               }
    57.             }
    58.           }
    59.         }
    60.       }
    61.     }
    62.   }

    Note

    If your pipeline runs successfully, images will be pushed to Docker Hub. If you are using Harbor, you cannot pass the parameter to docker login -u via the Jenkins credential with environment variables. This is because every Harbor robot account username contains a $ character, which will be converted to $$ by Jenkins when used by environment variables. Learn more.

Run the Pipeline

After you save the Jenkinsfile, click Run. If everything goes well, you will see the Deployment workload in your multi-cluster project.

multi-cluster-ok