Serverless Installation Guide

KServe Serverless installation enables autoscaling based on request volume and supports scale down to and from zero. It also supports revision management and canary rollout based on revisions.

Kubernetes 1.17 is the minimally required version and please check the following recommended Knative, Istio versions for the corresponding Kubernetes version.

Kubernetes VersionRecommended Istio VersionRecommended Knative Version
1.171.90.19, 0.20
1.181.9, 1.100.21, 0.22
1.191.9, 1.10, 1.110.23, 0.24
1.201.9, 1.10, 1.110.24, 0.25
1.211.10, 1.110.25, 0.26
1.221.110.25, 0.26

1. Install Istio

Please refer to the Istio install guide.

2. Install Knative Serving

Please refer to Knative Serving install guide.

Note

If you are looking to use PodSpec fields such as nodeSelector, affinity or tolerations which are now supported in the v1beta1 API spec, you need to turn on the corresponding feature flags in your Knative configuration.

3. Install Cert Manager

The minimally required Cert Manager version is 1.3.0 and you can refer to Cert Manager.

Note

Cert manager is required to provision webhook certs for production grade installation, alternatively you can run self signed certs generation script.

4. Install KServe

kubectl

  1. kubectl apply -f https://github.com/kserve/kserve/releases/download/v0.7.0-rc0/kserve.yaml