Scaling to Zero
Remember those super powers we talked about? One of Knative Serving’s powers is built-in automatic scaling, also known as autoscaling. This means your Knative Service only spins up your application to perform its job (in this case, saying “Hello world!”) if it is needed. Otherwise, it will scale to zero by spinning down and waiting for a new request to come in.
What about scaling up to meet increased demand?
Knative Autoscaling also allows you to easily configure your service to scale up (horizontal autoscaling) to meet increased demand as well as control the number of instances that spin up using concurrency limits and other options, but that’s beyond the scope of this tutorial.
Let’s see this in action! We’re going to peek under the hood at the Pod in Kubernetes where our Knative Service is running to watch our “Hello world!” Service scale up and down.
Watch your Knative Service scale to zero
Let’s run our “Hello world!” Service just one more time. This time, try the Knative Service URL
in your browser http://hello.default.127.0.0.1.sslip.io, or you can use your terminal with curl
.
curl http://hello.default.127.0.0.1.sslip.io
Now watch the pods and see how they scale to zero after traffic stops going to the URL.
kubectl get pod -l serving.knative.dev/service=hello -w
Warning
It may take up to 2 minutes for your Pods to scale down. Pinging your service again will reset this timer.
Expected output
NAME READY STATUS
hello-world 2/2 Running
hello-world 2/2 Terminating
hello-world 1/2 Terminating
hello-world 0/2 Terminating
Scale up your Knative Service
Rerun the Knative Service in your browser http://hello.default.127.0.0.1.sslip.io, and you will see a new pod running again.
Expected output
NAME READY STATUS
hello-world 0/2 Pending
hello-world 0/2 ContainerCreating
hello-world 1/2 Running
hello-world 2/2 Running
Exit the watch command with Ctrl+c
.
Some people call this Serverless Up next, traffic splitting!
Want to go deeper on Autoscaling?
Interested in getting in the weeds with Knative Autoscaling? Check out the autoscaling documentation for concepts, samples, and more!