Layer 4 and Layer 7 Load Balancing


Kubernetes supports load balancing in two ways: Layer-4 Load Balancing and Layer-7 Load Balancing.

Layer-4 Load Balancer

Layer-4 load balancer (or the external load balancer) forwards traffic to Nodeports. Layer-4 load balancer allows you to forward both HTTP and TCP traffic.

Often, the Layer-4 load balancer is supported by the underlying cloud provider, so when you deploy RKE clusters on bare-metal servers and vSphere clusters, Layer-4 load balancer is not supported. However, a single globally managed config-map can be used to expose services on NGINX or third-party ingress.

Note: It is possible to deploy a cluster with a non-cloud load balancer, such as MetalLB. However, that use case is more advanced than the Layer-4 load balancer supported by a cloud provider, and it is not configurable in Rancher or RKE.

Support for Layer-4 Load Balancing

Support for layer-4 load balancer varies based on the underlying cloud provider.

Cluster DeploymentLayer-4 Load Balancer Support
Amazon EKSSupported by AWS cloud provider
Google GKESupported by GCE cloud provider
Azure AKSSupported by Azure cloud provider
RKE on EC2Supported by AWS cloud provider
RKE on DigitalOceanLimited NGINX or third-party Ingress
RKE on vSphereLimited NGINX or third party-Ingress
RKE on Custom Hosts
(e.g. bare-metal servers)
Limited NGINX or third-party Ingress
Third-party MetalLBLimited NGINX or third-party Ingress

* Services can be exposed through a single globally managed config-map.

Layer-7 Load Balancer

Layer-7 load balancer (or the ingress controller) supports host and path-based load balancing and SSL termination. Layer-7 load balancer only forwards HTTP and HTTPS traffic and therefore they listen on ports 80 and 443 only. Cloud providers such as Amazon and Google support layer-7 load balancer. In addition, RKE clusters deploys the Nginx Ingress Controller.

Support for Layer-7 Load Balancing

Support for layer-7 load balancer varies based on the underlying cloud provider.

Cluster DeploymentLayer-7 Load Balancer Support
Amazon EKSSupported by AWS cloud provider
Google GKESupported by GKE cloud provider
Azure AKSNot Supported
RKE on EC2Nginx Ingress Controller
RKE on DigitalOceanNginx Ingress Controller
RKE on vSphereNginx Ingress Controller
RKE on Custom Hosts
(e.g. bare-metal servers)
Nginx Ingress Controller

Host Names in Layer-7 Load Balancer

Some cloud-managed layer-7 load balancers (such as the ALB ingress controller on AWS) expose DNS addresses for ingress rules. You need to map (via CNAME) your domain name to the DNS address generated by the layer-7 load balancer.

Other layer-7 load balancers, such as the Google Load Balancer or Nginx Ingress Controller, directly expose one or more IP addresses. Google Load Balancer provides a single routable IP address. Nginx Ingress Controller exposes the external IP of all nodes that run the Nginx Ingress Controller. You can do either of the following:

  1. Configure your own DNS to map (via A records) your domain name to the IP addresses exposes by the Layer-7 load balancer.
  2. Ask Rancher to generate an xip.io host name for your ingress rule. Rancher will take one of your exposed IPs, say a.b.c.d, and generate a host name ..a.b.c.d.xip.io.

The benefit of using xip.io is that you obtain a working entrypoint URL immediately after you create the ingress rule. Setting up your own domain name, on the other hand, requires you to configure DNS servers and wait for DNS to propagate.