Sidecar
Sidecar
describes the configuration of the sidecar proxy that mediates inbound and outbound communication to the workload instance it is attached to. By default, Istio will program all sidecar proxies in the mesh with the necessary configuration required to reach every workload instance in the mesh, as well as accept traffic on all the ports associated with the workload. The Sidecar
configuration provides a way to fine tune the set of ports, protocols that the proxy will accept when forwarding traffic to and from the workload. In addition, it is possible to restrict the set of services that the proxy can reach when forwarding outbound traffic from workload instances.
Services and configuration in a mesh are organized into one or more namespaces (e.g., a Kubernetes namespace or a CF org/space). A Sidecar
configuration in a namespace will apply to one or more workload instances in the same namespace, selected using the workloadSelector
field. In the absence of a workloadSelector
, it will apply to all workload instances in the same namespace. When determining the Sidecar
configuration to be applied to a workload instance, preference will be given to the resource with a workloadSelector
that selects this workload instance, over a Sidecar
configuration without any workloadSelector
.
NOTE 1: _Each namespace can have only one Sidecar
configuration without any workloadSelector
that specifies the default for all pods in that namespace_. It is recommended to use the name default
for the namespace-wide sidecar. The behavior of the system is undefined if more than one selector-less Sidecar
configurations exist in a given namespace. The behavior of the system is undefined if two or more Sidecar
configurations with a workloadSelector
select the same workload instance.
NOTE 2: A Sidecar
configuration in the MeshConfig
root namespace will be applied by default to all namespaces without a Sidecar
configuration. This global default Sidecar
configuration should not have any workloadSelector
.
NOTE 3: A Sidecar
is not applicable to gateways, even though gateways are istio-proxies.
The example below declares a global default Sidecar
configuration in the root namespace called istio-config
, that configures sidecars in all namespaces to allow egress traffic only to other workloads in the same namespace as well as to services in the istio-system
namespace.
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
name: default
namespace: istio-config
spec:
egress:
- hosts:
- "./*"
- "istio-system/*"
The example below declares a Sidecar
configuration in the prod-us1
namespace that overrides the global default defined above, and configures the sidecars in the namespace to allow egress traffic to public services in the prod-us1
, prod-apis
, and the istio-system
namespaces.
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
name: default
namespace: prod-us1
spec:
egress:
- hosts:
- "prod-us1/*"
- "prod-apis/*"
- "istio-system/*"
The following example declares a Sidecar
configuration in the prod-us1
namespace for all pods with labels app: ratings
belonging to the ratings.prod-us1
service. The workload accepts inbound HTTP traffic on port 9080. The traffic is then forwarded to the attached workload instance listening on a Unix domain socket. In the egress direction, in addition to the istio-system
namespace, the sidecar proxies only HTTP traffic bound for port 9080 for services in the prod-us1
namespace.
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
name: ratings
namespace: prod-us1
spec:
workloadSelector:
labels:
app: ratings
ingress:
- port:
number: 9080
protocol: HTTP
name: somename
defaultEndpoint: unix:///var/run/someuds.sock
egress:
- port:
number: 9080
protocol: HTTP
name: egresshttp
hosts:
- "prod-us1/*"
- hosts:
- "istio-system/*"
If the workload is deployed without IPTables-based traffic capture, the Sidecar
configuration is the only way to configure the ports on the proxy attached to the workload instance. The following example declares a Sidecar
configuration in the prod-us1
namespace for all pods with labels app: productpage
belonging to the productpage.prod-us1
service. Assuming that these pods are deployed without IPtable rules (i.e. the istio-init
container) and the proxy metadata ISTIO_META_INTERCEPTION_MODE
is set to NONE
, the specification, below, allows such pods to receive HTTP traffic on port 9080 (wrapped inside Istio mutual TLS) and forward it to the application listening on 127.0.0.1:8080
. It also allows the application to communicate with a backing MySQL database on 127.0.0.1:3306
, that then gets proxied to the externally hosted MySQL service at mysql.foo.com:3306
.
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
name: no-ip-tables
namespace: prod-us1
spec:
workloadSelector:
labels:
app: productpage
ingress:
- port:
number: 9080 # binds to proxy_instance_ip:9080 (0.0.0.0:9080, if no unicast IP is available for the instance)
protocol: HTTP
name: somename
defaultEndpoint: 127.0.0.1:8080
captureMode: NONE # not needed if metadata is set for entire proxy
egress:
- port:
number: 3306
protocol: MYSQL
name: egressmysql
captureMode: NONE # not needed if metadata is set for entire proxy
bind: 127.0.0.1
hosts:
- "*/mysql.foo.com"
And the associated service entry for routing to mysql.foo.com:3306
apiVersion: networking.istio.io/v1
kind: ServiceEntry
metadata:
name: external-svc-mysql
namespace: ns1
spec:
hosts:
- mysql.foo.com
ports:
- number: 3306
name: mysql
protocol: MYSQL
location: MESH_EXTERNAL
resolution: DNS
It is also possible to mix and match traffic capture modes in a single proxy. For example, consider a setup where internal services are on the 192.168.0.0/16
subnet. So, IP tables are setup on the VM to capture all outbound traffic on 192.168.0.0/16
subnet. Assume that the VM has an additional network interface on 172.16.0.0/16
subnet for inbound traffic. The following Sidecar
configuration allows the VM to expose a listener on 172.16.1.32:80
(the VM’s IP) for traffic arriving from the 172.16.0.0/16
subnet.
NOTE: The ISTIO_META_INTERCEPTION_MODE
metadata on the proxy in the VM should contain REDIRECT
or TPROXY
as its value, implying that IP tables based traffic capture is active.
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
name: partial-ip-tables
namespace: prod-us1
spec:
workloadSelector:
labels:
app: productpage
ingress:
- bind: 172.16.1.32
port:
number: 80 # binds to 172.16.1.32:80
protocol: HTTP
name: somename
defaultEndpoint: 127.0.0.1:8080
captureMode: NONE
egress:
# use the system detected defaults
# sets up configuration to handle outbound traffic to services
# in 192.168.0.0/16 subnet, based on information provided by the
# service registry
- captureMode: IPTABLES
hosts:
- "*/*"
The following example declares a Sidecar
configuration in the prod-us1
namespace for all pods with labels app: ratings
belonging to the ratings.prod-us1
service. The service accepts inbound HTTPS traffic on port 8443 and the sidecar proxy terminates one way TLS using the given server certificates. The traffic is then forwarded to the attached workload instance listening on a Unix domain socket. It is expected that PeerAuthentication policy would be configured in order to set mTLS mode to “DISABLE” on specific ports. In this example, the mTLS mode is disabled on PORT 80. This feature is currently experimental.
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
name: ratings
namespace: prod-us1
spec:
workloadSelector:
labels:
app: ratings
ingress:
- port:
number: 80
protocol: HTTPS
name: somename
defaultEndpoint: unix:///var/run/someuds.sock
tls:
mode: SIMPLE
privateKey: "/etc/certs/privatekey.pem"
serverCertificate: "/etc/certs/servercert.pem"
---
apiVersion: v1
kind: Service
metadata:
name: ratings
labels:
app: ratings
service: ratings
spec:
ports:
- port: 8443
name: https
targetPort: 80
selector:
app: ratings
---
apiVersion: security.istio.io/v1
kind: PeerAuthentication
metadata:
name: ratings-peer-auth
namespace: prod-us1
spec:
selector:
matchLabels:
app: ratings
mtls:
mode: STRICT
portLevelMtls:
80:
mode: DISABLE
In addition to configuring traffic capture and how traffic is forwarded to the app, it’s possible to control inbound connection pool settings. By default, Istio pushes connection pool settings from DestinationRules
to both clients (for outbound connections to the service) as well as servers (for inbound connections to a service instance). Using the InboundConnectionPool
and per-port ConnectionPool
settings in a Sidecar
allow you to control those connection pools for the server separately from the settings pushed to all clients.
apiVersion: networking.istio.io/v1
kind: Sidecar
metadata:
name: connection-pool-settings
namespace: prod-us1
spec:
workloadSelector:
labels:
app: productpage
inboundConnectionPool:
http:
http1MaxPendingRequests: 1024
http2MaxRequests: 1024
maxRequestsPerConnection: 1024
maxRetries: 100
ingress:
- port:
number: 80
protocol: HTTP
name: somename
connectionPool:
http:
http1MaxPendingRequests: 1024
http2MaxRequests: 1024
maxRequestsPerConnection: 1024
maxRetries: 100
tcp:
maxConnections: 100
Sidecar
Sidecar
describes the configuration of the sidecar proxy that mediates inbound and outbound communication of the workload instance to which it is attached.
Field | Type | Description | Required |
---|---|---|---|
workloadSelector | WorkloadSelector | Criteria used to select the specific set of pods/VMs on which this | No |
ingress | IstioIngressListener[] | Ingress specifies the configuration of the sidecar for processing inbound traffic to the attached workload instance. If omitted, Istio will automatically configure the sidecar based on the information about the workload obtained from the orchestration platform (e.g., exposed ports, services, etc.). If specified, inbound ports are configured if and only if the workload instance is associated with a service. | No |
egress | IstioEgressListener[] | Egress specifies the configuration of the sidecar for processing outbound traffic from the attached workload instance to other services in the mesh. If not specified, inherits the system detected defaults from the namespace-wide or the global default Sidecar. | No |
inboundConnectionPool | ConnectionPoolSettings | Settings controlling the volume of connections Envoy will accept from the network. This default will apply for all inbound listeners and can be overridden per-port in the By default, Istio applies a service’s Connection pool settings for a server’s inbound sidecar are configured in the following precedence, highest to lowest:
In every case, the connection pool settings are overriden, not merged. | No |
outboundTrafficPolicy | OutboundTrafficPolicy | Configuration for the outbound traffic policy. If your application uses one or more external services that are not known apriori, setting the policy to | No |
IstioIngressListener
IstioIngressListener
specifies the properties of an inbound traffic listener on the sidecar proxy attached to a workload instance.
Field | Type | Description | Required |
---|---|---|---|
port | SidecarPort | The port associated with the listener. | Yes |
bind | string | The IP(IPv4 or IPv6) to which the listener should be bound. Unix domain socket addresses are not allowed in the bind field for ingress listeners. If omitted, Istio will automatically configure the defaults based on imported services and the workload instances to which this configuration is applied to. | No |
captureMode | CaptureMode | The captureMode option dictates how traffic to the listener is expected to be captured (or not). | No |
defaultEndpoint | string | The IP endpoint or Unix domain socket to which traffic should be forwarded to. This configuration can be used to redirect traffic arriving at the bind | No |
tls | ServerTLSSettings | Set of TLS related options that will enable TLS termination on the sidecar for requests originating from outside the mesh. Currently supports only SIMPLE and MUTUAL TLS modes. | No |
connectionPool | ConnectionPoolSettings | Settings controlling the volume of connections Envoy will accept from the network. This setting overrides the top-level default | No |
IstioEgressListener
IstioEgressListener
specifies the properties of an outbound traffic listener on the sidecar proxy attached to a workload instance.
Field | Type | Description | Required |
---|---|---|---|
port | SidecarPort | The port associated with the listener. If using Unix domain socket, use 0 as the port number, with a valid protocol. The port if specified, will be used as the default destination port associated with the imported hosts. If the port is omitted, Istio will infer the listener ports based on the imported hosts. Note that when multiple egress listeners are specified, where one or more listeners have specific ports while others have no port, the hosts exposed on a listener port will be based on the listener with the most specific port. | No |
bind | string | The IP(IPv4 or IPv6) or the Unix domain socket to which the listener should be bound to. Port MUST be specified if bind is not empty. Format: IPv4 or IPv6 address formats or | No |
captureMode | CaptureMode | When the bind address is an IP, the captureMode option dictates how traffic to the listener is expected to be captured (or not). captureMode must be DEFAULT or | No |
hosts | string[] | One or more service hosts exposed by the listener in The The NOTE: Only services and configuration artifacts exported to the sidecar’s namespace (e.g., | Yes |
WorkloadSelector
WorkloadSelector
specifies the criteria used to determine if the Gateway
, Sidecar
, EnvoyFilter
, ServiceEntry
, or DestinationRule
configuration can be applied to a proxy. The matching criteria includes the metadata associated with a proxy, workload instance info such as labels attached to the pod/VM, or any other info that the proxy provides to Istio during the initial handshake. If multiple conditions are specified, all conditions need to match in order for the workload instance to be selected. Currently, only label based selection mechanism is supported.
Field | Type | Description | Required |
---|---|---|---|
labels | map<string, string> | One or more labels that indicate a specific set of pods/VMs on which the configuration should be applied. The scope of label search is restricted to the configuration namespace in which the the resource is present. | No |
OutboundTrafficPolicy
OutboundTrafficPolicy
sets the default behavior of the sidecar for handling outbound traffic from the application. If your application uses one or more external services that are not known apriori, setting the policy to ALLOW_ANY
will cause the sidecars to route any unknown traffic originating from the application to its requested destination. Users are strongly encouraged to use ServiceEntry
configurations to explicitly declare any external dependencies, instead of using ALLOW_ANY
, so that traffic to these services can be monitored.
Field | Type | Description | Required |
---|---|---|---|
mode | Mode | No |
SidecarPort
Port describes the properties of a specific port of a service.
Field | Type | Description | Required |
---|---|---|---|
number | uint32 | A valid non-negative integer port number. | No |
protocol | string | The protocol exposed on the port. MUST BE one of HTTP|HTTPS|GRPC|HTTP2|MONGO|TCP|TLS. TLS can be either used to terminate non-HTTP based connections on a specific port or to route traffic based on SNI header to the destination without terminating the TLS connection. | No |
name | string | Label assigned to the port. | No |
OutboundTrafficPolicy.Mode
Name | Description |
---|---|
REGISTRY_ONLY | Outbound traffic will be restricted to services defined in the service registry as well as those defined through |
ALLOW_ANY | Outbound traffic to unknown destinations will be allowed, in case there are no services or |
CaptureMode
CaptureMode
describes how traffic to a listener is expected to be captured. Applicable only when the listener is bound to an IP.
Name | Description |
---|---|
DEFAULT | The default capture mode defined by the environment. |
IPTABLES | Capture traffic using IPtables redirection. |
NONE | No traffic capture. When used in an egress listener, the application is expected to explicitly communicate with the listener port or Unix domain socket. When used in an ingress listener, care needs to be taken to ensure that the listener port is not in use by other processes on the host. |