Docker Swarm

Step 1:

Create an overlay network for the NATS & NATS Streaming cluster (in this example, nats-streaming-example). Notice we added the --attachable option which will allow other containers to join the network which will be done at the end to confirm that can connect to the cluster.

  1. docker network create --driver overlay --attachable nats-streaming-example

Step 2:

Next create the NATS cluster which will be used by the NATS Streaming cluster.

  1. for i in `seq 1 3`; do
  2.   sudo docker service create --network nats-streaming-example \
  3.                              --name nats-cluster-node-$i nats:1.1.0 \
  4.                              -cluster nats://0.0.0.0:6222 \
  5.                              -routes nats://nats-cluster-node-1:6222,nats://nats-cluster-node-2:6222,nats://nats-cluster-node-3:6222
  6. done

Step 3:

Now that there is a NATS cluster available to connect, create the NATS Streaming cluster of three nodes as follows:

  1. for i in `seq 1 3`; do
  2.   sudo docker service create --network nats-streaming-example \
  3.                              --name nats-streaming-node-$i nats-streaming:0.9.2 \
  4.                              -store file -dir store -clustered -cluster_id swarm -cluster_node_id node-$i \
  5.                              -cluster_peers node-1,node-2,node-3 \
  6.                              -nats_server nats://nats-cluster-node-1:4222,nats://nats-cluster-node-2:4222,nats://nats-cluster-node-3:4222
  7. done

Step 4:

Next, confirm that it is possible to publish and replay messages via NATS Streaming by attaching a container to the same network where both NATS and NATS Streaming exist. Below you can find an example session of doing so, note that even though the client is only connecting to nats://nats-cluster-node-1:4222 the NATS cluster will be routing the messages so that they will be processed to the NATS Streaming cluster service.

  1. $ docker run --network nats-streaming-example -it synadia/nats-box
  3. # Publishing 3 messages
  4. c01c232d571a:~# stan-pub -s nats://nats-cluster-node-1:4222 --cluster swarm hello world
  5. Published [hello] : 'world'
  6. c01c232d571a:~# stan-pub -s nats://nats-cluster-node-1:4222 --cluster swarm hello world
  7. Published [hello] : 'world'
  8. c01c232d571a:~# stan-pub -s nats://nats-cluster-node-1:4222 --cluster swarm hello world
  9. Published [hello] : 'world'
  11. # Replaying the messages from the beginning
  12. c01c232d571a:~# stan-sub -s nats://nats-cluster-node-1:4222 --cluster swarm -id $RANDOM --all hello
  13. Connected to nats://nats-cluster-node-1:4222 clusterID: [swarm] clientID: [2379]
  14. Listening on [hello], clientID=[2379], qgroup=[] durable=[]
  15. [#1] Received: sequence:1 subject:"hello" data:"world" timestamp:1595949420614047600
  16. [#2] Received: sequence:2 subject:"hello" data:"world" timestamp:1595949422327787300
  17. [#3] Received: sequence:3 subject:"hello" data:"world" timestamp:1595949422898530500