Upgrade to Universal Installer 0.3

Guide to Upgrade Mesosphere Universal Installer to version 0.3

Upgrade Universal Installer 0.2 to 0.3

This guide documents how to upgrade a Universal Installer installation from version 0.2 to 0.3 to support Terraform v0.12. The guide assumes that the DC/OS cluster to be upgraded is similar to the examples we provide. If you have customized your installation or have a more complex setup then the provided examples than you may need to perform additional steps beyond those listed below.

You should test this procedure on a test cluster before applying it any production cluster to ensure you understand the procedure and it does not break anything.

Preparation

Ideally you should use tfenv to switch between terraform versions but you can also do it by yourself. so tfenv use 0.12.25 means you need to replace your 0.11 terraform version with 0.12.25 We assume you’re using a clusters main.tf similar to this:

  1. provider "azurerm" {}
  2. # Used to determine your public IP for forwarding rules
  3. data "http" "whatismyip" {
  4.   url = "http://whatismyip.akamai.com/"
  5. }
  6. locals {
  7.   cluster_name = "generic-dcos-ee-demo"
  8. }
  9. module "dcos" {
  10.   source  = "dcos-terraform/dcos/azurerm"
  11.   version = "~> 0.2.0"
  12.   providers = {
  13.     azurerm = "azurerm"
  14.   }
  15.   location = "West US"
  16.   cluster_name        = "${local.cluster_name}"
  17.   ssh_public_key_file = "~/.ssh/id_rsa.pub"
  18.   admin_ips           = ["${data.http.whatismyip.body}/32"]
  19.   num_masters        = 1
  20.   num_private_agents = 2
  21.   num_public_agents  = 1
  22.   dcos_instance_os = "centos_7.6"
  23.   dcos_variant              = "ee"
  24.   dcos_version              = "2.1"
  25.   dcos_license_key_contents = "${file("~/license.txt")}"
  26.   # provide a SHA512 hashed password, here "deleteme"
  27.   dcos_superuser_password_hash = "$6$rounds=656000$YSvuFmasQDXheddh$TpYlCxNHF6PbsGkjlK99Pwxg7D0mgWJ.y0hE2JKoa61wHx.1wtxTAHVRHfsJU9zzHWDoE08wpdtToHimNR9FJ/"
  28.   dcos_superuser_username      = "demo-super"
  29. }
  30. output "masters_dns_name" {
  31.   description = "This is the load balancer address to access the DC/OS UI"
  32.   value       = "${module.dcos.masters-loadbalancer}"
  33. }

Make sure you’re using the latest modules and your state is properly updated:

  1. terraform init -upgrade
  2. terraform apply

Translate terraform 0.11 main.tf into 0.12

Now we switch to terraform 0.12.25 which offers us an option to translate terraform 0.11 code into terraform 0.12 code

  1. tfenv install 0.12.25
  2. tfenv use 0.12.25

Translate into 0.12 code

  1. terraform 0.12upgrade

You must change the module version to 0.3.0:

change:

  1. version = "~> 0.2.0"

to:

  1. version = "~> 0.3.0"

As there where changes to the Azure provider we also have to add the features section: Therefore replace:

  1. provider "azurerm" {}

with:

  1. provider "azurerm" {
  2.   version = "=2.14.0"
  3.   features {}
  4. }

First we upgrade our modules to Universal Installer 0.3 ( version change from above)

  1. terraform init -upgrade

not every option might be properly translated. Lets check if our main.tf is valid.

  1. terraform validate

A known issue is the providers part:

  1. providers = {
  2.   azurerm = "azurerm"
  3. }

it should look like this:

  1. providers = {
  2.   azurerm = azurerm
  3. }

the important part is that the provider reference must be without quotes (“”) You can find more information about tf 0.11 to 0.12 upgrade here: https://www.terraform.io/upgrade-guides/0-12.html

Start the upgrade procedure

Now we apply the new modules to our previous terraform state.

We need to let terraform run on everything except load balancers

Due to a needed change in the way the load balancer module is being used we must exclude it from the first apply:

  1. terraform apply $(terraform state list | grep -v module.loadbalancers | xargs printf -- '-target %s ')

We expect changes to ... and `…``

After this was successful most of the infrastructure is updated

Import load balancers rules in the new format.

The load balancer module had quite some changes about its addressing. Therefore we now need to create import statements from the current state, drop the old state for load balancer rules and reimport them into terraform.

  1. terraform state pull | jq -r '.resources[] | select(.module != null) |select(.module|startswith("module.dcos.module.dcos-infrastructure.module.loadbalancers")) | select(.type=="azurerm_lb_rule")| . as $i | .instances[] | "terraform import \""+$i.module+"."+$i.type+"."+$i.name+"[\\\""+.attributes_flat.frontend_port+"\\\"]" +"\" \"" + .attributes_flat.id + "\""' > import_lb_rules.sh

In the next step we will drop the complete state for these load balancers. We must make sure that the previous commands ran successfully and stored the targetgroups and listeners.

In our example this looks like this:

  1. cat import_targetgroups.sh
  2. terraform import "module.dcos.module.dcos-infrastructure.module.loadbalancers.module.masters-internal.module.masters-internal.azurerm_lb_rule.load_balancer_rule[\"80\"]" "/subscriptions/12345678-1234-5678-abcd-abcdefghijkl/resourceGroups/generic-dcos-ee-demo/providers/Microsoft.Network/loadBalancers/int-generic-dcos-ee-demo/loadBalancingRules/load-balancer-rule-80"
  3. [...]

Our file has this amount of command lines:

  1. wc -l import_lb_rules.sh
  2.       10 import_lb_rules.sh

The numbers might differ on your infrastructure if you use additional ports. Before we import these resources again we will drop state for the load balancer rules:

  1. for addr in $(terraform state pull | jq -r '.resources[] | select(.module != null) |select(.module|startswith("module.dcos.module.dcos-infrastructure.module.loadbalancers")) | select(.type=="azurerm_lb_rule")| . as $i | .instances[] | $i.module+"."+$i.type+"."+$i.name+(if .index_key == null then "" else "["+(.index_key|tostring)+"]" end)'); do terraform state rm "${addr}";done

After dropping the state we import the load balancer rules into our new format

  1. bash -x ./import_lb_rules.sh

Some references got lost in the process. But we can easily reproduce them. The following statement will reimport azurerm_network_interface_security_group_association into the terraform state.

  1. terraform plan -out=tf.plan && terraform show -json tf.plan | jq -r '.resource_changes[] | select(.type == "azurerm_network_interface_security_group_association") | "terraform import \""+ .address +"\" \""+.change.after.network_interface_id+"|"+.change.after.network_security_group_id+"\""' | bash -

After this is finished we need to run a final apply as in the new format terraform needs to create some security rules:

  1. terraform apply

from now on terraform plan should not show any additional changes.