云端虚拟机置备

如何使用Terraform迅速在阿里云创建Pigsty部署所需的虚拟机资源

如果您手头没有 x86_64 架构的PC、笔记本、Mac，使用即用即毁的云虚拟机可能是另一个不错的选择。

Terraform

Terraform 是开源免费的 基础设施即代码 工具。您只需要声明好所需的云虚拟机、网络与安全组配置等，一键即可拉起对应的资源。

在MacOS下安装Terraform，只需要执行brew install terraform即可。然后您需要有云厂商账号，并获取AccessKey与AccessSecret凭证，充点钱，就可以开始云端沙箱部署之旅啦。

TF配置文件

项目根目录 terraform/ 中提供了若干云厂商的 Terraform 资源定义文件，您可以使用这些模板快速在云上申请虚拟机资源用于部署Pigsty。这里以阿里云为例：

  1. cd terraform        # 进入terraform目录中
  2. vi alicloud.tf      # 编辑配置文件，填入您的阿里云AccessKey与SecretKey

阿里云样例Terraform文件

  1. provider "alicloud" {
  2.   access_key = "xxxxxx"
  3.   secret_key = "xxxxxx"
  4.   region = "cn-beijing"
  5. }
  7. # use 10.10.10.0/24 cidr block as demo network
  8. resource "alicloud_vpc" "vpc" {
  9.   vpc_name   = "pigsty-demo-network"
  10.   cidr_block = "10.10.10.0/24"
  11. }
  13. # add virtual switch for pigsty demo network
  14. resource "alicloud_vswitch" "vsw" {
  15.   vpc_id     = "${alicloud_vpc.vpc.id}"
  16.   cidr_block = "10.10.10.0/24"
  17.   zone_id    = "cn-beijing-k"
  18. }
  20. # add default security group and allow all tcp traffic
  21. resource "alicloud_security_group" "default" {
  22.   name   = "default"
  23.   vpc_id = "${alicloud_vpc.vpc.id}"
  24. }
  25. resource "alicloud_security_group_rule" "allow_all_tcp" {
  26.   ip_protocol       = "tcp"
  27.   type              = "ingress"
  28.   nic_type          = "intranet"
  29.   policy            = "accept"
  30.   port_range        = "1/65535"
  31.   priority          = 1
  32.   security_group_id = "${alicloud_security_group.default.id}"
  33.   cidr_ip           = "0.0.0.0/0"
  34. }
  36. # https://registry.terraform.io/providers/aliyun/alicloud/latest/docs/resources/instance
  37. resource "alicloud_instance" "pg-meta-1" {
  38.   instance_name              = "pg-meta-1"
  39.   host_name                  = "pg-meta-1"
  40.   instance_type              = "ecs.s6-c1m2.small"
  41.   vswitch_id                 = "${alicloud_vswitch.vsw.id}"
  42.   security_groups            = ["${alicloud_security_group.default.id}"]
  43.   image_id                   = "centos_7_8_x64_20G_alibase_20200914.vhd"
  44.   password                   = "PigstyDemo4"
  45.   private_ip                 = "10.10.10.10"
  46.   internet_max_bandwidth_out = 40 # 40Mbps , alloc a public IP
  47. }
  49. resource "alicloud_instance" "pg-test-1" {
  50.   instance_name   = "pg-test-1"
  51.   host_name       = "pg-test-1"
  52.   instance_type   = "ecs.s6-c1m1.small"
  53.   vswitch_id      = "${alicloud_vswitch.vsw.id}"
  54.   security_groups = ["${alicloud_security_group.default.id}"]
  55.   image_id        = "centos_7_8_x64_20G_alibase_20200914.vhd"
  56.   password        = "PigstyDemo4"
  57.   private_ip      = "10.10.10.11"
  58. }
  60. resource "alicloud_instance" "pg-test-2" {
  61.   instance_name   = "pg-test-2"
  62.   host_name       = "pg-test-2"
  63.   instance_type   = "ecs.s6-c1m1.small"
  64.   vswitch_id      = "${alicloud_vswitch.vsw.id}"
  65.   security_groups = ["${alicloud_security_group.default.id}"]
  66.   image_id        = "centos_7_8_x64_20G_alibase_20200914.vhd"
  67.   password        = "PigstyDemo4"
  68.   private_ip      = "10.10.10.12"
  69. }
  71. resource "alicloud_instance" "pg-test-3" {
  72.   instance_name   = "pg-test-3"
  73.   host_name       = "pg-test-3"
  74.   instance_type   = "ecs.s6-c1m1.small"
  75.   vswitch_id      = "${alicloud_vswitch.vsw.id}"
  76.   security_groups = ["${alicloud_security_group.default.id}"]
  77.   image_id        = "centos_7_8_x64_20G_alibase_20200914.vhd"
  78.   password        = "PigstyDemo4"
  79.   private_ip      = "10.10.10.13"
  80. }
  83. output "meta_ip" {
  84.   value = "${alicloud_instance.pg-meta-1.public_ip}"
  85. }

执行计划

首先，使用terraform命令，创建上面定义的云资源（共享1C1G临时用用很便宜，按需付费）

  1. terraform init      # 安装 terraform provider: aliyun （仅第一次需要）
  2. terraform apply     # 生成执行计划：创建虚拟机，虚拟网段/交换机/安全组

执行 apply 并输入 yes后，terraform会调用阿里云API创建对应的虚拟机资源。

Terraform Apply执行结果

  1. Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols:
  2.   + create
  4. Terraform will perform the following actions:
  6.   # alicloud_instance.pg-meta-1 will be created
  7.   + resource "alicloud_instance" "pg-meta-1" {
  8.       + availability_zone                  = (known after apply)
  9.       + credit_specification               = (known after apply)
  10.       + deletion_protection                = false
  11.       + dry_run                            = false
  12.       + host_name                          = "pg-meta-1"
  13.       + id                                 = (known after apply)
  14.       + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
  15.       + instance_charge_type               = "PostPaid"
  16.       + instance_name                      = "pg-meta-1"
  17.       + instance_type                      = "ecs.s6-c1m2.small"
  18.       + internet_charge_type               = "PayByTraffic"
  19.       + internet_max_bandwidth_in          = (known after apply)
  20.       + internet_max_bandwidth_out         = 40
  21.       + key_name                           = (known after apply)
  22.       + password                           = (sensitive value)
  23.       + private_ip                         = "10.10.10.10"
  24.       + public_ip                          = (known after apply)
  25.       + role_name                          = (known after apply)
  26.       + secondary_private_ip_address_count = (known after apply)
  27.       + secondary_private_ips              = (known after apply)
  28.       + security_groups                    = (known after apply)
  29.       + spot_strategy                      = "NoSpot"
  30.       + status                             = "Running"
  31.       + subnet_id                          = (known after apply)
  32.       + system_disk_category               = "cloud_efficiency"
  33.       + system_disk_performance_level      = (known after apply)
  34.       + system_disk_size                   = 40
  35.       + volume_tags                        = (known after apply)
  36.       + vswitch_id                         = (known after apply)
  37.     }
  39.   # alicloud_instance.pg-test-1 will be created
  40.   + resource "alicloud_instance" "pg-test-1" {
  41.       + availability_zone                  = (known after apply)
  42.       + credit_specification               = (known after apply)
  43.       + deletion_protection                = false
  44.       + dry_run                            = false
  45.       + host_name                          = "pg-test-1"
  46.       + id                                 = (known after apply)
  47.       + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
  48.       + instance_charge_type               = "PostPaid"
  49.       + instance_name                      = "pg-test-1"
  50.       + instance_type                      = "ecs.s6-c1m1.small"
  51.       + internet_max_bandwidth_in          = (known after apply)
  52.       + internet_max_bandwidth_out         = 0
  53.       + key_name                           = (known after apply)
  54.       + password                           = (sensitive value)
  55.       + private_ip                         = "10.10.10.11"
  56.       + public_ip                          = (known after apply)
  57.       + role_name                          = (known after apply)
  58.       + secondary_private_ip_address_count = (known after apply)
  59.       + secondary_private_ips              = (known after apply)
  60.       + security_groups                    = (known after apply)
  61.       + spot_strategy                      = "NoSpot"
  62.       + status                             = "Running"
  63.       + subnet_id                          = (known after apply)
  64.       + system_disk_category               = "cloud_efficiency"
  65.       + system_disk_performance_level      = (known after apply)
  66.       + system_disk_size                   = 40
  67.       + volume_tags                        = (known after apply)
  68.       + vswitch_id                         = (known after apply)
  69.     }
  71.   # alicloud_instance.pg-test-2 will be created
  72.   + resource "alicloud_instance" "pg-test-2" {
  73.       + availability_zone                  = (known after apply)
  74.       + credit_specification               = (known after apply)
  75.       + deletion_protection                = false
  76.       + dry_run                            = false
  77.       + host_name                          = "pg-test-2"
  78.       + id                                 = (known after apply)
  79.       + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
  80.       + instance_charge_type               = "PostPaid"
  81.       + instance_name                      = "pg-test-2"
  82.       + instance_type                      = "ecs.s6-c1m1.small"
  83.       + internet_max_bandwidth_in          = (known after apply)
  84.       + internet_max_bandwidth_out         = 0
  85.       + key_name                           = (known after apply)
  86.       + password                           = (sensitive value)
  87.       + private_ip                         = "10.10.10.12"
  88.       + public_ip                          = (known after apply)
  89.       + role_name                          = (known after apply)
  90.       + secondary_private_ip_address_count = (known after apply)
  91.       + secondary_private_ips              = (known after apply)
  92.       + security_groups                    = (known after apply)
  93.       + spot_strategy                      = "NoSpot"
  94.       + status                             = "Running"
  95.       + subnet_id                          = (known after apply)
  96.       + system_disk_category               = "cloud_efficiency"
  97.       + system_disk_performance_level      = (known after apply)
  98.       + system_disk_size                   = 40
  99.       + volume_tags                        = (known after apply)
  100.       + vswitch_id                         = (known after apply)
  101.     }
  103.   # alicloud_instance.pg-test-3 will be created
  104.   + resource "alicloud_instance" "pg-test-3" {
  105.       + availability_zone                  = (known after apply)
  106.       + credit_specification               = (known after apply)
  107.       + deletion_protection                = false
  108.       + dry_run                            = false
  109.       + host_name                          = "pg-test-3"
  110.       + id                                 = (known after apply)
  111.       + image_id                           = "centos_7_8_x64_20G_alibase_20200914.vhd"
  112.       + instance_charge_type               = "PostPaid"
  113.       + instance_name                      = "pg-test-3"
  114.       + instance_type                      = "ecs.s6-c1m1.small"
  115.       + internet_max_bandwidth_in          = (known after apply)
  116.       + internet_max_bandwidth_out         = 0
  117.       + key_name                           = (known after apply)
  118.       + password                           = (sensitive value)
  119.       + private_ip                         = "10.10.10.13"
  120.       + public_ip                          = (known after apply)
  121.       + role_name                          = (known after apply)
  122.       + secondary_private_ip_address_count = (known after apply)
  123.       + secondary_private_ips              = (known after apply)
  124.       + security_groups                    = (known after apply)
  125.       + spot_strategy                      = "NoSpot"
  126.       + status                             = "Running"
  127.       + subnet_id                          = (known after apply)
  128.       + system_disk_category               = "cloud_efficiency"
  129.       + system_disk_performance_level      = (known after apply)
  130.       + system_disk_size                   = 40
  131.       + volume_tags                        = (known after apply)
  132.       + vswitch_id                         = (known after apply)
  133.     }
  135.   # alicloud_security_group.default will be created
  136.   + resource "alicloud_security_group" "default" {
  137.       + id                  = (known after apply)
  138.       + inner_access        = (known after apply)
  139.       + inner_access_policy = (known after apply)
  140.       + name                = "default"
  141.       + security_group_type = "normal"
  142.       + vpc_id              = (known after apply)
  143.     }
  145.   # alicloud_security_group_rule.allow_all_tcp will be created
  146.   + resource "alicloud_security_group_rule" "allow_all_tcp" {
  147.       + cidr_ip           = "0.0.0.0/0"
  148.       + id                = (known after apply)
  149.       + ip_protocol       = "tcp"
  150.       + nic_type          = "intranet"
  151.       + policy            = "accept"
  152.       + port_range        = "1/65535"
  153.       + priority          = 1
  154.       + security_group_id = (known after apply)
  155.       + type              = "ingress"
  156.     }
  158.   # alicloud_vpc.vpc will be created
  159.   + resource "alicloud_vpc" "vpc" {
  160.       + cidr_block        = "10.10.10.0/24"
  161.       + id                = (known after apply)
  162.       + ipv6_cidr_block   = (known after apply)
  163.       + name              = (known after apply)
  164.       + resource_group_id = (known after apply)
  165.       + route_table_id    = (known after apply)
  166.       + router_id         = (known after apply)
  167.       + router_table_id   = (known after apply)
  168.       + status            = (known after apply)
  169.       + vpc_name          = "pigsty-demo-network"
  170.     }
  172.   # alicloud_vswitch.vsw will be created
  173.   + resource "alicloud_vswitch" "vsw" {
  174.       + availability_zone = (known after apply)
  175.       + cidr_block        = "10.10.10.0/24"
  176.       + id                = (known after apply)
  177.       + name              = (known after apply)
  178.       + status            = (known after apply)
  179.       + vpc_id            = (known after apply)
  180.       + vswitch_name      = (known after apply)
  181.       + zone_id           = "cn-beijing-k"
  182.     }
  184. Plan: 8 to add, 0 to change, 0 to destroy.
  186. Changes to Outputs:
  187.   + meta_ip = (known after apply)
  189. Do you want to perform these actions?
  190.   Terraform will perform the actions described above.
  191.   Only 'yes' will be accepted to approve.
  193.   Enter a value: yes
  195. alicloud_vpc.vpc: Creating...
  196. alicloud_vpc.vpc: Creation complete after 6s [id=vpc-2zed78z7n5z06o1dmydhj]
  197. alicloud_security_group.default: Creating...
  198. alicloud_vswitch.vsw: Creating...
  199. alicloud_security_group.default: Creation complete after 1s [id=sg-2ze7x7zu8tcdsefroofa]
  200. alicloud_security_group_rule.allow_all_tcp: Creating...
  201. alicloud_security_group_rule.allow_all_tcp: Creation complete after 0s [id=sg-2ze7x7zu8tcdsefroofa:ingress:tcp:1/65535:intranet:0.0.0.0/0:accept:1]
  202. alicloud_vswitch.vsw: Creation complete after 6s [id=vsw-2zejctjdr16ryz194jxz4]
  203. alicloud_instance.pg-test-3: Creating...
  204. alicloud_instance.pg-test-2: Creating...
  205. alicloud_instance.pg-test-1: Creating...
  206. alicloud_instance.pg-meta-1: Creating...
  207. alicloud_instance.pg-test-3: Still creating... [10s elapsed]
  208. alicloud_instance.pg-test-2: Still creating... [10s elapsed]
  209. alicloud_instance.pg-test-1: Still creating... [10s elapsed]
  210. alicloud_instance.pg-meta-1: Still creating... [10s elapsed]
  211. alicloud_instance.pg-meta-1: Creation complete after 16s [id=i-2zef4frw6kezb47339wr]
  212. alicloud_instance.pg-test-1: Still creating... [20s elapsed]
  213. alicloud_instance.pg-test-2: Still creating... [20s elapsed]
  214. alicloud_instance.pg-test-3: Still creating... [20s elapsed]
  215. alicloud_instance.pg-test-2: Creation complete after 23s [id=i-2zefzvz0fyl7mloc4v30]
  216. alicloud_instance.pg-test-1: Still creating... [30s elapsed]
  217. alicloud_instance.pg-test-3: Still creating... [30s elapsed]
  218. alicloud_instance.pg-test-3: Creation complete after 33s [id=i-2zeeyodo2pc8b1k2d167]
  219. alicloud_instance.pg-test-1: Creation complete after 33s [id=i-2zef4frw6kezb47339ws]

SSH配置与微调

其中，管理机将分配一个按量付费的公网IP，您也可以使用命令terraform output将其打印出来。

  1. # 打印公网IP与root密码
  2. ssh_pass='PigstyDemo4'
  3. public_ip=$(terraform output | grep -Eo '[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}\.[0-9]{1,3}')
  4. echo "meta node: root:${ssh_pass}@${public_ip}"

接下来，我们先来配置本地登录云端管理机器的SSH配置（默认用户root，密码PigstyDemo4）

  1. # 创建 ~/.ssh/pigsty_terraform 文件，包含云端管理机器的SSH定义（可选，好用一点）
  2. cat > ~/.ssh/pigsty_terraform <<-EOF
  3. Host demo
  4.   User root
  5.   HostName ${public_ip}
  6.   UserKnownHostsFile /dev/null
  7.   StrictHostKeyChecking no
  8.   PasswordAuthentication yes
  9. EOF
  10. chmod 0600 ~/.ssh/pigsty_terraform 
  12. # 启用该配置
  13. if ! grep --quiet "Include ~/.ssh/pigsty_terraform" ~/.ssh/config ; then
  14.     (echo 'Include ~/.ssh/pigsty_terraform' && cat ~/.ssh/config) >  ~/.ssh/config.tmp;
  15.     mv ~/.ssh/config.tmp ~/.ssh/config && chmod 0600 ~/.ssh/config;
  16. fi

然后，您可以通过SSH别名demo访问该云端管理机了。

  1. # 添加本地到元节点的免密访问
  2. sshpass -p ${ssh_pass} ssh-copy-id demo

然后，您就可以免密从本地访问该节点了，如果只需要进行单节点安装，这样就行了。接下来，在该元节点上完成标准安装

特殊注意事项

阿里云虚拟机CentOS 7.8镜像中运行有 nscd ，锁死了 glibc 版本，会导致安装时出现RPM依赖错误。

在所有机器上执行 yum remove -y nscd 即可解决此问题。

完成上述准备工作后，所有机器准备工作已经就绪，可以开始常规的 Pigsty下载配置安装三部曲啦。

最后修改 2022-05-27: init commit (1e3e284)