Configuring Sidekiq

原文：https://docs.gitlab.com/ee/administration/high_availability/sidekiq.html

Configuring Sidekiq

本节讨论如何配置外部 Sidekiq 实例.

Sidekiq 需要连接到 Redis，PostgreSQL 和 Gitaly 实例. 要配置 Sidekiq 节点：

  1. SSH 到 Sidekiq 服务器.

  2. 从 GitLab 下载页面使用步骤 1 和 2 下载/安装所需的 Omnibus GitLab 软件包. 不要完成下载页面上的任何其他步骤.

  3. 使用编辑器打开/etc/gitlab/gitlab.rb .

  4. 生成 Sidekiq 配置：

    1. sidekiq['listen_address'] = "10.10.1.48"
    3. ## Optional: Enable extra Sidekiq processes
    4. sidekiq_cluster['enable'] = true
    5. sidekiq_cluster['enable'] = true
    6.   "elastic_indexer"
    7. ]

  5. 设置 Sidekiq 与 Redis 的连接：

    1. ## Must be the same in every sentinel node
    2. redis['master_name'] = 'gitlab-redis'
    4. ## The same password for Redis authentication you set up for the master node.
    5. redis['master_password'] = 'YOUR_PASSOWORD'
    7. ## A list of sentinels with `host` and `port`
    8. gitlab_rails['redis_sentinels'] = [
    9.     {'host' => '10.10.1.34', 'port' => 26379},
    10.     {'host' => '10.10.1.35', 'port' => 26379},
    11.     {'host' => '10.10.1.36', 'port' => 26379},
    12.   ]

  6. 设置 Sidekiq 与 Gitaly 的连接：

    1. git_data_dirs({
    2.   'default' => { 'gitaly_address' => 'tcp://gitaly:8075' },
    3. })
    4. gitlab_rails['gitaly_token'] = 'YOUR_TOKEN'

  7. 设置 Sidekiq 与 PostgreSQL 的连接：

    1. gitlab_rails['db_host'] = '10.10.1.30'
    2. gitlab_rails['db_password'] = 'YOUR_PASSOWORD'
    3. gitlab_rails['db_port'] = '5432'
    4. gitlab_rails['db_adapter'] = 'postgresql'
    5. gitlab_rails['db_encoding'] = 'unicode'
    6. gitlab_rails['auto_migrate'] = false

    请记住将 Sidekiq 节点添加到 PostgreSQL 的受信任地址中：

    1. postgresql['trust_auth_cidr_addresses'] = %w(127.0.0.1/32 10.10.1.30/32 10.10.1.31/32 10.10.1.32/32 10.10.1.33/32 10.10.1.38/32)

  8. 禁用其他服务：

    1. nginx['enable'] = false
    2. grafana['enable'] = false
    3. prometheus['enable'] = false
    4. gitlab_rails['auto_migrate'] = false
    5. alertmanager['enable'] = false
    6. gitaly['enable'] = false
    7. gitlab_monitor['enable'] = false
    8. gitlab_workhorse['enable'] = false
    9. nginx['enable'] = false
    10. postgres_exporter['enable'] = false
    11. postgresql['enable'] = false
    12. redis['enable'] = false
    13. redis_exporter['enable'] = false
    14. puma['enable'] = false
    15. gitlab_exporter['enable'] = false

  9. Run gitlab-ctl reconfigure.

注意：发生更新并执行数据库迁移后，您将需要重新启动 Sidekiq 节点.

Example configuration

这是结尾的/etc/gitlab/gitlab.rb样子：

  1. ########################################
  2. #####        Services Disabled       ###
  3. ########################################
  5. nginx['enable'] = false
  6. grafana['enable'] = false
  7. prometheus['enable'] = false
  8. gitlab_rails['auto_migrate'] = false
  9. alertmanager['enable'] = false
  10. gitaly['enable'] = false
  11. gitlab_monitor['enable'] = false
  12. gitlab_workhorse['enable'] = false
  13. nginx['enable'] = false
  14. postgres_exporter['enable'] = false
  15. postgresql['enable'] = false
  16. redis['enable'] = false
  17. redis_exporter['enable'] = false
  18. puma['enable'] = false
  19. gitlab_exporter['enable'] = false
  21. ########################################
  22. ####              Redis              ###
  23. ########################################
  25. ## Must be the same in every sentinel node
  26. redis['master_name'] = 'gitlab-redis'
  28. ## The same password for Redis authentication you set up for the master node.
  29. redis['master_password'] = 'YOUR_PASSOWORD'
  31. ## A list of sentinels with `host` and `port`
  32. gitlab_rails['redis_sentinels'] = [
  33.     {'host' => '10.10.1.34', 'port' => 26379},
  34.     {'host' => '10.10.1.35', 'port' => 26379},
  35.     {'host' => '10.10.1.36', 'port' => 26379},
  36.   ]
  38. #######################################
  39. ###              Gitaly             ###
  40. #######################################
  42. git_data_dirs({
  43.   'default' => { 'gitaly_address' => 'tcp://gitaly:8075' },
  44. })
  45. gitlab_rails['gitaly_token'] = 'YOUR_TOKEN'
  47. #######################################
  48. ###            Postgres             ###
  49. #######################################
  50. gitlab_rails['db_host'] = '10.10.1.30'
  51. gitlab_rails['db_password'] = 'YOUR_PASSOWORD'
  52. gitlab_rails['db_port'] = '5432'
  53. gitlab_rails['db_adapter'] = 'postgresql'
  54. gitlab_rails['db_encoding'] = 'unicode'
  55. gitlab_rails['auto_migrate'] = false
  57. #######################################
  58. ###      Sidekiq configuration      ###
  59. #######################################
  60. sidekiq['listen_address'] = "10.10.1.48"
  62. #######################################
  63. ###     Monitoring configuration    ###
  64. #######################################
  65. consul['enable'] = true
  66. consul['monitoring_service_discovery'] =  true
  68. consul['configuration'] = {
  69.   bind_addr: '10.10.1.48',
  70.   retry_join: %w(10.10.1.34 10.10.1.35 10.10.1.36)
  71. }
  73. # Set the network addresses that the exporters will listen on
  74. node_exporter['listen_address'] = '10.10.1.48:9100'
  76. # Rails Status for prometheus
  77. gitlab_rails['monitoring_whitelist'] = ['10.10.1.42', '127.0.0.1']

Further reading

相关的 Sidekiq 配置：

  1. Extra Sidekiq processes
  2. Using the GitLab-Sidekiq chart