5.7 其他好用的配置技巧

5.7.1 使用supervisord进行进程管理

Supervisord是一个优秀的进程管理工具，一般在部署redis时采用它来进行redis、sentinel等进程的管理，一个已经在生产环境采用的supervisord配置文件如下：
; Sample supervisor config file.
;
; For more information on the config file, please see:
; http://supervisord.org/configuration.html
;
; Notes:
; - Shell expansion (“~” or “$HOME”) is not supported. Environment
; variables can be expanded using this syntax: “%(ENV_HOME)s”.
; - Comments must have a leading space: “a=b ;comment” not “a=b;comment”. 

  1. [unix_http_server] 
  2. file=/smsred/redis-3.0.4/run/supervisor.sock ; (the path to the socket file) 
  3. ;chmod=0700 ; socket file mode (default 0700) 
  4. ;chown=nobody:nogroup ; socket file uid:gid owner 
  5. ;username=user ; (default is no username (open server)) 
  6. ;password=123 ; (default is no password (open server)) 
  8. ;[inet_http_server] ; inet (TCP) server disabled by default 
  9. ;port=127.0.0.1:9001 ; (ip_address:port specifier, *:port for all iface) 
  10. ;username=user ; (default is no username (open server)) 
  11. ;password=123 ; (default is no password (open server)) 
  13. [supervisord] 
  14. logfile=/smsred/redis-3.0.4/log/supervisord.log ; (main log file;default $CWD/supervisord.log) 
  15. logfile_maxbytes=50MB ; (max main logfile bytes b4 rotation;default 50MB) 
  16. logfile_backups=10 ; (num of main logfile rotation backups;default 10) 
  17. loglevel=info ; (log level;default info; others: debug,warn,trace) 
  18. pidfile=/smsred/redis-3.0.4/run/supervisord.pid ; (supervisord pidfile;default supervisord.pid) 
  19. nodaemon=false ; (start in foreground if true;default false) 
  20. minfds=1024 ; (min. avail startup file descriptors;default 1024) 
  21. minprocs=200 ; (min. avail process descriptors;default 200) 
  22. ;umask=022 ; (process file creation umask;default 022) 
  23. ;user=chrism ; (default is current user, required if root) 
  24. ;identifier=supervisor ; (supervisord identifier, default is 'supervisor') 
  25. ;directory=/tmp ; (default is not to cd during start) 
  26. ;nocleanup=true ; (don't clean up tempfiles at start;default false) 
  27. ;childlogdir=/tmp ; ('AUTO' child log dir, default $TEMP) 
  28. ;environment=KEY="value" ; (key value pairs to add to environment) 
  29. ;strip_ansi=false ; (strip ansi escape codes in logs; def. false) 
  31. ; the below section must remain in the config file for RPC 
  32. ; (supervisorctl/web interface) to work, additional interfaces may be 
  33. ; added by defining them in separate rpcinterface: sections 
  34. [rpcinterface:supervisor] 
  35. supervisor.rpcinterface_factory = supervisor.rpcinterface:make_main_rpcinterface 
  37. [supervisorctl] 
  38. serverurl=unix:///smsred/redis-3.0.4/run/supervisor.sock ; use a unix:// URL for a unix socket 
  39. ;serverurl=http://127.0.0.1:9001 ; use an http:// url to specify an inet socket 
  40. ;username=chris ; should be same as http_username if set 
  41. ;password=123 ; should be same as http_password if set 
  42. ;prompt=mysupervisor ; cmd line prompt (default "supervisor") 
  43. ;history_file=~/.sc_history ; use readline history if available 
  45. ; The below sample program section shows all possible program subsection values, 
  46. ; create one or more 'real' program: sections to be able to control them under 
  47. ; supervisor. 
  49. ;[program:theprogramname] 
  50. ;command=/bin/cat ; the program (relative uses PATH, can take args) 
  51. ;process_name=%(program_name)s ; process_name expr (default %(program_name)s) 
  52. ;numprocs=1 ; number of processes copies to start (def 1) 
  53. ;directory=/tmp ; directory to cwd to before exec (def no cwd) 
  54. ;umask=022 ; umask for process (default None) 
  55. ;priority=999 ; the relative start priority (default 999) 
  56. ;autostart=true ; start at supervisord start (default: true) 
  57. ;autorestart=unexpected ; whether/when to restart (default: unexpected) 
  58. ;startsecs=1 ; number of secs prog must stay running (def. 1) 
  59. ;startretries=3 ; max # of serial start failures (default 3) 
  60. ;exitcodes=0,2 ; 'expected' exit codes for process (default 0,2) 
  61. ;stopsignal=QUIT ; signal used to kill process (default TERM) 
  62. ;stopwaitsecs=10 ; max num secs to wait b4 SIGKILL (default 10) 
  63. ;stopasgroup=false ; send stop signal to the UNIX process group (default false) 
  64. ;killasgroup=false ; SIGKILL the UNIX process group (def false) 
  65. ;user=chrism ; setuid to this UNIX account to run the program 
  66. ;redirect_stderr=true ; redirect proc stderr to stdout (default false) 
  67. ;stdout_logfile=/a/path ; stdout log path, NONE for none; default AUTO 
  68. ;stdout_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB) 
  69. ;stdout_logfile_backups=10 ; # of stdout logfile backups (default 10) 
  70. ;stdout_capture_maxbytes=1MB ; number of bytes in 'capturemode' (default 0) 
  71. ;stdout_events_enabled=false ; emit events on stdout writes (default false) 
  72. ;stderr_logfile=/a/path ; stderr log path, NONE for none; default AUTO 
  73. ;stderr_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB) 
  74. ;stderr_logfile_backups=10 ; # of stderr logfile backups (default 10) 
  75. ;stderr_capture_maxbytes=1MB ; number of bytes in 'capturemode' (default 0) 
  76. ;stderr_events_enabled=false ; emit events on stderr writes (default false) 
  77. ;environment=A="1",B="2" ; process environment additions (def no adds) 
  78. ;serverurl=AUTO ; override serverurl computation (childutils) 
  80. ; The below sample eventlistener section shows all possible 
  81. ; eventlistener subsection values, create one or more 'real' 
  82. ; eventlistener: sections to be able to handle event notifications 
  83. ; sent by supervisor. 
  85. ;[eventlistener:theeventlistenername] 
  86. ;command=/bin/eventlistener ; the program (relative uses PATH, can take args) 
  87. ;process_name=%(program_name)s ; process_name expr (default %(program_name)s) 
  88. ;numprocs=1 ; number of processes copies to start (def 1) 
  89. ;events=EVENT ; event notif. types to subscribe to (req'd) 
  90. ;buffer_size=10 ; event buffer queue size (default 10) 
  91. ;directory=/tmp ; directory to cwd to before exec (def no cwd) 
  92. ;umask=022 ; umask for process (default None) 
  93. ;priority=-1 ; the relative start priority (default -1) 
  94. ;autostart=true ; start at supervisord start (default: true) 
  95. ;autorestart=unexpected ; whether/when to restart (default: unexpected) 
  96. ;startsecs=1 ; number of secs prog must stay running (def. 1) 
  97. ;startretries=3 ; max # of serial start failures (default 3) 
  98. ;exitcodes=0,2 ; 'expected' exit codes for process (default 0,2) 
  99. ;stopsignal=QUIT ; signal used to kill process (default TERM) 
  100. ;stopwaitsecs=10 ; max num secs to wait b4 SIGKILL (default 10) 
  101. ;stopasgroup=false ; send stop signal to the UNIX process group (default false) 
  102. ;killasgroup=false ; SIGKILL the UNIX process group (def false) 
  103. ;user=chrism ; setuid to this UNIX account to run the program 
  104. ;redirect_stderr=true ; redirect proc stderr to stdout (default false) 
  105. ;stdout_logfile=/a/path ; stdout log path, NONE for none; default AUTO 
  106. ;stdout_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB) 
  107. ;stdout_logfile_backups=10 ; # of stdout logfile backups (default 10) 
  108. ;stdout_events_enabled=false ; emit events on stdout writes (default false) 
  109. ;stderr_logfile=/a/path ; stderr log path, NONE for none; default AUTO 
  110. ;stderr_logfile_maxbytes=1MB ; max # logfile bytes b4 rotation (default 50MB) 
  111. ;stderr_logfile_backups ; # of stderr logfile backups (default 10) 
  112. ;stderr_events_enabled=false ; emit events on stderr writes (default false) 
  113. ;environment=A="1",B="2" ; process environment additions 
  114. ;serverurl=AUTO ; override serverurl computation (childutils) 
  116. ; The below sample group section shows all possible group values, 
  117. ; create one or more 'real' group: sections to create "heterogeneous" 
  118. ; process groups. 
  120. ;[group:thegroupname] 
  121. ;programs=progname1,progname2 ; each refers to 'x' in [program:x] definitions 
  122. ;priority=999 ; the relative start priority (default 999) 
  124. ; The [include] section can just contain the "files" setting. This 
  125. ; setting can list multiple files (separated by whitespace or 
  126. ; newlines). It can also contain wildcards. The filenames are 
  127. ; interpreted as relative to this file. Included files *cannot* 
  128. ; include files themselves. 
  130. ;[include] 
  131. ;files = relative/directory/*.ini 
  133. [program:redis-1xxx] 
  134. command=/smsred/redis-3.0.4/bin/redis-server /smsred/redis-3.0.4/conf/redis-1xxx.conf 
  135. autostart=true 
  136. autorestart=false 
  137. user=smsred 
  138. stdout_logfile=/smsred/redis-3.0.4/log/redis-1xxx.out.log 
  139. stderr_logfile=/smsred/redis-3.0.4/log/redis-1xxx.err.log 
  140. priority=1000 
  142. [program:redis-1xxx] 
  143. command=/smsred/redis-3.0.4/bin/redis-server /smsred/redis-3.0.4/conf/redis-1xxx.conf 
  144. autostart=true 
  145. autorestart=false 
  146. user=smsred 
  147. stdout_logfile=/smsred/redis-3.0.4/log/redis-1xxx.out.log 
  148. stderr_logfile=/smsred/redis-3.0.4/log/redis-1xxx.err.log 
  149. priority=1000 
  151. [program:redis-1xxx] 
  152. command=/smsred/redis-3.0.4/bin/redis-server /smsred/redis-3.0.4/conf/redis-1xxx.conf 
  153. autostart=true 
  154. autorestart=false 
  155. user=smsred 
  156. stdout_logfile=/smsred/redis-3.0.4/log/redis-1xxx.out.log 
  157. stderr_logfile=/smsred/redis-3.0.4/log/redis-1xxx.err.log 
  158. priority=1000 
  160. [program:redis-sentinel] 
  161. command =/smsred/redis-3.0.4/bin/redis-sentinel /smsred/redis-3.0.4/conf/sentinel.conf 
  162. autostart=true 
  163. autorestart=true 
  164. startsecs=3

5.7.2 使用alias方便操作

如果开多实例，那么shell下进行操作的次数会很多，因此你需要一些alias进行命令的缩短，这个技巧并不高深，但是很实用。一个实例如下：

  1. alias cli1='$HOME/redis-3.0.4/bin/redis-cli -a xxx -p 1xx' 
  2. alias cli2='$HOME/redis-3.0.4/bin/redis-cli -a xxx -p 1xx' 
  3. alias cli3='$HOME/redis-3.0.4/bin/redis-cli -a xxx -p 1xx' 
  4. alias clis='$HOME/redis-3.0.4/bin/redis-cli -p 26379' 
  6. alias sctl='supervisorctl -c $HOME/redis-3.0.4/conf/redis-supervisord.conf ' 
  7. alias sstart='supervisord -c $HOME/redis-3.0.4/conf/redis-supervisord.conf' 
  8. alias see='pdsh -R ssh -w MSMSRED[1-3],PSMSRED1,PSMSAPP1 "/usr/local/bin/supervisorctl -c /smsred/redis-3.0.4/conf/redis-supervisord.conf status "'

5.7.3 使用pdsh/pdcp进行多机器操作

Pdsh/pdcp是一个python ssh多机操作的工具，在部署中可以采用它进行多机的同一操作批量执行，注意编译的时候把ssh编译进去，在执行时指定ssh模式，一个查看多机supervisord管理进程的命令实例如下：

  1. pdsh -R ssh -w MSMSRED[1-3],PSMSRED1,PSMSAPP1 "/usr/local/bin/supervisorctl -c /smsred/redis-3.0.4/conf/redis-supervisord.conf status "

前提是你这些机器已经建立了ssh互信。建立互信可以用下边这个脚本

  1. #!/bin/bash 
  2. #2015-12-08 
  3. #author gnuhpc 
  5. expect -c "spawn ssh-keygen -t rsa 
  6. expect { 
  7. \":\" {send \"\r\"; exp_continue} 
  8. \"*(y/n)*\" {send \"y\r\"; exp_continue} 
  9. } 
  10. " 
  11. for p in $(cat ip.cfg) 
  12. do 
  13. ip=$(echo "$p"|cut -f1 -d":") 
  14. username=$(echo "$p"|cut -f2 -d":") 
  15. password=$(echo "$p"|cut -f3 -d":") 
  16. echo $password 
  18. expect -c " 
  19. spawn ssh-copy-id ${username}@$ip 
  20. expect { 
  21. \"*yes/no*\" {send \"yes\r\"; exp_continue} 
  22. \"*(y/n)*\" {send \"y\r\"; exp_continue} 
  23. \"*password*\" {send \"$password\r\"; exp_continue} 
  24. \"*Password*\" {send \"$password\r\"; exp_continue} 
  25. } 
  26. " 
  27. expect -c " 
  28. spawn ssh ${username}@$ip "hostname" 
  29. expect { 
  30. \"*yes/no*\" {send \"yes\r\"; exp_continue} 
  31. \"*password*\" {send \"$password\r\"; exp_continue} 
  32. \"*(y/n)*\" {send \"y\r\"; exp_continue} 
  33. \"*Password*\" {send \"$password\r\";} 
  34. } 
  35. " 
  36. done

指定一个ip.cfg，里面的格式为：IP（主机名也行，只要能解析）:用户名:密码
例如：

  1. xxxx.139:username:password 
  2. xxxx.140:username:password 
  3. xxxx.141:username:password 
  4. xxxx.142:username:password 
  5. xxxx.137:username:password

5.7.4 使用脚本进行sentinel配置文件的备份

Sentinel在启动、切换时会对config文件进行rewrite，在上线前或者某些手动维护后你可能希望把conf文件都变为最初，当系统中有很多redis实例时，这个手工操作会让人疯掉，那不妨写个脚本在配置好sentinel和redis后不启动先备份一下，测试完毕后再恢复。

一个简单的备份脚本如下：

  1. backupconf.sh 
  2. #!/bin/bash 
  3. for i in `find ~/redis-3.0.4/conf -name *.conf` 
  4. do 
  5. cp -v $i ${i}.bak 
  6. done

恢复脚本：

  1.  recoveryconf.sh
  2. #!/bin/bash 
  3. for i in `find ~/redis-3.0.4/conf -name *.conf.bak` 
  4. do 
  5. cp -v $i ${i%.*} 
  6. done