Puppet扩展篇3-如何扩展master的SSL传输性能（apache）

描述：puppet使用SSL(https)协议来进行通讯，默认情况下，puppet server端使用基于Ruby的WEBRick HTTP服务器。由于WEBRick HTTP服务器在处理agent端的性能方面并不是很强劲，因此需要扩展puppet，搭建Apache或者其他强劲的web服务器来处理客户的https请求。

需要解决的问题：

  • 扩展传输方式：提高性能并增加Master和agent之间的并发连接数量。
  • 扩展SSL：采用良好的SSL证书管理方法来加密Master和agent之间的通讯。

参考：http://projects.puppetlabs.com/projects/1/wiki/Using_Passenger

1 使用Ruby Gem安装Passenger

  1. [root@puppetserver etc]# yum install ruby-devel ruby-libs rubygems libcurl-devel
  2. [root@puppetserver etc]# yum install httpd httpd-devel apr-util-devel apr-devel mod_ssl
  3. [root@puppetserver repos]# gem install --local passenger-4.0.19.gem #自动解决依赖关系，进入gem包目录进行安装
  4. Building native extensions.  This could take a while...
  5. Successfully installed rake-10.0.1
  6. Successfully installed daemon_controller-1.1.5
  7. Successfully installed rack-1.5.2
  8. Successfully installed passenger-4.0.19

2 整合Apache和Passenger

  1. [root@puppetserver rpms]# yum install gcc-c++  gcc openssl-devel #源码包编译安装（安装需要apache gcc gcc-c++ openssl-devel开发包的支持）
  2. [root@puppetserver etc]# passenger-install-apache2-module #按照相关提示解决依赖关系，安装完成之后会显示
  3. …
  4. The Apache 2 module was successfully installed.
  5. Please edit your Apache configuration file, and add these lines:
  6.    LoadModule passenger_module /usr/lib/ruby/gems/1.8/gems/passenger-4.0.19/buildout/apache2/mod_passenger.so
  7.    PassengerRoot /usr/lib/ruby/gems/1.8/gems/passenger-4.0.19
  8.    PassengerDefaultRuby /usr/bin/ruby
  10. After you restart Apache, you are ready to deploy any number of Ruby on Rails
  11. applications on Apache, without any further Ruby on Rails-specific
  12. configuration!
  13. …

3 配置Apache和Passenger

创建虚拟主机并加载passenger相关模块，注意证书路径要和puppet实际证书路径对应。虚拟主机配置Apache以监听在8140端口，并且使用SSL和Puppet Master生成的证书对所有通讯进行加密。同时还将配置Passenger来使系统的Ruby解释器并且提供Rack配置文件config.ru的路径

  1. [root@puppetserver conf.d]# vim passenger.conf
  2. LoadModule passenger_module /usr/lib/ruby/gems/1.8/gems/passenger-4.0.19/buildout/apache2/mod_passenger.so
  3. <IfModule mod_passenger.c>
  4.    PassengerRoot /usr/lib/ruby/gems/1.8/gems/passenger-4.0.19
  5.    PassengerRuby /usr/bin/ruby
  6.    PassengerHighPerformance on
  7.    PassengerMaxPoolSize 12
  8.    PassengerPoolIdleTime 1500
  9.    PassengerStatThrottleRate 120
  10.  # RailsAutoDetect On
  11. </IfModule>
  12. Listen 8140  #监听TCP 8140端口，这是PuppetMaster服务器的标准端口
  13. <VirtualHost *:8140>
  14.         SSLEngine on  #开始ssl加密
  15.         SSLProtocol -ALL +SSLv3 +TLSv1
  16.         SSLCipherSuite ALL:!ADH:RC4+RSA:+HIGH:+MEDIUM:-LOW:-SSLv2:-EXP #开启ssl加密
  18.         SSLCertificateFile      /var/lib/puppet/ssl/certs/puppetserver.kisspuppet.com.pem 
  19.         SSLCertificateKeyFile   /var/lib/puppet/ssl/private_keys/puppetserver.kisspuppet.com.pem
  20.         SSLCertificateChainFile /var/lib/puppet/ssl/ca/ca_crt.pem
  21.         SSLCACertificateFile    /var/lib/puppet/ssl/ca/ca_crt.pem
  22.         SSLCARevocationFile     /var/lib/puppet/ssl/ca/ca_crt.pem #打开证书撤销功能，当我们颁发或撤销Puppet agent的证书时，Puppet cert命令会自动更关心ca_crl.pem文件
  23.         SSLVerifyClient optional
  24.         SSLVerifyDepth  1
  25.         SSLOptions +StdEnvVars #配置Apache来验证Puppet agent证书的真实性。验证的结果会被保存在这个环境变量中，运行在Passenger中的Puppet master进程会使用这个变量来认证Puppet agent。
  27. #Puppet agent证书验证的结果会以客户端请求头的形式存放在标准环境中。
  28.         RequestHeader unset X-Forwarded-For
  29.         RequestHeader set X-SSL-Subject %{SSL_CLIENT_S_DN}e
  30.         RequestHeader set X-Client-DN %{SSL_CLIENT_S_DN}e
  31.         RequestHeader set X-Client-Verify %{SSL_CLIENT_VERIFY}e
  33.         DocumentRoot /etc/puppet/rack/puppetmaster/public/
  34.         RackBaseURI /
  35. #Rack为Web服务器提供了用来和Puppet这样的Ruby HTTP服务交换请求和响应的一些常用API。Rack经常被用于在多台Web服务器上部署如Puppet Dashboad这样的web程序。
  36.         <Directory /etc/puppet/rack/puppetmaster/>  #虚拟主机部分
  37.                 Options None
  38.                 AllowOverride None
  39.                 Order allow,deny
  40.                 allow from all
  41.         </Directory>
  42. </VirtualHost>
  1. [root@c1.inanu.net]# service httpd configtest  #检查apache配置语法是否正确
  2. Warning: DocumentRoot [/etc/puppet/rack/puppetmaster/public/] does not exist
  3. Syntax OK

备注：有关puppet虚拟主机配置可参考默认配置

  1. /usr/share/puppet/ext/rack/files/apache2.conf

4 准备config.ru配置文件

  1. [root@puppetserver rack]# mkdir -p /etc/puppet/rack/puppetmaster/{public,tmp} #为Rack和Puppet master的rack程序实例创建框架目录。
  2. [root@puppetserver rack]# cp /usr/share/puppet/ext/rack/files/config.ru /etc/puppet/rack/puppetmaster/ 
  3. [root@puppetserver rack]# vim /etc/puppet/rack/puppetmaster/config.ru  #默认即可
  5. # a config.ru, for use with every rack-compatible webserver.
  6. # SSL needs to be handled outside this, though.
  8. # if puppet is not in your RUBYLIB:
  9. # $:.unshift('/opt/puppet/lib')
  11. $0 = "master"
  13. # if you want debugging:
  14. # ARGV << "--debug"
  16. ARGV << "--rack"
  17. require 'puppet/application/master'
  18. # we're usually running inside a Rack::Builder.new {} block,
  19. # therefore we need to call run *here*.
  20. run Puppet::Application[:master].run

备注：
如果需要最新的Rack配置文件，可以在Puppet最新发行版的ext目录找到。也可以在https://github.com/puppetlabs/puppet/tree/master/ext/rack/files找到。

  1. [root@puppetserver rack]# chown puppet. /etc/puppet/rack/puppetmaster/config.ru #Rack配置文件config.ru的用户和组应该是puppet。当Apache启动时，Passenger会检查这个文件的所有者，并将其使用的账号从root切换到权限较低的puppet账户。

5 在Apache中测试PuppetMaster

  1. [root@puppetserver ~]# /etc/rc.d/init.d/puppetmaster stop #停止puppetmaster进程
  2. [root@puppetserver ~]# chkconfig puppetmaster off #防止开机自动启动
  3. [root@puppetserver ~]# /etc/rc.d/init.d/httpd start #启动apache服务
  4. [root@puppetserver ~]# chkconfig httpd off  #设置开机自动启动
  5. [root@puppetserver ~]# netstat -nlp | grep 8140  #监听8140端口
  6. tcp        0      0 :::8140             :::*          LISTEN      4162/httpd

测试一：通过浏览器（IE版本<9）访问https://172.16.200.100:8140/，出现以下信息，说明配置正确

apache+passenger替代WEBrick

测试二：在节点上运行puppet程序，在服务器端通过apache访问日志查看是否有puppet的请求，如果返回状态吗“200”表明这次请求时成功的。

  1. [root@puppetserver conf.d]# tailf  /var/log/httpd/access_log
  2. 172.16.200.101 - - [22/Jul/2013:10:30:34 +0800] "GET /production/file_metadata/modules/mysql/etc/my.cnf? HTTP/1.1" 200 298 "-" "-"
  3. 172.16.200.101 - - [22/Jul/2013:10:30:34 +0800] "GET /production/file_metadata/modules/motd/etc/motd? HTTP/1.1" 200 295 "-" "-"
  4. 172.16.200.101 - - [22/Jul/2013:10:30:35 +0800] "PUT /production/report/agent1.kisspuppet.com HTTP/1.1" 200 14 "-" "-"
  5. 172.16.200.101 - - [22/Jul/2013:10:30:40 +0800] "POST /production/catalog/agent1.kisspuppet.com HTTP/1.1" 200 8346 "-" "-"
  6. 172.16.200.101 - - [22/Jul/2013:10:30:41 +0800] "GET /production/file_metadata/modules/ssh/etc/ssh/sshd_config? HTTP/1.1"