mycat 集群實現過程
規划
1.1 安裝 192.168.121.52、192.168.121.238
在mycat群共享里面下載Mycat-server-1.5-alpha-20151221110028-linux.tar.gz
安裝到/usr/local目錄里面去：tar -xvf Mycat-server-1.5-alpha-20151221110028-linux.tar.gz -C /usr/local
1.2，啟動：
/usr/local/mycat/bin/mycat start
1.3，配置監聽mycat是否存活
在2台mycat服務器上開啟xinetd，啟動mycat_status服務，在Mycat server1 Mycat server2上都需要添加檢測端口48700的腳本，為此需要用到xinetd，xinetd為linux系統的基礎服務，
安裝xinetd：
添加服務：
腳本/usr/local/bin/mycat_status腳本
mycat_status腳本
在/etc/services中加入mycat_status服務
在末尾加入
[root@oracle_standby soft]# vim /etc/services
mycat_status 48700/tcp # mycat_status
保存
重啟xinetd服務
service xinetd restart
2、安裝keepalived
yum install -y openssl*
看安裝到哪里去了：
[root@cactitest ~]# find / -name ssl
/usr/include/c++/4.4.4/gnu/javax/net/ssl
/usr/include/c++/4.4.4/javax/net/ssl
/usr/include/boost/asio/ssl
/etc/cups/ssl
/etc/ssl
2.2,安裝keepalived，
yum install -y keepalived*
[root@cactitest ~]# find / -name keepalived.conf
/etc/keepalived/keepalived.conf
[root@cactitest ~]#
建檢查haproxy是否存活癿腳本
mkdir /etc/keepalived/scripts
cd /etc/keepalived/scripts
（1）keepalived.conf配置
在haproxy1上面
在haproxy2上面：
（2）check_haproxy.sh 如果沒有haproxy進程存在，就啟動haproxy，停止keepalived
（3）/etc/keepalived/scripts/haproxy_master.sh(master和slave一樣)
（4）/etc/keepalived/scripts/haproxy_backup.sh(master和slave一樣)
（5）haproxy_fault.sh(master和slave一樣)
（6）haproxy_stop.sh(master和slave一樣)
（7）啟用服務
service keepalived start
3、准備haproxy
3.1，下載當前比較新的版本
去http://fossies.org/linux/misc/haproxy-1.6.3.tar.gz/網站下載
wget http://fossies.org/linux/misc/haproxy-1.6.3.tar.gz
tar -xvf haproxy-1.6.3.tar.gz
cd haproxy-1.6.3
make TARGET=linux26 PREFIX=/usr/local/haprpxy ARCH=x86_64
make install PREFIX=/usr/local/haproxy
useradd haproxy
chown -R haproxy.haproxy *
其中報錯如下，這個問題一時解決不了，只好重做系統才能解決：
[root@oracle_standby1 haproxy-1.6.3]# make TARGET=linux26 PREFIX=/usr/local/haprpxy ARCH=x86_64
gcc -Iinclude -Iebtree -Wall -m64 -march=x86-64 -O2 -g -fno-strict-aliasing -Wdeclaration-after-statement -DTPROXY -DCONFIG_HAP_CRYPT -DENABLE_POLL -DENABLE_EPOLL -DNETFILTER -DUSE_GETSOCKNAME -DCONFIG_HAPROXY_VERSION=\"1.6.3\" -DCONFIG_HAPROXY_DATE=\"2015/12/25\" -c -o src/standard.o src/standard.c
src/standard.c: Assembler messages:
src/standard.c:1342: Error: Incorrect register `%r9' used with `l' suffix
src/standard.c:1372: Error: Incorrect register `%r9' used with `l' suffix
make: *** [src/standard.o] Error 1
[root@oracle_standby1 haproxy-1.6.3]#
haproxy.cfg
#cd /usr/local/haproxy
#touch haproxy.cfg
#vim /usr/local/haproxy/haproxy.cfg
3.3，記錄日志
haproxy記錄日志
默認haproxy是不記錄日志的，為了記錄日志還需要配置syslog模塊，在linux下是rsyslogd服務，yum –y install rsyslog先安裝rsyslog，然后
yum install -y rsyslog*
cd /etc/rsyslog.d/
vim haproxy.conf
$ModLoad imudp
$UDPServerRun 514
local0.* /var/log/haproxy.log
在#### RULES ####上面一行的地方加入以下內容：
$IncludeConfig /etc/rsyslog.d/*.conf
在
local7.* /var/log/boot.log的下面加入以下內容（增加后的效果如下）：
# Save boot messages also to boot.log
local7.* /var/log/boot.log
local0.*
重啟
service rsyslog restart
可以看到新日志
[root@cactitest rsyslog.d]# ll /var/log/haproxy.log
-rw-------. 1 root root 0 Mar 13 19:38 /var/log/haproxy.log
[root@cactitest rsyslog.d]#
3.4 啟動haproxy
啟動haproxy1、haproxy2，啟動haproxy前必須先啟動keepalived，否則啟動不了。
[root@cactitest soft]# /etc/rc.d/init.d/keepalived restart
Starting keepalived: [ OK ]
[root@cactitest soft]#
/usr/local/haproxy/sbin/haproxy -f /usr/local/haproxy/haproxy.cfg
啟動完，可以去網站查看信息：
后續繼續調試這個問題
haproxy+keepalived： 192.168.121.219
haproxy+keepalived：192.168.121.244
mycat2：192.168.121.238
1.1 安裝 192.168.121.52、192.168.121.238
在mycat群共享里面下載Mycat-server-1.5-alpha-20151221110028-linux.tar.gz
安裝到/usr/local目錄里面去：tar -xvf Mycat-server-1.5-alpha-20151221110028-linux.tar.gz -C /usr/local
1.2，啟動：
/usr/local/mycat/bin/mycat start
1.3，配置監聽mycat是否存活
在2台mycat服務器上開啟xinetd，啟動mycat_status服務，在Mycat server1 Mycat server2上都需要添加檢測端口48700的腳本，為此需要用到xinetd，xinetd為linux系統的基礎服務，
安裝xinetd：
yum install xinetd -y
添加服務：
[root@oracle_standby soft]# vim /etc/xinetd.d/mycat_statusservice mycat_status{ flags = REUSE socket_type = stream port = 48700 wait = no user = root server =/usr/local/bin/mycat_status log_on_failure += USERID disable = no}
腳本/usr/local/bin/mycat_status腳本
mycat_status腳本
#!/bin/bash#/usr/local/bin/mycat_status.sh# This script checks if a mycat server is healthy running on localhost. It will# return:## "HTTP/1.x 200 OK\r" (if mycat is running smoothly)## "HTTP/1.x 503 Internal Server Error\r" (else)mycat=`/usr/local/mycat/bin/mycatstatus | grep'not running' | wc -l`if [ "$mycat" = "0" ];then /bin/echo-e "HTTP/1.1 200 OK\r\n" else /bin/echo-e "HTTP/1.1 503 Service Unavailable\r\n"fi
在/etc/services中加入mycat_status服務
在末尾加入
[root@oracle_standby soft]# vim /etc/services
mycat_status 48700/tcp # mycat_status
保存
重啟xinetd服務
service xinetd restart
2、安裝keepalived
先安裝好openssl
yum install -y openssl*
看安裝到哪里去了：
[root@cactitest ~]# find / -name ssl
/usr/include/c++/4.4.4/gnu/javax/net/ssl
/usr/include/c++/4.4.4/javax/net/ssl
/usr/include/boost/asio/ssl
/etc/cups/ssl
/etc/ssl
[root@cactitest ~]#
[root@cactitest ~]# ldd /usr/bin/openssl linux-vdso.so.1 => (0x00007fff28f09000)libssl.so.10 => /usr/lib64/libssl.so.10 (0x00007fe3a6554000)libgssapi_krb5.so.2 => /lib64/libgssapi_krb5.so.2 (0x000000340de00000)libkrb5.so.3 => /lib64/libkrb5.so.3 (0x000000340e200000)libcom_err.so.2 => /lib64/libcom_err.so.2 (0x000000340ca00000)libk5crypto.so.3 => /lib64/libk5crypto.so.3 (0x000000340d200000)libcrypto.so.10 => /usr/lib64/libcrypto.so.10 (0x00007fe3a616e000)libdl.so.2 => /lib64/libdl.so.2 (0x0000003408200000)libz.so.1 => /lib64/libz.so.1 (0x0000003408a00000)libc.so.6 => /lib64/libc.so.6 (0x0000003407e00000)libkrb5support.so.0 => /lib64/libkrb5support.so.0 (0x000000340d600000)libkeyutils.so.1 => /lib64/libkeyutils.so.1 (0x000000340ee00000)libresolv.so.2 => /lib64/libresolv.so.2 (0x0000003409a00000)libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003408600000)/lib64/ld-linux-x86-64.so.2 (0x0000003407600000)libselinux.so.1 => /lib64/libselinux.so.1 (0x0000003409600000)[root@cactitest ~]# [root@cactitest ~]# which openssl/usr/bin/openssl[root@cactitest ~]# openssl versionOpenSSL 1.0.1e-fips 11 Feb 2013[root@cactitest ~]#
2.2,安裝keepalived，
yum install -y keepalived*
[root@cactitest ~]# find / -name keepalived.conf
/etc/keepalived/keepalived.conf
[root@cactitest ~]#
建檢查haproxy是否存活癿腳本
mkdir /etc/keepalived/scripts
cd /etc/keepalived/scripts
（1）keepalived.conf配置
在haproxy1上面
vim /etc/keepalived/keepalived.conf#! Configuration Filefor keepalivedvrrp_script chk_http_port { script"/etc/keepalived/scripts/check_haproxy.sh" interval 2 weight 2}vrrp_instance VI_1 { state MASTER #主上改為Master interface eth0 #對外提供服務的網絡接口 virtual_router_id 51 #VRRP組名，兩個節點的設置必須一樣，以指明各個節點屬於同一VRRP組 priority 150 #數值愈大，優先級越高,172.17.210.84上改為120 advert_int 1 #同步通知間隔 authentication { #包含驗證類型和驗證密碼。類型主要有PASS、AH兩種，通常使用的類型為PASS，據說AH使用時有問題 auth_type PASS auth_pass 1111 } track_script { chk_http_port #調用腳本check_haproxy.sh檢查haproxy是否存活 } virtual_ipaddress { #vip地址，這個ip必須與我們在lvs客戶端設定的vip相一致 192.168.121.103 dev eth0 scope globa } notify_master/etc/keepalived/scripts/haproxy_master.sh notify_backup/etc/keepalived/scripts/haproxy_backup.sh notify_fault /etc/keepalived/scripts/haproxy_fault.sh notify_stop /etc/keepalived/scripts/haproxy_stop.sh}
在haproxy2上面：
vim /etc/keepalived/keepalived.conf#! Configuration Filefor keepalivedvrrp_script chk_http_port { script"/etc/keepalived/scripts/check_haproxy.sh" interval 2 weight 2}vrrp_instance VI_1 { state MASTER #在主上改為Master interface eth1 #對外提供服務的網絡接口 virtual_router_id 51 #VRRP組名，兩個節點的設置必須一樣，以指明各個節點屬於同一VRRP組 priority 120 #數值愈大，優先級越高,172.17.210.64上改為120 advert_int 1 #同步通知間隔 authentication { #包含驗證類型和驗證密碼。類型主要有PASS、AH兩種，通常使用的類型為PASS，據說AH使用時有問題 auth_type PASS auth_pass 1111 } track_script { chk_http_port #調用腳本check_haproxy.sh檢查haproxy是否存活 } virtual_ipaddress { #vip地址，這個ip必須與我們在lvs客戶端設定的vip相一致 192.168.121.103 dev eth1 scope globa } notify_master /etc/keepalived/scripts/haproxy_master.sh notify_backup /etc/keepalived/scripts/haproxy_backup.sh notify_fault /etc/keepalived/scripts/haproxy_fault.sh notify_stop /etc/keepalived/scripts/haproxy_stop.sh}
（2）check_haproxy.sh 如果沒有haproxy進程存在，就啟動haproxy，停止keepalived
vim /etc/keepalived/scripts/check_haproxy.sh#!/bin/bashSTARTHAPROXY="/usr/local/haproxy/sbin/haproxy -f /usr/local/haproxy/haproxy.cfg"STOPKEEPALIVED="/etc/init.d/keepalived stop"LOGFILE="/usr/local/keepalived/var/log/keepalived-haproxy-state.log"echo "[check_haproxy status]" >> $LOGFILEA=`ps-C haproxy --no-header |wc-l`echo "[check_haproxy status]" >> $LOGFILEdate >> $LOGFILEif [ $A -eq 0 ];thenecho $STARTHAPROXY >> $LOGFILE$STARTHAPROXY >> $LOGFILE 2>&1sleep5fiif [ `ps -C haproxy --no-header |wc-l` -eq 0 ];thenexit 0elseexit 1fi
（3）/etc/keepalived/scripts/haproxy_master.sh(master和slave一樣)
vim /etc/keepalived/scripts/haproxy_master.sh#!/bin/bashSTARTHAPROXY=`/usr/local/haproxy/sbin/haproxy-f /usr/local/haproxy/haproxy.cfg`STOPHAPROXY=`ps-ef | grep sbin/haproxy | grep -vgrep |awk'{print $2}'|xargskill -s 9`LOGFILE="/usr/local/keepalived/var/log/keepalived-haproxy-state.log"echo "[master]" >> $LOGFILEdate >> $LOGFILEecho "Being master...." >> $LOGFILE 2>&1echo "stop haproxy...." >> $LOGFILE 2>&1$STOPHAPROXY >> $LOGFILE 2>&1echo "start haproxy...." >> $LOGFILE 2>&1$STARTHAPROXY >> $LOGFILE 2>&1echo "haproxy stared ..." >> $LOGFILE
（4）/etc/keepalived/scripts/haproxy_backup.sh(master和slave一樣)
vim /etc/keepalived/scripts/haproxy_backup.sh#!/bin/bashSTARTHAPROXY=`/usr/local/haproxy/sbin/haproxy-f /usr/local/haproxy/haproxy.cfg`STOPHAPROXY=`ps-ef | grep sbin/haproxy | grep -vgrep |awk'{print $2}'|xargskill -s 9`LOGFILE="/usr/local/keepalived/var/log/keepalived-haproxy-state.log"echo "[backup]" >> $LOGFILEdate >> $LOGFILEecho "Being backup...." >> $LOGFILE 2>&1echo "stop haproxy...." >> $LOGFILE 2>&1$STOPHAPROXY >> $LOGFILE 2>&1echo "start haproxy...." >> $LOGFILE 2>&1$STARTHAPROXY >> $LOGFILE 2>&1echo "haproxy stared ..." >> $LOGFILE
（5）haproxy_fault.sh(master和slave一樣)
vim /etc/keepalived/scripts/haproxy_fault.sh#!/bin/bashLOGFILE=/usr/local/keepalived/var/log/keepalived-haproxy-state.logecho "[fault]" >> $LOGFILEdate >> $LOGFILE
（6）haproxy_stop.sh(master和slave一樣)
vim /etc/keepalived/scripts/haproxy_stop.sh#!/bin/bashLOGFILE=/usr/local/keepalived/var/log/keepalived-haproxy-state.logecho "[stop]" >> $LOGFILEdate >> $LOGFILE
（7）啟用服務
service keepalived start
3、准備haproxy
3.1，下載當前比較新的版本
去http://fossies.org/linux/misc/haproxy-1.6.3.tar.gz/網站下載
wget http://fossies.org/linux/misc/haproxy-1.6.3.tar.gz
tar -xvf haproxy-1.6.3.tar.gz
cd haproxy-1.6.3
make TARGET=linux26 PREFIX=/usr/local/haprpxy ARCH=x86_64
make install PREFIX=/usr/local/haproxy
useradd haproxy
chown -R haproxy.haproxy *
其中報錯如下，這個問題一時解決不了，只好重做系統才能解決：
[root@oracle_standby1 haproxy-1.6.3]# make TARGET=linux26 PREFIX=/usr/local/haprpxy ARCH=x86_64
gcc -Iinclude -Iebtree -Wall -m64 -march=x86-64 -O2 -g -fno-strict-aliasing -Wdeclaration-after-statement -DTPROXY -DCONFIG_HAP_CRYPT -DENABLE_POLL -DENABLE_EPOLL -DNETFILTER -DUSE_GETSOCKNAME -DCONFIG_HAPROXY_VERSION=\"1.6.3\" -DCONFIG_HAPROXY_DATE=\"2015/12/25\" -c -o src/standard.o src/standard.c
src/standard.c: Assembler messages:
src/standard.c:1342: Error: Incorrect register `%r9' used with `l' suffix
src/standard.c:1372: Error: Incorrect register `%r9' used with `l' suffix
make: *** [src/standard.o] Error 1
[root@oracle_standby1 haproxy-1.6.3]#
3.2，配置haproxy.cfg功能
haproxy.cfg
#cd /usr/local/haproxy
#touch haproxy.cfg
#vim /usr/local/haproxy/haproxy.cfg
[root@cactitest ~]# more /usr/local/haproxy/haproxy.cfggloballog 127.0.0.1 local0 ##記日志的功能 maxconn 4096 chroot/usr/local/haproxy user haproxy group haproxy daemondefaults log global option dontlognull retries 3 option redispatch maxconn 2000 contimeout 5000 clitimeout 50000 srvtimeout 50000listen admin_status 192.168.121.103:48800 ##VIP stats uri/admin-status ##統計頁面 stats auth admin:admin mode http option httploglisten allmycat_service 192.168.121.103:8096 ##轉發到mycat的8066端口，即mycat的服務端口 mode tcp option tcplog option httpchk OPTIONS * HTTP/1.1\r\nHost:\ www balance roundrobin server mycat1 192.168.121.52:8066 check port 48700 inter 5s rise 2 fall 3 server mycat2 192.168.121.238:8066 check port 48700 inter 5s rise 2 fall 3 srvtimeout 20000listen allmycat_admin 192.168.121.103:8097 ##轉發到mycat的9066端口，及mycat的管理控制台端口 mode tcp option tcplog option httpchk OPTIONS * HTTP/1.1\r\nHost:\ www balance roundrobin server mycat1 192.168.121.52:9066 check port 48700 inter 5s rise 2 fall 3 server mycat2 192.168.121.238:9066 check port 48700 inter 5s rise 2 fall 3 srvtimeout 20000[root@cactitest ~]#
3.3，記錄日志
haproxy記錄日志
默認haproxy是不記錄日志的，為了記錄日志還需要配置syslog模塊，在linux下是rsyslogd服務，yum –y install rsyslog先安裝rsyslog，然后
yum install -y rsyslog*
cd /etc/rsyslog.d/
vim haproxy.conf
$ModLoad imudp
$UDPServerRun 514
local0.* /var/log/haproxy.log
在#### RULES ####上面一行的地方加入以下內容：
$IncludeConfig /etc/rsyslog.d/*.conf
在
local7.* /var/log/boot.log的下面加入以下內容（增加后的效果如下）：
# Save boot messages also to boot.log
local7.* /var/log/boot.log
local0.*
重啟
service rsyslog restart
可以看到新日志
[root@cactitest rsyslog.d]# ll /var/log/haproxy.log
-rw-------. 1 root root 0 Mar 13 19:38 /var/log/haproxy.log
[root@cactitest rsyslog.d]#
3.4 啟動haproxy
啟動haproxy1、haproxy2，啟動haproxy前必須先啟動keepalived，否則啟動不了。
[root@cactitest soft]# /etc/rc.d/init.d/keepalived restart
Starting keepalived: [ OK ]
[root@cactitest soft]#
/usr/local/haproxy/sbin/haproxy -f /usr/local/haproxy/haproxy.cfg
啟動完，可以去網站查看信息：
http://192.168.121.103:48800/admin-status
啟動有報錯，報錯信息如下：
[root@mall_hc_244 rsyslog.d]# /usr/local/haproxy/sbin/haproxy -f /usr/local/haproxy/haproxy.cfg[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:4] : unknown keyword 'chroot/usr/local/haproxy' in 'global' section[WARNING] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:14] : the 'contimeout' directive is now deprecated in favor of 'timeout connect', and will not be supported in future versions.[WARNING] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:15] : the 'clitimeout' directive is now deprecated in favor of 'timeout client', and will not be supported in future versions.[WARNING] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:16] : the 'srvtimeout' directive is now deprecated in favor of 'timeout server', and will not be supported in future versions.[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:17] : 'listen' cannot handle unexpected argument '192.168.121.103:48800'.[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:17] : please use the 'bind' keyword for listening addresses.[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:18]: unknown stats parameter 'uri/admin-status', expects 'admin', 'uri', 'realm', 'auth', 'scope', 'enable', 'hide-version', 'show-node', 'show-desc' or 'show-legends'.[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:22] : 'listen' cannot handle unexpected argument '192.168.121.103:8096'.[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:22] : please use the 'bind' keyword for listening addresses.[WARNING] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:29] : overwriting 'timeout server' which was already specified[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:30] : 'listen' cannot handle unexpected argument '192.168.121.103:8097'.[ALERT] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:30] : please use the 'bind' keyword for listening addresses.[WARNING] 073/084322 (1715) : parsing [/usr/local/haproxy/haproxy.cfg:37] : overwriting 'timeout server' which was already specified[ALERT] 073/084322 (1715) : Error(s) found in configuration file : /usr/local/haproxy/haproxy.cfg[WARNING] 073/084322 (1715) : config : proxy 'admin_status' has no 'bind' directive. Please declare it as a backend if this was intended.[WARNING] 073/084322 (1715) : config : missing timeouts for proxy 'admin_status'. | While not properly invalid, you will certainly encounter various problems | with such a configuration. To fix this, please ensure that all following | timeouts are set to a non-zero value: 'client', 'connect', 'server'.[WARNING] 073/084322 (1715) : config : log format ignored for proxy 'admin_status' since it has no log address.[WARNING] 073/084322 (1715) : config : proxy 'allmycat_service' has no 'bind' directive. Please declare it as a backend if this was intended.[WARNING] 073/084322 (1715) : config : missing timeouts for proxy 'allmycat_service'. | While not properly invalid, you will certainly encounter various problems | with such a configuration. To fix this, please ensure that all following | timeouts are set to a non-zero value: 'client', 'connect', 'server'.[WARNING] 073/084322 (1715) : config : log format ignored for proxy 'allmycat_service' since it has no log address.[WARNING] 073/084322 (1715) : config : proxy 'allmycat_admin' has no 'bind' directive. Please declare it as a backend if this was intended.[WARNING] 073/084322 (1715) : config : missing timeouts for proxy 'allmycat_admin'. | While not properly invalid, you will certainly encounter various problems | with such a configuration. To fix this, please ensure that all following | timeouts are set to a non-zero value: 'client', 'connect', 'server'.[WARNING] 073/084322 (1715) : config : log format ignored for proxy 'allmycat_admin' since it has no log address.[ALERT] 073/084322 (1715) : Fatal errors found in configuration.[root@mall_hc_244 rsyslog.d]#
后續繼續調試這個問題
注意！
本站转载的文章为个人学习借鉴使用，本站对版权不负任何法律责任。如果侵犯了您的隐私权益，请联系我们删除。