Fork me on GitHub

分布式消息队列RocketMQ部署-进阶2

字数统计: 917字   |   阅读时长≈ 4分

RocketMQ原理

参考：分布式消息队列RocketMQ原理-进阶1

分布式部署架构

RocketMQ分布式架构

RocketMQ分布式部署

环境说明

IP地址 主机名 OS 角色 架构模式
10.0.10.25 rocketmq-master1 CentOS6 nameserver、brokerserver Master1
10.0.10.26 rocketmq-master2 CentOS6 nameserver、brokerserver Master2

hosts信息添加[全节点操作]

1
2
3
4
5
6
#vim /etc/hosts

10.0.10.25 mqnameserver1
10.0.10.26 mqnameserver2
10.0.10.25 rocketmq-master1
10.0.10.26 rocketmq-master2

JDK安装[全节点操作]

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
wget http://mirrors.linuxeye.com/jdk/jdk-7u80-linux-x64.tar.gz
mkdir -p /usr/local/jdk
tar -zxvf jdk-7u80-linux-x64.tar.gz -C /usr/local/jdk
cd /usr/local/jdk/jdk1.7.0_80/ && mv ./*  ../  
cd .. && rm -rf jdk1.7.0_80/

#配置环境变量
export PATH=$PATH:/usr/local/bin
export JAVA_HOME=/usr/local/jdk
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
export PATH=$PATH:$JAVA_HOME/bin

export ROCKETMQ_HOME=/usr/local/rocketmq
export PATH=$PATH::$ROCKETMQ_HOME/bin

#刷新环境变量
source /etc/profile

RocketMQ安装[全节点操作]

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
RocketMQ Github项目主页：https://github.com/alibaba/RocketMQ/releases

https://github.com/alibaba/rocketmq/releases/download/v3.2.6/alibaba-rocketmq-3.2.6.tar.gz

tar -zxvf v3.5.8.tar.gz -C /usr/local
ln -s rocketmq-3.5.8 rocketmq

#接下来执行/usr/local/rocketmq/bin目录下的 os.sh脚本
#echo 'deadline' > /sys/block/${DISK}/queue/scheduler
echo 'deadline' > /sys/block/sda/queue/scheduler
su - root -c 'ulimit -n'
#cat /sys/block/$DISK/queue/scheduler
cat /sys/block/sda/queue/scheduler
说明：
第一：${DISK}获取不到sda，所以变量需要改为sda; 
第二：ulimit相关设置：admin没有此用户，所以需要改为root

#执行RocketMQ官方提供的优化脚本
cd /usr/local/rocketmq/bin && sh os.sh

RocketMQ配置

Master1服务器配置：

1
2
3
4
5
cd /usr/local/rocketmq/conf/2m-noslave/
mkdir -p /data/rocketmq/store/commitlog  /data/log
vim broker-a.properties    #注：此处文件名为broker-a.properties

只关注带中文备注的参数即可
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
brokerClusterName=AdpMqCluster      #定义ClusterName
brokerName=broker-a                 #定义brokerName
brokerId=0                         
namesrvAddr=10.0.10.25:9876;10.0.10.26:9876   #配置nameserver服务器地址，以";"分割
defaultTopicQueueNums=4
autoCreateTopicEnable=true
autoCreateSubscriptionGroup=true
listenPort=10911
deleteWhen=04
fileReservedTime=120
mapedFileSizeCommitLog=1073741824
mapedFileSizeConsumeQueue=50000000
destroyMapedFileIntervalForcibly=120000
redeleteHangedFileInterval=120000
diskMaxUsedSpaceRatio=88

storePathRootDir=/data/rocketmq/store         #定义store根路径
storePathCommitLog=/data/rocketmq/store/commitlog  #定义commitlog

maxMessageSize=65536

flushCommitLogLeastPages=4
flushConsumeQueueLeastPages=2
flushCommitLogThoroughInterval=10000
flushConsumeQueueThoroughInterval=60000

brokerRole=ASYNC_MASTER
flushDiskType=ASYNC_FLUSH

checkTransactionMessageEnable=false

sendMessageThreadPoolNums=128
pullMessageThreadPoolNums=128

Master2服务器配置：

1
2
3
cd /usr/local/rocketmq/conf/2m-noslave/
mkdir -p /data/rocketmq/store/commitlog  /data/log
vim broker-b.properties    #注：此处文件名为broker-b.properties
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
brokerClusterName=AdpMqCluster   #定义ClusterName,与Master1配置一样，同属于一个集群
brokerName=broker-b              #定义brokerName，此处是broker-b
brokerId=1
namesrvAddr=10.0.10.25:9876;10.0.10.26:9876  #配置nameserver服务器地址，以";"分割
defaultTopicQueueNums=4
autoCreateTopicEnable=true
autoCreateSubscriptionGroup=true
listenPort=10911
deleteWhen=04
fileReservedTime=120
mapedFileSizeCommitLog=1073741824
mapedFileSizeConsumeQueue=50000000
destroyMapedFileIntervalForcibly=120000
redeleteHangedFileInterval=120000
diskMaxUsedSpaceRatio=88

storePathRootDir=/data/rocketmq/store       #定义store根路径
storePathCommitLog=/data/rocketmq/store/commitlog   #定义commitlog

maxMessageSize=65536

flushCommitLogLeastPages=4
flushConsumeQueueLeastPages=2
flushCommitLogThoroughInterval=10000
flushConsumeQueueThoroughInterval=60000

brokerRole=ASYNC_MASTER
flushDiskType=ASYNC_FLUSH

checkTransactionMessageEnable=false

sendMessageThreadPoolNums=128
pullMessageThreadPoolNums=128

runbroker.sh参数调整[全节点操作]

1
2
3
4
runbroker.sh需要根据内存大小进行适当地调整
cd /usr/local/rocketmq/bin

JAVA_OPT="${JAVA_OPT} -server -Xms4g -Xmx4g -Xmn2g -XX:PermSize=128m -XX:MaxPermSize=320m"

服务启动

[全节点操作]

1
2
#修改配置文件的日志路径,改为/data目录下
cd /usr/local/rocketmq/conf && sed -i  's#${user.home}#/data#g' *.xml

启动NameServer[全节点操作]

1
2
cd /usr/local/rocketmq/bin
nohup sh mqnamesrv &

扫一扫，分享到微信

tag:

    缺失模块。
    1、请确保node版本大于6.2
    2、在博客根目录（注意不是yilia-plus根目录）执行以下命令：
    npm i hexo-generator-json-content --save

    3、在根目录_config.yml里添加配置： 

      jsonContent:
    meta: false
    pages: false
    posts:
      title: true
      date: true
      path: true
      text: false
      raw: false
      content: false
      slug: false
      updated: false
      comments: false
      link: false
      permalink: false
      excerpt: false
      categories: false
      tags: true


不论我写了什么...
其实都是错的......