linuxea:mongodb 4.4.6副本集配置笔记 version : 4.4.6先决条件1，防火墙互相放行270202, 节点配置应该一致副本集解决不了写入瓶颈，如果副本集规模越大，写入性能越会下降，副本集可以应对读多的场景序号ip配置1172.16.100.108*16 / hdd（推荐ssd）2172.16.100.118*16 / hdd（推荐ssd）3172.16.100.128*16 / hdd（推荐ssd）echo never > /sys/kernel/mm/transparent_hugepage/enabledecho never > /sys/kernel/mm/transparent_hugepage/defrag3, deploy.sh#!/bin/bash \# auther: mark \# descriptions: the shell scripts install mongodb 4.4.6 version and start script and firewalld if ! grep ntp.aliyun.com /var/spool/cron/root >/dev/null 2>&1;then (crontab -l; echo -e "10 * * * * ntpdate ntp.aliyun.com") | crontab -;fi timedatectl set-timezone Asia/Shanghai hostnamectl set-hostname mongodb1 tar xf mongodb-linux-x86_64-rhel70-4.4.6.tgz -C /usr/local cd /usr/local/ ln -s mongodb-linux-x86_64-rhel70-4.4.6 mongodb mkdir /data/mongodb/{data,logs,pid,conf} -p groupadd mongodb useradd -g mongodb mongodb chown -R mongodb.mongodb /data/mongodb ln -s /usr/local/mongodb/bin/mongo /usr/local/bin/ cp /etc/firewalld/zones/public.xml /etc/firewalld/zones/public.xml.oldone cat > /etc/firewalld/zones/public.xml << EOF <?xml version="1.0" encoding="utf-8"?> <zone> <short>Public</short> <service name="ssh"/> <service name="dhcpv6-client"/> <port protocol="tcp" port="27020"/> </zone> EOF systemctl restart firewalld cat > /etc/systemd/system/mongodb.service << EPF [Unit] Description=mongodb Service After=network.target syslog.target [Service] Environment=ZOO_LOG_DIR=/data/mongodb/logs SyslogIdentifier=mongodb User=mongodb Group=mongodb Type=forking LimitFSIZE=infinity LimitCPU=infinity LimitAS=infinity LimitMEMLOCK=infinity LimitNOFILE=64000 LimitNPROC=64000 PIDfile=/mydata/data/mongodb/pid/mongod.pid ExecReload=/bin/kill -s HUP $MAINPID ExecStart=/usr/local/mongodb/bin/mongod -f /data/mongodb/conf/mongodb.conf ExecStop=/usr/local/mongodb/bin/mongod --shutdown -f /data/mongodb/conf/mongodb.conf Restart=on-failure PrivateTmp=true [Install] WantedBy=default.target EPF systemctl daemon-reload chmod +x /etc/systemd/system/mongodb.service systemctl enable mongodb示例: 172.16.100.10/11/12echo "mongodb soft nofile 64000" >> /etc/security/limits.conf echo "mongodb hard nofile 64000" >> /etc/security/limits.conf echo "mongodb soft nproc 32000" >> /etc/security/limits.conf echo "mongodb hard nproc 32000" >> /etc/security/limits.conf echo "never" > /sys/kernel/mm/transparent_hugepage/enabled echo "never" > /sys/kernel/mm/transparent_hugepage/defragLimitFSIZE=infinity LimitCPU=infinity LimitAS=infinity LimitMEMLOCK=infinity LimitNOFILE=64000 LimitNPROC=64000配置文件10配置systemLog: destination: file logAppend: true path: /data/mongodb/logs/mongod.log storage: dbPath: /data/mongodb/data journal: enabled: true directoryPerDB: true wiredTiger: engineConfig: cacheSizeGB: 8 directoryForIndexes: true processManagement: fork: true pidFilePath: /data/mongodb/pid/mongod.pid net: port: 27020 bindIp: 0.0.0.0 #bindIp: 0.0.0.0,mongodb1,localhost # ip and hostname maxIncomingConnections: 5000 #security: # keyFile: /data/mongodb/conf/keyfile # authorization: enabled replication: # oplogSizeMB: 1024 replSetName: rs0先注释security字段，没有密码登陆。三台节点防火墙开启27020互通初始化集群直接使用mongo连入admin/usr/local/mongodb/bin/mongo 172.16.100.10:27020 --authenticationDatabase admin配置仲裁priority。如果节点配置不一样，根据配置大小调整权重比例config = { _id:"rs0", members:[ {_id:0,host:"172.16.100.10:27020",priority:90}, {_id:1,host:"172.16.100.11:27020",priority:90}, {_id:2,host:"172.16.100.12:27020",arbiterOnly:true} ] };或者不配置。节点少,不配置仲裁config = { _id:"rs0", members:[ {_id:0,host:"172.16.100.10:27020",priority:90}, {_id:1,host:"172.16.100.11:27020",priority:90}, {_id:2,host:"172.16.100.12:27020",priority:90} ] };配置集群要进入admin> use admin switched to db admin > config = { _id:"rs0", ... members:[ ... {_id:0,host:"172.16.100.10:27020",priority:90}, ... {_id:1,host:"172.16.100.11:27020",priority:90}, ... {_id:2,host:"172.16.100.12:27020",priority:90} ... ] ... } { "_id" : "rs0", "members" : [ { "_id" : 0, "host" : "172.16.100.10:27020", "priority" : 90 }, { "_id" : 1, "host" : "172.16.100.11:27020", "priority" : 90 }, { "_id" : 2, "host" : "172.16.100.12:27020", "priority" : true } ] }使用rs.initiate(config);进行初始化> rs.initiate(config); { "ok" : 1 }使用rs.status()查看状态rs0:SECONDARY> rs.status() { "set" : "rs0", "date" : ISODate("2021-05-18T02:37:24.202Z"), "myState" : 1, "term" : NumberLong(1), "syncSourceHost" : "", "syncSourceId" : -1, "heartbeatIntervalMillis" : NumberLong(2000), "majorityVoteCount" : 2, "writeMajorityCount" : 2, "votingMembersCount" : 3, "writableVotingMembersCount" : 2, "optimes" : { "lastCommittedOpTime" : { "ts" : Timestamp(1621305433, 1), "t" : NumberLong(1) }, "lastCommittedWallTime" : ISODate("2021-05-18T02:37:13.348Z"), "readConcernMajorityOpTime" : { "ts" : Timestamp(1621305433, 1), "t" : NumberLong(1) }, "readConcernMajorityWallTime" : ISODate("2021-05-18T02:37:13.348Z"), "appliedOpTime" : { "ts" : Timestamp(1621305433, 1), "t" : NumberLong(1) }, "durableOpTime" : { "ts" : Timestamp(1621305433, 1), "t" : NumberLong(1) }, "lastAppliedWallTime" : ISODate("2021-05-18T02:37:13.348Z"), "lastDurableWallTime" : ISODate("2021-05-18T02:37:13.348Z") }, "lastStableRecoveryTimestamp" : Timestamp(1621305431, 3), "electionCandidateMetrics" : { "lastElectionReason" : "electionTimeout", "lastElectionDate" : ISODate("2021-05-18T02:37:11.853Z"), "electionTerm" : NumberLong(1), "lastCommittedOpTimeAtElection" : { "ts" : Timestamp(0, 0), "t" : NumberLong(-1) }, "lastSeenOpTimeAtElection" : { "ts" : Timestamp(1621305421, 1), "t" : NumberLong(-1) }, "numVotesNeeded" : 2, "priorityAtElection" : 90, "electionTimeoutMillis" : NumberLong(10000), "numCatchUpOps" : NumberLong(0), "newTermStartDate" : ISODate("2021-05-18T02:37:11.879Z"), "wMajorityWriteAvailabilityDate" : ISODate("2021-05-18T02:37:13.328Z") }, "members" : [ { "_id" : 0, "name" : "172.16.100.10:27020", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 733, "optime" : { "ts" : Timestamp(1621305433, 1), "t" : NumberLong(1) }, "optimeDate" : ISODate("2021-05-18T02:37:13Z"), "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "", "electionTime" : Timestamp(1621305431, 1), "electionDate" : ISODate("2021-05-18T02:37:11Z"), "configVersion" : 1, "configTerm" : 1, "self" : true, "lastHeartbeatMessage" : "" }, { "_id" : 1, "name" : "172.16.100.11:27020", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 22, "optime" : { "ts" : Timestamp(1621305433, 1), "t" : NumberLong(1) }, "optimeDurable" : { "ts" : Timestamp(1621305433, 1), "t" : NumberLong(1) }, "optimeDate" : ISODate("2021-05-18T02:37:13Z"), "optimeDurableDate" : ISODate("2021-05-18T02:37:13Z"), "lastHeartbeat" : ISODate("2021-05-18T02:37:23.871Z"), "lastHeartbeatRecv" : ISODate("2021-05-18T02:37:23.378Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "172.16.100.10:27020", "syncSourceId" : 0, "infoMessage" : "", "configVersion" : 1, "configTerm" : 1 }, { "_id" : 2, "name" : "172.16.100.12:27020", "health" : 1, "state" : 7, "stateStr" : "SECONDARY", "uptime" : 22, "lastHeartbeat" : ISODate("2021-05-18T02:37:23.872Z"), "lastHeartbeatRecv" : ISODate("2021-05-18T02:37:23.876Z"), "pingMs" : NumberLong(0), "lastHeartbeatMessage" : "", "syncSourceHost" : "", "syncSourceId" : -1, "infoMessage" : "", "configVersion" : 1, "configTerm" : 1 } ], "ok" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1621305433, 1), "signature" : { "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="), "keyId" : NumberLong(0) } }, "operationTime" : Timestamp(1621305433, 1) }授权root用户创建super man用户db.createUser({user: "root", pwd: "linuxea.com", roles: [{role: "root", db: "admin"}]}); db.createUser({user: "root", pwd: "linuxea.com", roles: [{role: "dbAdminAnyDatabase", db: "admin"}]}); db.createUser({user: "marksugar", pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU", roles: [{role: "dbAdminAnyDatabase", db: "admin"}]});创建普通用户https://www.jianshu.com/p/0a7452d8843ddb.createUser( { user: "marksugar2",pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU",roles: [ { role:"readWrite", db: "marksugar" }] }) db.createUser( { user: "marksugar",pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU",roles: [ { role:"dbAdmin", db: "marksugar" }] }) db.createUser({ user: "marksugar",pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU",roles: [ { role: "dbAdmin", db: "marksugar" }]}) db.createUser({ user: "marksugar",pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU",roles: [ { role: "dbOwner", db: "marksugar" }]})如下：修改密码 db.createUser({user: "root", pwd: "linuxea.com", roles: [{role: "root", db: "admin"}]}) 执行结果 Successfully added user: { "user" : "root", "roles" : [ { "role" : "root", "db" : "admin" } ] }创建完成可以使用如下命令验证授权mongo -u root -p "linuxea.com" 17.168.0.175:27020/admin rs0:PRIMARY> db.get admin.get mongo -u marksugar -p "TdmMzIyNjRmMjViOTc1MGIwZGU" 17.168.0.175:27020/marksugar rs0:PRIMARY> db.get marksugar.get验证集群登入：mongo 172.16.100.10:27020/admin[root@localhost ~]# mongo 172.16.100.10:27020/admin MongoDB shell version v4.4.6 connecting to: mongodb://172.16.100.10:27020/admin?compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("e73613cb-6004-46b0-b229-8356c6ed8cf5") } MongoDB server version: 4.4.6 --- The server generated these startup warnings when booting: 2021-05-18T10:25:11.991+08:00: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem 2021-05-18T10:25:13.535+08:00: Access control is not enabled for the database. Read and write access to data and configuration is unrestricted 2021-05-18T10:25:13.535+08:00: /sys/kernel/mm/transparent_hugepage/enabled is 'always'. We suggest setting it to 'never' 2021-05-18T10:25:13.535+08:00: /sys/kernel/mm/transparent_hugepage/defrag is 'always'. We suggest setting it to 'never' 2021-05-18T10:25:13.535+08:00: Soft rlimits too low 2021-05-18T10:25:13.535+08:00: currentValue: 1024 2021-05-18T10:25:13.535+08:00: recommendedMinimum: 64000 --- --- Enable MongoDB's free cloud-based monitoring service, which will then receive and display metrics about your deployment (disk utilization, CPU, operation statistics, etc). The monitoring data will be available on a MongoDB website with a unique URL accessible to you and anyone you share the URL with. MongoDB may use this information to make product improvements and to suggest MongoDB products and deployment options to you. To enable free monitoring, run the following command: db.enableFreeMonitoring() To permanently disable this reminder, run the following command: db.disableFreeMonitoring() ---查看库show dbsrs0:PRIMARY> show dbs admin 0.000GB config 0.000GB local 0.000GB创建库use yxtops-testrs0:PRIMARY> use yxtops-test switched to db yxtops-test查看db.getName()rs0:PRIMARY> db.getName() yxtops-test插入：db.student.insert([{'name':'mark'},{}])rs0:PRIMARY> db.student.insert([{'name':'mark'},{}]) BulkWriteResult({ "writeErrors" : [ ], "writeConcernErrors" : [ ], "nInserted" : 2, "nUpserted" : 0, "nMatched" : 0, "nModified" : 0, "nRemoved" : 0, "upserted" : [ ] })查询rs0:PRIMARY> show tables; student rs0:PRIMARY> db.student.find() { "_id" : ObjectId("60a329d15d32fd9c982ccde1"), "name" : "mark" } { "_id" : ObjectId("60a329d15d32fd9c982ccde2") }验证登陆其他节点： mongo 172.16.100.11:27020/admin/usr/local/mongodb/bin/mongo -u root -p 'linuxea.com' 172.16.100.11:27020 --authenticationDatabase admin打开读rs0:SECONDARY> rs.slaveOk()进入其他库验证rs0:SECONDARY> use yxtops-test switched to db yxtops-test rs0:SECONDARY> show tables; student rs0:SECONDARY> db.student.find() { "_id" : ObjectId("60a329d15d32fd9c982ccde1"), "name" : "mark" } { "_id" : ObjectId("60a329d15d32fd9c982ccde2") }用户认证集群与集群之间要使用Keyfile。首先创建keyfile。而后复制到其他节点[root@mongodb1 ~]# cd /data/mongodb/conf/ [root@mongodb1 conf]# openssl rand -base64 756 > keyfile [root@mongodb1 conf]# chmod 400 keyfile [root@mongodb1 conf]# pwd /mydata/data/mongodb/conf chown mongodb.mongodb keyfile将内容复制到其他两个节点：cd /mydata/data/mongodb/conf for i in 11 12;do scp keyfile 172.16.100.$i:/mydata/data/mongodb/conf/;done for i in 11 12;do ssh 172.16.100.$i chmod 400 /mydata/data/mongodb/conf/keyfile;done for i in 11 12;do ssh 172.16.100.$i chown mongodb.mongodb /mydata/data/mongodb/conf/keyfile;done或者直接把keyfil文件内容粘贴出来复制到其他两个节点cat > keyfile << EOF kSb+lVdnA9K9/fJnldG65Vvem3r0dKHX/4ag0qcAIZ1Bl87VxmqVho5vKtDMZLN1 uQE9aZ4A3gZ0LFgdPpIXkAHazP9ZqNqBfIJO6JRpBDClFuN8KU1FIJI1ghyVTTAh sjPgdGr8NB7bnloPfm92LwT5kArNMuAd6aqa5EggmpnUZmxkpc81msx39S2mLsxC YEerP0Rj0j8ZA36hsgOsHy+PGvADhjcscqIFAbcqKSpP0CJGZC2WQLUo6EfL0/u9 ChLcUJp0FNgW2vguVXyOjwIhv+x9Rn7fHGokidjnVl54sylPz4AYBtgdmLXsmxi8 5JFXl56kT5W/SD5tvG1IJtteGJfyrWmVqOjbAqhQd6JSQ5zOvRVCUqpndxVy/IRP fw1thjQdBkpcLzf92rUqTUSyANsPV+M1/3L6VEU0KmarkL5yxQvKHlYR1/MtSr7+ bI1UvPsXAMdXWoyZUuZDAeh+J1mMlebeNZ7lYJagskd4SVk9sQoQfmAEnjTuJvSz xpvW4cbJIjzGx58rrfZ/DX+JowhDcsom3Icvl/PlV2JK3CEs4Rna0C70z4KZ0W7B uEY34aTi3IKS3dXQ06qNu3Zja3Zeff9CK2tW0CUs+MiO7Jqp1pVVZRHT6mrG3HWF VbcmvOiHBoEt0/YoMSU6fQsJMgk16Zv53GF0UvY3ZF3x1w6OKT5u7kp9OzHWnPr0 oK6fogfEgi94VBpdSHOXKUyeEI+0LgX8xSb4rmTn4Ud3tBCxXbnqlgVzEuBG+r55 chO4Xmk53FDW5UGtBC9QMWCtGT2I3vymEmKDlnIpzqQXJoKNOQi8UcIw/fluZeaG a1tcaaNn7Vrt9eNfgrBy1w7jL/6FGWF+lhbRmlTAMOMU6k4nGWinaZZA/MAmQmr8 55Y99wT18feHlt+FDH0eSewk6HnTW5QxZYgudP+V89/2vMQHH5vXEBD0JeDHSrpY rkTWULfr9s8nXxoDr5tbLxP1oc+CULt1pZOwXH+Exx5fQuT8 EOF chown mongodb.mongodb keyfile chmod 400 keyfile在配置文件中取消注释security: keyFile: /mydata/data/mongodb/conf/keyfile authorization: enabled而后关闭三台mongodb节点，关闭完成后再依次启动删除用户rs0:PRIMARY> db.dropUser("marksugar") true登陆开启认证后登陆：创建操作等，只能在PRIMARY节点操作才可以。通过rs.status()查看/usr/local/mongodb/bin/mongo -u root -p 'linuxea.com' 172.16.100.10:27020 --authenticationDatabase admin创建其他库和授权库用户use marksugar db.createUser({user: "marksugar",pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU",roles: [ { role: "dbAdmin", db: "marksugar" }]}); db.createUser({user: "marksugar", pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU", roles: [{role: "dbOwner", db: "marksugar"}]}); db.createUser({ user: "marksugar",pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU",roles: [ { role: "dbAdmin", db: "marksugar" }] }) db.createUser({ user: "marksugar",pwd: "TdmMzIyNjRmMjViOTc1MGIwZGU",roles: [ { role: "dbAdmin", db: "marksugar" }]}) db.createUser({user: "root", pwd: "linuxea.com", roles: [{role: "root", db: "admin"}]}); db.createUser({user: "root", pwd: "linuxea.com", roles: [{role: "dbAdminAnyDatabase", db: "admin"}]});插入rs0:PRIMARY> use marksugar switched to db marksugar rs0:PRIMARY> db marksugar rs0:PRIMARY> db.marksugar.insert({"name":"mark"}) WriteResult({ "nInserted" : 1 }) rs0:PRIMARY> show dbs admin 0.000GB config 0.000GB marksugar 0.000GB local 0.001GB rs0:PRIMARY>登陆marksugar/usr/local/mongodb/bin/mongo -u marksugar -p "TdmMzIyNjRmMjViOTc1MGIwZGU" 172.16.100.10:27020/marksugar监控授权db.grantRolesToUser("root", [{role:"__system", db:"admin"}]) db.grantRolesToUser("root", [{role:"dbAdminAnyDatabase", db:"admin"}]);如下：mongo -u root -p "linuxea.com" 172.16.100.10:27020/admin rs0:PRIMARY> use admin switched to db admin rs0:PRIMARY> db.grantRolesToUser("root", [{role:"__system", db:"admin"}]) rs0:PRIMARY> db.grantRolesToUser("root", [{role:"dbAdminAnyDatabase", db:"admin"}]);副本读rs.slaveOk()或者rs.secondaryOk()日志清理logpath日志中存储了日志过程。将会保留7天#!/bin/bash IPADDRES=172.16.100.10:27020 DBNAME=admin USERNAME="USER_NAME" PASSWORDS="PASSWORD" LOGPATHS=/var/log/mongodb LOGDYA=7 # mongodb logpath logfile roll mongo ${IPADDRES}/${DBNAME} --authenticationDatabase ${DBNAME} -u ${USERNAME} -p "${PASSWORDS}" --eval "db.runCommand({logRotate:1});" sleep 3s # logfile delete last 7 days find ${LOGPATHS}/mongod.log.20* -type f -mtime +${LOGDYA} -delete # 1 12 * * * /bin/bash /data/script/mongomore.sh其他参考mongodb4.4.8复制(副本)集简单配置mongodb

linuxea:mongodb性能诊断工具 下载mongodb-database-tools后就自带了mongostat命令使用mongostat使用超级管理员查看admin库 1 是间隔1秒的意思 ./mongostat -h 127.0.0.1:27020 -u superadmin --password=password --authenticationDatabase=admin 1insert query update delete getmore command ：在最近的一秒钟发生的操作。getmore：是针对一些游标操作，第一次拿了100条，而游标返回了10000w条，需要一次次抓回来，这里表示有多少个getmore在执行command ：表示除了增删改查，包含增删改查，包括index等状态的命令都是通过command 来完成的dirty ：mongodb是通过内存来缓存和增加数据，mongodb通过缓存来管理一些数据，默认是百分之60的内存使用，在这些内存之间有多少是被更新的，修改的，或者插入的。这些操作且没有刷盘的，就是dirty。这里的百分比表示没有刷盘的占用百分比。如果没有超过百分之5，后台程序会5分钟刷一次数据到盘上。如果百分比超过5，后台会启动程序自动把这些刷到盘上。从而尽量的保证在百分之5以下。而一旦超过百分之20，mongodb可能会停止接受前面的请求也要将数据刷到盘上，也就是超过百分之20时阻塞新请求。这种情况，要么是刷盘跟不上，磁盘IO跟不上。要么是写入压力太大。used ：默认是百分之60的内存使用，百分之60的内存已经有百分之多少被使用了。低于百分之80的时候，mongdb不会做什么事情，超过百分之80开始清理动作，基于一些很久没有被使用的数据剔除，缓存清理动作。超过百分之95时阻塞新请求，并专注于清理缓存。vsize ：使用的内存大小res: 实际使用的内存大小qrw /arw ： 超过10存在等待net_in /net_out ： 进出conn ： 连接数使用mongotop./mongotop -h 127.0.0.1:27020 -u superadmin --password=password --authenticationDatabase=admin 2间隔2秒抓一次ns : 来源库total：总时间消耗read：读时间消耗write：写时间消耗使用日志配置db.getProfilingStatus()查看是否开启rs02:PRIMARY> db.getProfilingStatus() { "was" : 1, "slowms" : 10, "sampleRate" : 1, "$clusterTime" : { "clusterTime" : Timestamp(1628512885, 1), "signature" : { "hash" : BinData(0,"RXoRmbr9npCqd6IxClxVYWeIjzg="), "keyId" : NumberLong("6993996578134425604") } }, "operationTime" : Timestamp(1628512885, 1) }设置：db.setProfilingLevel(level, slowms)查看：db.system.profile.find()evel：0，关闭；1，记录慢速操作；2，记录所有操作。slowms：时间阈值，单位ms。表示10毫秒的：db.setProfilingLevel( 1 , 10);默认100ms示例2019-10-25T11:20:30.775+0800 I COMMAND [conn12] command test.test appName: "MongoDB Shell" command: find { find: "test", filter: { i: 10000.0 }, $db: "test" } planSummary: COLLSCAN keysExamined:0 docsExamined:27108 cursorExhausted:1 numYields:211 nreturned:1 reslen:243 locks:{ Global: { acquireCount: { r: 424 } }, Database: { acquireCount: { r: 212 } }, Collection: { acquireCount: { r: 212 } } } protocol:op_command 19msdocsExamined ： 扫描文档数locks： 锁信息numYields: 执行计划durationMillis: 执行时间mtoolshttps://github.com/rueckstiess/mtools/releaseshttps://github.91chifun.workers.dev//https://github.com/rueckstiess/mtools/archive/refs/tags/v1.6.4.tar.gzmtools可以分析mongo日志yum install python3 -ytar xf v1.6.4.tar.gz && cd mtools-1.6.4 python3 setup.py install常用指令：• mplotqueries 日志文件：将所有慢查询通过图表形式展现；• mloginfo --queries 日志文件：总结出所有慢查询的模式和出现次数、消耗时间等；

linuxea:mongodb4.4.8复制(副本)集简单配置 mongodb复制集是原生提供这种方式 ，复制集的主要意义在于实现服务的高可用，它的依赖于两个方面的功能输入写入时将数据快速复制到另外一个独立节点上在接受写入的节点发生故障时自动选举一个新的替代节点在实现高可用的同时，复制集实现了其他几个附加的作用数据分发： 将数据 从一个区域复制到另一个 区域，减少另一个区域的读延迟读写分离：不同类型的压力分别在不同的节点上执行异地容灾：在数据中心故障的时候快速的切换到异地一个典型的复制集由三个以上的具有投票权的节点组成，包括：一个主节点 (PRIMARY)： 接受写入 操作和选举时投票两个或多个从节点 (SECONDARY) : 复制主节点上的新数据 和选举时投票不推荐使用Arbiter(投票节点)数据是如何复制的？当一个修改操作 ，无论是插入更新或者删除，到达主节点时，他对数据的操作被记录下来，经过一些 必要的转换，这些记录 称为oplog从节点通过在主节点上打开一个 tailable游标不断获取新进入的主节点的oplog，并在自己的数据上回放，以此保持跟主节点的数据一致通过选举完成的故障恢复具有投票 圈的节点两两互信发送心跳当5次心跳未收到时判断为节点失联如果失联的是主节点，从节点发起选举，选出新的主节点如果失联的是从节点则不会产生新 的选举选举基于RAFT一致性算法实现，选举成功的必要条件是大多数投票节点存活复制集中最多可以有50个节点，但具有投票权的节点最多 7个影响选举的因素整个集群必须有大多数节点存货被选举为主节点的节点必须满足以下条件：能够与多数节点建立连接具有较新 的oplog具有较高的优先级(如果配置了的话)复制集节点有一下常见的选配项目 ：是否具有投票权（v）： 有就参与投票优先级（priority）：优先级越高的节点优先称为主节点，优先级为0的节点无法称为主节点隐藏（hidden）：复制 数据，但对应用不可见。隐藏节点可以 具有投票权，但优先级必须 为0延迟（slaveDelay）：复制n秒之前的数据，保持与主节点的 时间差（通常用来作为一个规避误操作的备份节点）复制集的注意事项所有的节点都有可能称为主节点，配置应该一致复制集版本一致在写频繁的情况下，增加节点不会增加系统的写性能。除非是读多写少的情况其他配置ssh-keygen -t rsa ssh-copy-id 172.16.100.92 ssh-copy-id 172.16.100.93配置ulimit[root@Node-172_16_100_91 ~]# ulimit -n 1000000安装脚本if ! grep ntp.aliyun.com /var/spool/cron/root >/dev/null 2>&1;then (crontab -l; echo -e "10 * * * * ntpdate ntp.aliyun.com") | crontab -;fi timedatectl set-timezone Asia/Shanghai hostnamectl set-hostname mongodb1 wget https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-rhel70-4.4.8.tgz tar xf mongodb-linux-x86_64-rhel70-4.4.8.tgz -C /usr/local cd /usr/local/ ln -s mongodb-linux-x86_64-rhel70-4.4.8 mongodb ## ulimit echo "never" > /sys/kernel/mm/transparent_hugepage/defrag echo "never" > /sys/kernel/mm/transparent_hugepage/enabled groupadd -r -g 490 mongodb useradd -u 490 -s /sbin/nologin -c 'mongodb server' -g mongodb mongodb -M mkdir /u01/data/mongodb/{data,logs,pid,conf} -p chown -R mongodb.mongodb /u01/data/mongodb ln -s /usr/local/mongodb/bin/mongo /usr/local/bin/ #cp /etc/firewalld/zones/public.xml /etc/firewalld/zones/public.xml.oldone #cat > /etc/firewalld/zones/public.xml << EOF #<?xml version="1.0" encoding="utf-8"?> #<zone> # <short>Public</short> # <service name="ssh"/> # <service name="dhcpv6-client"/> # <port protocol="tcp" port="27020"/> #</zone> #EOF #systemctl restart firewalld firewall-cmd --permanent --zone=public --add-rich-rule='rule family="ipv4" source address="172.16.100.0/24" port port="27020" protocol="tcp" accept' firewall-cmd --reload firewall-cmd --list-all cat > /etc/systemd/system/mongodb.service << EPF [Unit] Description=mongodb Service After=network.target syslog.target [Service] Environment=ZOO_LOG_DIR=/u01/data/mongodb/logs SyslogIdentifier=mongodb LimitFSIZE=infinity LimitCPU=infinity LimitAS=infinity LimitMEMLOCK=infinity LimitNOFILE=64000 LimitNPROC=64000 User=mongodb Group=mongodb Type=forking PIDfile=/u01/data/mongodb/pid/mongod.pid ExecReload=/bin/kill -s HUP $MAINPID ExecStart=/usr/local/mongodb/bin/mongod -f /u01/data/mongodb/conf/mongodb.conf ExecStop=/usr/local/mongodb/bin/mongod --shutdown -f /u01/data/mongodb/conf/mongodb.conf Restart=on-failure PrivateTmp=true [Install] WantedBy=default.target EPF systemctl daemon-reload chmod +x /etc/systemd/system/mongodb.service systemctl enable mongodb配置文件配置文件ip和域名ip域名主机名172.16.100.91mongo1.linuxea.com mongo2.linuxea.commogodb_instance1172.16.100.92mongo3.linuxea.com mongo4.linuxea.commogodb_instance2172.16.100.93mongo5.linuxea.com mongo5.linuxea.commogodb_instance3echo "172.16.100.91 mogodb_instance1 mongo1.linuxea.com mongo2.linuxea.com" >> /etc/hosts echo "172.16.100.92 mogodb_instance2 mongo3.linuxea.com mongo4.linuxea.com" >> /etc/hosts echo "172.16.100.93 mogodb_instance3 mongo5.linuxea.com mongo6.linuxea.com" >> /etc/hosts修改每个节点的主机名for i in static pretty transient; do hostnamectl set-hostname mogodb_instance1 --$i; done节点1cat > /u01/data/mongodb/conf/mongodb.conf << EOF systemLog: destination: file logAppend: true path: /u01/data/mongodb/logs/mongod.log storage: dbPath: /u01/data/mongodb/data journal: enabled: true directoryPerDB: true wiredTiger: engineConfig: cacheSizeGB: 2 directoryForIndexes: true processManagement: fork: true pidFilePath: /u01/data/mongodb/pid/mongod.pid net: port: 27020 bindIp: localhost,mongo1.linuxea.com maxIncomingConnections: 5000 #security: #keyFile: /u01/data/mongodb/conf/keyfile #authorization: enabled replication: # oplogSizeMB: 1024 replSetName: rs02 EOF节点2cat > /u01/data/mongodb/conf/mongodb.conf << EOF systemLog: destination: file logAppend: true path: /u01/data/mongodb/logs/mongod.log storage: dbPath: /u01/data/mongodb/data journal: enabled: true directoryPerDB: true wiredTiger: engineConfig: cacheSizeGB: 2 directoryForIndexes: true processManagement: fork: true pidFilePath: /u01/data/mongodb/pid/mongod.pid net: port: 27020 bindIp: localhost,mongo3.linuxea.com maxIncomingConnections: 5000 #security: #keyFile: /u01/data/mongodb/conf/keyfile #authorization: enabled replication: # oplogSizeMB: 1024 replSetName: rs02 EOF节点3cat > /u01/data/mongodb/conf/mongodb.conf << EOF systemLog: destination: file logAppend: true path: /u01/data/mongodb/logs/mongod.log storage: dbPath: /u01/data/mongodb/data journal: enabled: true directoryPerDB: true wiredTiger: engineConfig: cacheSizeGB: 2 directoryForIndexes: true processManagement: fork: true pidFilePath: /u01/data/mongodb/pid/mongod.pid net: port: 27020 bindIp: localhost,mongo5.linuxea.com maxIncomingConnections: 5000 #security: #keyFile: /data/mongodb/conf/keyfile #authorization: enabled replication: # oplogSizeMB: 1024 replSetName: rs02 EOF初始化rs.initiate({ _id: "rs02", "members" : [ { "_id": 0, "host" : "mongo1.linuxea.com:27020" }, { "_id": 1, "host" : "mongo3.linuxea.com:27020" }, { "_id": 2, "host" : "mongo5.linuxea.com:27020" } ] });执行> rs.initiate({ ... _id: "rs02", ... "members" : [ ... { ... "_id": 0, ... "host" : "mongo1.linuxea.com:27020" ... }, ... { ... "_id": 1, ... "host" : "mongo3.linuxea.com:27020" ... }, ... { ... "_id": 2, ... "host" : "mongo5.linuxea.com:27020" ... } ... ] ... }); { "ok" : 1 }稍等片刻等待状态：SECONDARY变为PRIMARYrs02:SECONDARY> rs02:PRIMARY> rs02:PRIMARY> rs02:PRIMARY> rs02:PRIMARY> sh.status() printShardingStatus: this db does not have sharding enabled. be sure you are connecting to a mongos from the shell and not to a mongod. rs02:PRIMARY> rs.status() { ............. "members" : [ { "_id" : 0, "name" : "mongo1.linuxea.com:27020", "health" : 1, "state" : 1, "stateStr" : "PRIMARY", "uptime" : 66, ......... "_id" : 1, "name" : "mongo3.linuxea.com:27020", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 20, ........... "_id" : 2, "name" : "mongo5.linuxea.com:27020", "health" : 1, "state" : 2, "stateStr" : "SECONDARY", "uptime" : 20, .......... rs02:PRIMARY> 开启集群认证和用户认证mongodb默认没有一个超级用户的，默认任何人都可以登录。当开启用户认证后仍然可以不使用密码登录，但是不使用密码登录，不能访问里面的资源 ，且只能创建用户创建用户创建超级用户db.createUser({ user: 'superadmin', pwd: 'password', roles: [{role: 'root', db: 'admin'}] } )执行rs02:PRIMARY> use admin switched to db admin rs02:PRIMARY> db.createUser({ ... user: 'superadmin', ... pwd: 'password', ... roles: [{role: 'root', db: 'admin'}] ... } ... ) Successfully added user: { "user" : "superadmin", "roles" : [ { "role" : "root", "db" : "admin" } ] }而后就使用创建的账户登录mongo --host mongo3.linuxea.com:27020 -u superadmin -p password --authenticationDatabase admin而后创建mark库的读写用户当创建了amdin用户后，开启认证后，只能登录admin授权其他用户db.createUser({ user: 'writer', pwd: 'password', roles: [{role: 'readWrite', db: 'mark'}] } ) db.createUser({ user: 'reader', pwd: 'password', roles: [{role: 'read', db: 'mark'}] } )创建mark库的读写超级用户db.createUser({ user: 'mark', pwd: 'TdmMzIyNjRmMjViOTc1MGIwZGU', roles: [{role: 'dbAdmin', db: 'mark'}] } )一旦这样授权，在登录的时候就需要指定库--authenticationDatabase markmongo --host mongo3.linuxea.com:27020 -u mark -p TdmMzIyNjRmMjViOTc1MGIwZGU --authenticationDatabase mark创建集群认证文件用户创建完成后，还需要创建集群内认证文件 cd /u01/data/mongodb/conf/ openssl rand -base64 756 > keyfile chmod 400 keyfile chown mongodb.mongodb keyfile复制到92和93scp keyfile 172.16.100.92:/u01/data/mongodb/conf/ scp keyfile 172.16.100.93:/u01/data/mongodb/conf/ ssh 172.16.100.92 "chown mongodb.mongodb /u01/data/mongodb/conf/keyfile" ssh 172.16.100.93 "chown mongodb.mongodb /u01/data/mongodb/conf/keyfile" ssh 172.16.100.93 "chmod 400 /u01/data/mongodb/conf/keyfile" ssh 172.16.100.92 "chmod 400 /u01/data/mongodb/conf/keyfile"开启securitysecurity: keyFile: /u01/data/mongodb/conf/keyfile authorization: enabled而后重启集群并观察日志systemctl restart mongodb tail -f /u01/data/mongodb/logs/mongod.log 尝试登录超级管理登录[root@Node-172_16_100_91 ~]# mongo --host mongo1.linuxea.com:27020 -u superadmin -p password --authenticationDatabase admin MongoDB shell version v4.4.8 connecting to: mongodb://mongo1.linuxea.com:27020/?authSource=admin&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("4f20880e-2ab3-44b6-8ce9-825640ef13d4") } MongoDB server version: 4.4.8 --- Enable MongoDB's free cloud-based monitoring service, which will then receive and display metrics about your deployment (disk utilization, CPU, operation statistics, etc). The monitoring data will be available on a MongoDB website with a unique URL accessible to you and anyone you share the URL with. MongoDB may use this information to make product improvements and to suggest MongoDB products and deployment options to you. To enable free monitoring, run the following command: db.enableFreeMonitoring() To permanently disable this reminder, run the following command: db.disableFreeMonitoring() --- rs02:PRIMARY> show dbs admin 0.000GB config 0.000GB local 0.027GB mark 0.007GBmark用户登录[root@Node-172_16_100_91 ~]# mongo --host mongo3.linuxea.com:27020 -u mark -p TdmMzIyNjRmMjViOTc1MGIwZGU --authenticationDatabase mark MongoDB shell version v4.4.8 connecting to: mongodb://mongo3.linuxea.com:27020/?authSource=mark&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("b6204420-bf30-452f-9cef-e7bb84c73a4d") } MongoDB server version: 4.4.8 rs02:SECONDARY> 登录PRIMARY[root@Node-172_16_100_91 ~]# mongo --host mongo1.linuxea.com:27020 -u mark -p TdmMzIyNjRmMjViOTc1MGIwZGU --authenticationDatabase mark MongoDB shell version v4.4.8 connecting to: mongodb://mongo1.linuxea.com:27020/?authSource=mark&compressors=disabled&gssapiServiceName=mongodb Implicit session: session { "id" : UUID("9d19034d-e7b9-4ccb-b657-bc84122d0468") } MongoDB server version: 4.4.8 rs02:PRIMARY> show dbs mark 0.007GB rs02:PRIMARY> 开启从节点读slaveOk()添加节点rs.add("hostname And ip:port")Compose下载compass进行配置选择Fill in connection fields individually