github / github/gh-ost

When Backlog is full ,Applied is working , but copying seems stopped ,meantime disk avgrq is 50,I compare this with other buzy product server,disk is normal

Open
#402 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
13.6k
Forks
1.4k
Avg merge
2h 31m
Merged PRs (30d)
4

Description

/usr/local/src/gh-ost_1.0.34 --allow-master-master --allow-on-master --max-load=Threads_running=40 --critical-load=Threads_running=45 --chunk-size=1000 --max-lag-millis=1500 --initially-drop-old-table --initially-drop-ghost-table --dml-batch-size=100 --initially-drop-socket-file --ok-to-drop-table --host="xxx" --port=3306 --user="xx" --password="xx" --database="test" --table="gh_test" --verbose --alter="ADD column g1 varchar(20)" --switch-to-rbr --cut-over=default --default-retries=120 --panic-flag-file=/tmp/ghost.panic.flag --postpone-cut-over-flag-file=/tmp/ghost.postpone.flag --throttle-query="select 0" --execute

:595618745; State: migrating; ETA: 51s
Copy: 44678000/49894459 89.5%; Applied: 0; Backlog: 0/100; Time: 7m15s(total), 7m14s(copy); streamer: mysql-bin.000013:600332984; State: migrating; ETA: 50s
Copy: 44678000/49894459 89.5%; Applied: 0; Backlog: 0/100; Time: 7m14s(total), 7m13s(copy); streamer: mysql-bin.000013:600332984; State: migrating; ETA: 50s
Copy: 44680000/49894459 89.5%; Applied: 505; Backlog: 100/100; Time: 7m16s(total), 7m15s(copy); streamer: mysql-bin.000013:600460077; State: migrating; ETA: 50s
Copy: 44680000/49894459 89.5%; Applied: 3333; Backlog: 100/100; Time: 7m17s(total), 7m16s(copy); streamer: mysql-bin.000013:600656344; State: migrating; ETA: 50s
Copy: 44680000/49894459 89.5%; Applied: 6161; Backlog: 100/100; Time: 7m18s(total), 7m17s(copy); streamer: mysql-bin.000013:600852707; State: migrating; ETA: 51s
Copy: 44680000/49894459 89.5%; Applied: 8989; Backlog: 100/100; Time: 7m19s(total), 7m18s(copy); streamer: mysql-bin.000013:601049233; State: migrating; ETA: 51s
Copy: 44680000/49894459 89.5%; Applied: 11716; Backlog: 100/100; Time: 7m20s(total), 7m19s(copy); streamer: mysql-bin.000013:601237351; State: migrating; ETA: 51s
Copy: 44680000/49894459 89.5%; Applied: 14443; Backlog: 100/100; Time: 7m21s(total), 7m20s(copy); streamer: mysql-bin.000013:601425614; State: migrating; ETA: 51s
Copy: 44680000/49894459 89.5%; Applied: 17271; Backlog: 100/100; Time: 7m22s(total), 7m21s(copy); streamer: mysql-bin.000013:601621983; State: migrating; ETA: 51s
Copy: 44680000/49894459 89.5%; Applied: 19998; Backlog: 100/100; Time: 7m23s(total), 7m22s(copy); streamer: mysql-bin.000013:601818190; State: migrating; ETA: 51s



evice: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await r_await w_await svctm %util
sda 0.00 2.00 0.00 4.00 0.00 0.02 12.00 0.00 0.00 0.00 0.00 0.00 0.00
sdb 0.00 203.00 0.00 841.00 0.00 22.43 54.61 0.35 0.41 0.00 0.41 0.02 2.10
dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
dm-1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00







gh-ost_1.0.36 --allow-master-master --allow-on-master --max-load=Threads_running=40 --critical-load= Threads_running=45 --chunk-size=1000 --max-lag-millis=1500 --initially-drop-old-table --initially-drop-ghost-table --dml-batch-size=100 --initially-drop-socket-file --ok-to-drop-table --host="xxx" --port=3306 --user="xxx" --password="gxxx" --database="test" --table="gh_test" --verbose --alter="ADD column g1 varchar(20)" --switch-to-rbr --cut-over=default --default-retries=120 --panic-flag-file=/tmp/ghost.panic.flag --postpone-cut-over-flag-file=/tmp/ghost.postpone.flag --throttle-query="select 0" --execute


Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await r_await w_await svctm %util
sda 0.00 2.00 0.00 3.00 0.00 0.02 13.33 0.00 0.00 0.00 0.00 0.00 0.00
sdb 0.00 221.00 0.00 1667.00 0.00 98.59 121.12 5.37 3.22 0.00 3.22 0.08 13.00
dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
dm-1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await r_await w_await svctm %util
sda 0.00 2.00 0.00 3.00 0.00 0.02 13.33 0.00 0.00 0.00 0.00 0.00 0.00
sdb 0.00 224.00 0.00 1572.00 0.00 90.13 117.42 1.10 0.70 0.00 0.70 0.03 4.10
dm-0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00
dm-1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00



Copy: 10356000/51708939 20.0%; Applied: 156900; Backlog: 100/100; Time: 2m45s(total), 2m41s(copy); streamer: mysql-bin.000014:685506769; State: migrating; ETA: 10m42s
Copy: 10356000/51708939 20.0%; Applied: 169700; Backlog: 100/100; Time: 2m50s(total), 2m46s(copy); streamer: mysql-bin.000014:686398534; State: migrating; ETA: 11m2s
Copy: 10356000/51708939 20.0%; Applied: 182000; Backlog: 100/100; Time: 2m55s(total), 2m51s(copy); streamer: mysql-bin.000014:687257281; State: migrating; ETA: 11m22s
Copy: 10356000/51708939 20.0%; Applied: 194400; Backlog: 100/100; Time: 3m0s(total), 2m56s(copy); streamer: mysql-bin.000014:688124553; State: migrating; ETA: 11m42s
Copy: 10356000/51708939 20.0%; Applied: 268300; Backlog: 100/100; Time: 3m30s(total), 3m26s(copy); streamer: mysql-bin.000014:693269770; State: migrating; ETA: 13m42s



Applied is working , but copying seems stopped ,meantime disk avgrq is 50,I compare this with other buzy product server,disk is normal

Device: rrqm/s wrqm/s r/s w/s rMB/s wMB/s avgrq-sz avgqu-sz await r_await w_await svctm %util
sda 0.00 53.00 2.00 42.00 0.01 0.43 20.36 0.01 0.18 4.00 0.00 0.18 0.80
sdb 0.00 192.00 0.00 602.00 0.00 15.06 51.23 0.16 0.27 0.00 0.27 0.01 0.80
dm-0 0.00 0.00 0.00 2.00 0.00 0.06 64.00 0.00 0.00 0.00 0.00 0.00 0.00
dm-1 0.00 0.00 0.00 1.00 0.00 0.06 128.00 0.00 0.00 0.00 0.00 0.00 0.00

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.