pingcap/tidb-binlog

View on GitHub

A tool used to collect and merge tidb's binlog for real-time data backup and synchronization.

Stars: 291
Forks: 131
Open beginner issues: 0
Indexed issues: 75
Avg merge: 5m
Merged PRs (30d): 2

Dominant language: Go
License: Apache-2.0
Last GitHub push: Aug 20, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

75 open issues indexed

Drainer's memory usage exponentially increases when filtering too many DELETE events, leading to OOM Open

affects-5.4 affects-6.5

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1317 · 2 comments · Opened Aug 27, 2024
Support retrying ADD PRIMARY KEY Open

affects-6.5 affects-7.1 affects-7.5 affects-8.1 type/bug

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

pingcap/tidb-binlog#1312 · Opened Aug 9, 2024
remove arbiter Open

feature-request

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1310 · Opened Jul 31, 2024
drainer upgrade fail from v7.0.0 to v7.1.1 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1267 · 1 comment · Opened Sep 26, 2023
gcTS and alertGCTS aren't meaningful Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

pingcap/tidb-binlog#1262 · Opened Jul 11, 2023
make test failed Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1249 · Opened Jun 18, 2023
drainer savepoint 文件里面的commitTS 更新机制疑问，会不会导致drainer 数据不一致？ Open

question

Difficulty 5/5 Over a week Newbie friendliness 20/100

pingcap/tidb-binlog#1227 · Opened Apr 27, 2023
The pump component panics abnormally Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1225 · 1 comment · Opened Apr 4, 2023
Start drainer server failed due to table `dm_meta`.`testdm_syncer_checkpoint`: table not exist Open

type/bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

pingcap/tidb-binlog#1217 · Opened Feb 28, 2023
Check the status of all the Pump or Drainer nodes will hit 1105 error with enable tls between tidb enabled Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1216 · Opened Feb 28, 2023
Adds the binlog-drainer synchronization time monitor Open

feature-request

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1211 · 1 comment · Opened Feb 20, 2023
Support monitoring metrics for reparo Open

affects-5.4 feature-request

Difficulty 5/5 Over a week Newbie friendliness 20/100

pingcap/tidb-binlog#1208 · Opened Sep 2, 2022
Oracle syncer potential deadlock problems Open

affects-6.1 affects-8.5 severity/major type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1201 · 5 comments · Opened Aug 25, 2022
timestamp incorrect after sync by binlog Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1187 · 5 comments · Opened Aug 16, 2022
Drainer should not retry on long time ddls directly Open

feature-request

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1169 · 1 comment · Opened Jun 21, 2022
drainer: rtrim char type column in sql Open

affects-6.1 severity/moderate type/bug

Difficulty 3/5 1-2 days Newbie friendliness 38/100

pingcap/tidb-binlog#1164 · 4 comments · Opened May 25, 2022
drainer: process empty string from tidb in update/delete statement on oracle Open

affects-6.1 severity/moderate type/bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

pingcap/tidb-binlog#1162 · Opened May 25, 2022
Drainer:sync lob data to oracle Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

pingcap/tidb-binlog#1157 · Opened Apr 19, 2022
drainer报错： filterTable failed: not found table id: 49499 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1143 · Opened Mar 17, 2022
Drianer can't start with configuration `syncer.to.checkpoint.schema` contains "-" Open

type/bug

pingcap/tidb-binlog#1139 · 1 assignee · Opened Mar 10, 2022
support multi-k8s in grafana dashboards Open

feature-request

Difficulty 3/5 1-2 days Newbie friendliness 35/100

pingcap/tidb-binlog#1134 · Opened Feb 24, 2022
Drainer: quote in the value of column lead to error when syncing to oracle Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

pingcap/tidb-binlog#1131 · Opened Jan 20, 2022
Drainer: SyncDDL switcher does not work when syncing to oracle Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

pingcap/tidb-binlog#1129 · Opened Jan 17, 2022
drainer异常退出后不能自动重启 Open

type/bug

pingcap/tidb-binlog#1125 · 1 assignee · Opened Jan 13, 2022
fix default commit_ts in tiup-cluster Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1116 · Opened Jan 5, 2022
drainer OOM in old cluster Open

status/help-wanted type/enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1112 · 2 comments · Opened Dec 28, 2021
drainer is not compatiable with placement rules Open

type/bug

Difficulty 4/5 3-5 days Newbie friendliness 30/100

pingcap/tidb-binlog#1111 · 3 comments · Opened Dec 28, 2021
Drainer: Support TiDB to Oracle Replication Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 25/100

pingcap/tidb-binlog#1110 · Opened Dec 27, 2021
Add a metrics to observe the cost time for drainer to pull binlogs from pump Open

feature-request

Difficulty 3/5 1-2 days Newbie friendliness 45/100

pingcap/tidb-binlog#1064 · Opened Aug 9, 2021
Add drainer node name column in downstream checkpoint schema Open

status/help-wanted type/enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1063 · 3 reactions · Opened Aug 9, 2021
Drainer interrupts several times when meeting some incompatible DDLs Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 25/100

pingcap/tidb-binlog#1060 · Opened Jul 23, 2021
Drop a table in downstream should not impact binlog replication of other tables Open

feature-request

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1059 · 1 comment · Opened Jul 6, 2021
Optimize the TiBinlogToTxn stage Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 25/100

pingcap/tidb-binlog#1056 · Opened Jun 13, 2021
Optimize DELETE performance for range deletion Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 30/100

pingcap/tidb-binlog#1055 · Opened Jun 13, 2021
Catch-up ETA in grafana dashboard Open

feature-request

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1054 · 2 reactions · Opened Jun 13, 2021
readTimeout is too small for mysql loader Open

severity/moderate type/bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

pingcap/tidb-binlog#1053 · Opened Jun 13, 2021
Overwrite happened in Downstream while Capital Letter and lower case Duplicate entry Open

affects-6.1 affects-6.2 affects-6.3 affects-6.4 affects-6.5 affects-6.6 affects-7.0 affects-7.1 affects-7.5 affects-8.1 affects-8.5 severity/major type/bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1046 · 2 comments · Opened May 25, 2021
improve document to explain initial-commit-ts and syncer.to.password/encrypted_password Open

feature-request

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

pingcap/tidb-binlog#1045 · Opened May 14, 2021
Incorrect datetime value failed binlog syncing Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

pingcap/tidb-binlog#1036 · 2 comments · Opened Feb 25, 2021
drainer: ddl order is not guaranteed Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1034 · Opened Dec 31, 2020
bilateral synchronization: Write conflict could happen in update mark table Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1022 · 1 comment · Opened Dec 3, 2020
Parse longtext data type value getting wrong when using reparo to file Open

Difficulty 1/5 Under an hour Newbie friendliness 58/100

pingcap/tidb-binlog#1019 · Opened Dec 1, 2020
drainer: the sync order between transactions are not guaranteed Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1014 · Opened Nov 19, 2020
support to specify downstream host with multiple IPs Open

feature-request

Difficulty 4/5 3-5 days Newbie friendliness 35/100

pingcap/tidb-binlog#1013 · Opened Nov 16, 2020
drainer 支持带kerberos的kafka Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 18/100

pingcap/tidb-binlog#1008 · Opened Nov 12, 2020
4.0.x TIDB with TiFlash to Mysql Drainer get error when use 'ALTER TABLE t1 SET TIFLASH REPLICA n' Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 25/100

pingcap/tidb-binlog#1004 · Opened Oct 12, 2020
After an invalid connection error occurs, drainer's processing logic isn't working as expected Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 30/100

pingcap/tidb-binlog#1001 · Opened Sep 11, 2020
tikv has already be moved to other machine,but drainer still send msg to it Open

severity/moderate type/bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

pingcap/tidb-binlog#1000 · 5 comments · Opened Sep 3, 2020
support ipv6 for binlogctl Open

feature-request

Difficulty 5/5 Over a week Newbie friendliness 25/100

pingcap/tidb-binlog#995 · Opened Aug 7, 2020
Wish to support log consume from relay log Open

question

Difficulty 5/5 Over a week Newbie friendliness 25/100

pingcap/tidb-binlog#991 · 3 comments · Opened Jul 29, 2020

pingcap/tidb-binlog

Get new issues in your inbox