alibaba / alibaba/DataX

使用DataX迁移mysql到oceanbase,bit字段报内容超长

Open
#1,782 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

使用环境 】测试环境
【 OB or 其他组件 】OB、MySQL、DataX
【 使用版本 】OB:5.7.25-OceanBase_CE-v4.0.0.0-OceanBase_CE 4.0.0.0,MySQL:8.0.29,DataX:datax_v202303
【问题描述】使用DataX迁移mysql到oceanbase,bit字段报内容超长
【复现路径】mysql和oceanbase中建了同一张表,里面有bit类型的字段,同步失败
【问题现象及影响】
表里有bit类型的字段,使用DataX同步失败,报bit类型的字段内容超长
【附件】
报错:
![image](https://user-images.githubusercontent.com/9332487/237063092-750ac8af-af30-40b0-9387-6f7466cbcb3e.png)
oceanbase中的表结构:
![image](https://user-images.githubusercontent.com/9332487/237063159-9bcdcb70-4b4b-4b23-8d6c-cb1707684f20.png)
mysql中的表结构:
![image](https://user-images.githubusercontent.com/9332487/237063243-19219110-5b1c-4367-9e46-d74f45ede7ae.png)
mysql中的数据:
![image](https://user-images.githubusercontent.com/9332487/237063287-c42bc4e6-5eb0-4848-9125-9d95f8b5630c.png)
DataX的json配置:
![image](https://user-images.githubusercontent.com/9332487/237063368-d6e73720-fecf-420d-9a12-8e59a4db6f67.png)

https://ask.oceanbase.com/t/topic/35603364

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the migration with the DataX JSON configuration, matching MySQL and OceanBase table definitions, and a bit field as described. Compare the reported oversized-content error with the attached schemas and data; done means the same bit field synchronizes successfully without the error.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.