alibaba / alibaba/DataX

mongo的表数量大于2^31-1时入仓异常

Open
#2,140 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

integer conv to double err when mongo one collection data count max 2^31-1。

image

当mongo数据小于等于2^31-1时,mongo-client返回的为integer类型
当mongo数据大于2^31-1时,超过integer最大上限,mongo-client返回的为double类型。
所以需要判断类型,再做转换。不能统一用integer进行转换。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at the MongoDB reader's collection-count conversion where mongo-client values are converted to integer, and inspect how the count is obtained. Reproduce the case above 2^31-1 and verify that both integer and double responses are handled without the ingestion error.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mongodb
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.