alibaba / alibaba/DataX

Transformer插件对于过滤数字类型字段值为null的无法过滤

Open
#2,317 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

想过滤数据库字段类型为int 值为null的字段 无法实现
`"transformer": [
{
"parameter": {
"columnIndex": 5,
"paras": [
"=",
"null"
]
},
"name": "dx_filter"
}`
Image
上述这行代码,如果字段的值不为null 代码会往下走 走到FilterTransformer:225行会报错 因为过滤的参数值是 null
Image
这行代码会报错 因为null不能转换为数字,应该是有bug 理论上如果过滤参数为null 是不是直接判断字段值为null 就直接过滤掉啊

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at FilterTransformer line 225 and trace how the dx_filter transformer handles an integer column with a null filter parameter. Reproduce the issue with the configuration shown, then verify that filtering a null integer value no longer attempts to convert null to a number and that non-null values retain the expected behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.