DTStack / DTStack/chunjun

kafka-doris存在问题

Open
#1,574 5 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
4.1k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

### Search before asking

- [X] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar issues.

### What happened

{
"job": {
"content": [
{
"reader": {
"parameter": {
"topic": "test",
"mode": "earliest-offset",
"codec": "json",
"columns": [
{
"name": "id",
"type": "INT"

},
{
"name": "device_id",
"type": "STRING"
}
],
"consumerSettings": {
"bootstrap.servers": "172.18.8.203:9092",
"auto.commit.enable": "false"
}
},
"name": "kafkasource"
},
"writer": {
"parameter": {
"database": "db_test",
"table": "test1",
"username": "root",
"password": "",
"feNodes":
"172.18.8.207:8130"
,
"columns": [
{
"name": "id",
"comment": null,
"type": "INT",
"columnDisplaySize": 3,
"precision": 11,
"ifPrimaryKey": false,
"isnull": 1
},
{
"name": "device_id",
"comment": null,
"type": "varchar",
"columnDisplaySize": 85,
"precision": 85,
"ifPrimaryKey": false,
"isnull": 1
}
]
},
"name": "doriswriter"
}
}
],
"setting": {
"speed": {
"channel": 1
}
}
}
}

### What you expected to happen

原因:kafka接收数据往doris写入时,header为空,value有数据
![image](https://user-images.githubusercontent.com/34857750/227419672-13019be3-c90c-4578-848f-f3be3b3be94c.png)

### How to reproduce

原因:kafka接收数据往doris写入时,header为空,value有数据
![image](https://user-images.githubusercontent.com/34857750/227419672-13019be3-c90c-4578-848f-f3be3b3be94c.png)

### Anything else

_No response_

### Version

1.12_release

### Are you willing to submit PR?

- [X] Yes I am willing to submit a PR!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.