apache / apache/doris-streamloader

1.0.3版本不支持导入hive的textfile格式文件

Open
#39 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
36
Forks
24
PR merge metrics
No merged PRs in 30d

Description

有大量的hive的textfile格式.gz结尾的文件,使用1.0.3版本导入参数为--header="format:csv?compress_type:gz?column_separator:\t?row_delimiter:\n?strict_mode:false",导入报错read file failed,error message: EOF
但使用stream load的curl方式导入单个文件是可正常导入的

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the 1.0.3 import with the --header parameters and a Hive textfile .gz file, then compare that path with the working stream-load curl path. Trace the read failure reporting EOF; done means the compressed textfile imports successfully with the stated options.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.