alibaba / alibaba/DataX

mysql导入hive3.1.0 查询报错

Open
#425 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

hive版本3.1.0
文件格式:orc
mysql 成功导入hdfs orc格式 ,但在hive上查询时报错,
报错信息:java.io.IOException: java.lang.IllegalArgumentException: bucketId out of range: -1
如是设置参数set hive.fetch.task.conversion=none, 又可以查询成功

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the failure with Hive 3.1.0 against ORC data imported from MySQL, using the reported bucketId out of range error. Compare normal querying with hive.fetch.task.conversion=none; done means identifying and fixing the failing query path so the data can be queried without that workaround.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.