hdfsreader读取orc文件命令规范
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
读取hdfs orc文件时报如下错误：
Feb 10, 2022 1:32:04 PM org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator run
SEVERE: Unexpected Exception
java.lang.IllegalArgumentException: delta_0000006_0000006_0000 does not start with base_
at org.apache.hadoop.hive.ql.io.AcidUtils.parseBase(AcidUtils.java:144)
at org.apache.hadoop.hive.ql.io.AcidUtils.parseBaseBucketFilename(AcidUtils.java:172)
at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator.run(OrcInputFormat.java:544)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the HDFS reader failure when reading the reported ORC file and inspect the stack trace through org.apache.hadoop.hive.ql.io.orc.OrcInputFormat$FileGenerator and org.apache.hadoop.hive.ql.io.AcidUtils. Check how the reader command and file layout are specified; done means the supported command or required correction is documented and the reported error no longer occurs for the intended input.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 28/100