apache / apache/arrow-java

[Java] Integration Test Needed for Decoding Dictionaries Using ZSTD Compression in Java

Open
#145 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
94
Forks
152
Avg merge
3d 16h
Merged PRs (30d)
11

Description

### Describe the bug, including details regarding any error messages, version, and platform.

An [issue](https://github.com/apache/arrow/issues/37841) was identified when decoding dictionaries using ZSTD compression in Java, specifically for records that were initially generated in Go. The decoding process functions correctly for simple types, but fails when attempting to decode dictionaries.

As a solution a fix has been created [here](https://github.com/apache/arrow/pull/38371). Further, it would be better to write an integration test to verify this fix and explore it to determine whether further investigation is needed.

### Component(s)

Java

Contributor guide

Open the contributing guide

Research direction

Review the linked Apache Arrow issue and Java fix pull request first, then locate the existing Java integration tests for cross-language records and ZSTD-compressed dictionaries. Add coverage for dictionaries generated in Go and decoded in Java, and confirm the test passes with the linked fix.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.