apache / apache/arrow-js

[JavaScript][Integration] IPC files do not embed a valid IPC stream

Open
#51 0 comments 0 reactions 0 assignees View on GitHub
Type: bug
Dominant language
TypeScript
Stars
112
Forks
23
Avg merge
21h 18m
Merged PRs (30d)
8

Description

### Describe the bug, including details regarding any error messages, version, and platform.

The format guarantees that each IPC file [embeds a valid IPC stream](https://github.com/apache/arrow/blob/bde6ac57ad943f5938506359de1b13fb85b4f8ea/docs/source/format/Columnar.rst) in order to allow readers to ignore the Footer, skip the file's leading magic, and reuse a stream reader.

https://github.com/apache/arrow/pull/43834 adds validation of the embedded IPC stream and files written by JavaScript fail. When writing IPC files JavaScript seems to [omit the stream's Schema message](https://github.com/apache/arrow/actions/runs/10565413633/job/29269867382?pr=43834#step:9:26987) rendering the file unreadable by a stream-only reader.

### Component(s)

Integration, JavaScript

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.