microsoft / microsoft/AzureStorageExplorer

Support ZSTD on Parquet Preview

Open
#7,675 3 comments 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
No language data
Stars
452
Forks
92
Avg merge
15h 20m
Merged PRs (30d)
3

Description

Preflight Checklist
Problem

When previewing a parquet file with ZSTD Compression, I get this error: { "name": null, "message": "\"invalid compression method: ZSTD\"" }

Desired Solution

Support ZSTD, I guess it will be used more and more often since it's often better than snappy

Alternatives and Workarounds

No response

Additional Context

No response

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the Parquet Preview flow and reproduce the reported error with a ZSTD-compressed parquet file. Trace how compression methods are handled; the work is done when the preview opens the file successfully instead of reporting an invalid compression method.

Written by the indexing model from the issue text.

Assessment

Domain
data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.