Add support for sending and receiving dictionary arrays via Flight
- Dominant language
- C#
- Stars
- 39
- Forks
- 30
- Avg merge
- 1d 9h
- Merged PRs (30d)
- 16
Description
### Describe the enhancement requested
Dictionary arrays are not supported currently in dotnet flight implementation
Initially implement dictionary support where dictionary messages are resent with every record batch. This is not as optimal as proper dictionary reuse and delta support but will unlock ability to leverage dictionary batches over flight. Related work in Rust Arrow implementation: [https://github.com/apache/arrow-rs/pull/4896](https://github.com/apache/arrow-rs/pull/4896).
Copied from
[https://github.com/apache/arrow/issues/38045](https://github.com/apache/arrow/issues/38045)
[https://github.com/apache/arrow/issues/46089](https://github.com/apache/arrow/issues/46089)
Contributor guide
Research direction
Start by reviewing the .NET Flight implementation and the related Arrow Rust PR linked in the issue. Implement initial dictionary-array support with dictionary messages resent for every record batch, and verify that Flight can send and receive dictionary arrays.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- csharp
- Domain
- api, data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100