datafusion-contrib / datafusion-contrib/liquid-cache

IPC alignment

Open
#148 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

help wanted
Dominant language
Rust
Stars
452
Forks
51
Avg merge
3h 10m
Merged PRs (30d)
12

Description

@proteetpaul pointed out that our IPC format alignment is 8 bytes, which may not be sufficient for instructions (avx512) that require 64-byte alignment.

I need to think more carefully about the alignment boundary. It might be worth checking the arrow's alignment as well.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. Trace the IPC format definition and inspect the Arrow alignment involved, then determine the required boundary for AVX-512 instructions; done means the alignment requirement is resolved and its behavior is covered appropriately.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.