apache / apache/arrow

[C++] Simplify creating a scan node

Open
#30,755 1 comment 0 reactions 0 assignees View on GitHub
Component: C++ Type: task
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

The approach taken here will depend on the approach taken by ARROW-12311. If ScanOptions is completely hidden then we need a way to create a scan node from a ScannerBuilder and a Dataset. On the other hand, if we get rid of ScannerBuilder and only have ScanOptions then no work needs to be done here.

**Reporter**: [Weston Pace](https://issues.apache.org/jira/browse/ARROW-15261) / @westonpace

**Note**: *This issue was originally created as [ARROW-15261](https://issues.apache.org/jira/browse/ARROW-15261). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*

Contributor guide

Open the contributing guide

Research direction

Start by reading ARROW-12311 and the migration documentation linked in this issue, since the implementation depends on whether ScanOptions or ScannerBuilder remains public. Then inspect the existing scan-node creation path involving ScannerBuilder and Dataset. Done means the chosen API can create a scan node consistently under the outcome of ARROW-12311.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
data-engineering
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.