apache / apache/iceberg-cpp

Allow file reader to read without setting ReaderOptions::projection

Open
#514 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C++
Stars
221
Forks
124
Avg merge
1d 16h
Merged PRs (30d)
21

Description

Currently `ReaderOptions::projection` (https://github.com/apache/iceberg-cpp/blob/main/src/iceberg/file_reader.h#L111) is required to be set before opening a parquet/avro reader, otherwise an error will be returned complaining about this. It would be good to allow reading all columns from the file if this field is unset.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at src/iceberg/file_reader.h around ReaderOptions::projection and trace how parquet and avro readers are opened when it is unset. Verify that an unset projection reads all columns without the current error, using the relevant reader checks or tests in the repository.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
data-engineering, databases
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.