duckdb / duckdb/duckdb-httpfs

read_parquet : Not showing File Filter/Partition Filter in Physical Plan

Open
#23 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
60
Forks
100
Avg merge
1h 50m
Merged PRs (30d)
25

Description

We are reading below parquet file with partitions on file system, when we see Explain physical plan, one of the File Filter is missing from Plan. If this is not pushed down due to some reason then it should somewhere should be shown in the plan.

Parquet files

![Image](https://github.com/user-attachments/assets/b5db69f2-2a64-4346-ac53-5474d9e72088)

read_parquet query

EXPLAIN SELECT * FROM read_parquet('', hive_partitioning = true) where date = 20221201 and id= 'ID';

EXPLAIN plan output -> ID file filter is missing

![Image](https://github.com/user-attachments/assets/f54fca39-4ef7-4408-ad4e-d09b28676046)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by running the provided EXPLAIN SELECT query against the partitioned Parquet data with hive_partitioning enabled and compare the physical plan output. Trace how the file and partition filters are represented in the plan; done means the ID filter is shown, including when pushdown is not applied.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, sql
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.