apache / apache/datafusion

Add `read_parquet` SQL UDF

Open
#3,773 1 comment 1 reaction 0 assignees View on GitHub
enhancement sql
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
I just tried DuckDB for the first time and I liked this syntax:

```
CREATE VIEW nation AS SELECT * FROM read_parquet('/mnt/bigdata/tpch/sf10-parquet-float//nation/*.parquet')
```

This is much easier than `CREATE EXTERNAL TABLE`.

**Describe the solution you'd like**
Steal this idea

**Describe alternatives you've considered**
None

**Additional context**
None

Contributor guide

Open the contributing guide

Research direction

No files or tests are named. Start by locating DataFusion's SQL UDF or table-function registration and its Parquet reader, then compare the requested read_parquet behavior with the CREATE VIEW example in the issue. Done means that example can create a view over the matching Parquet files.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, sql
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.