apache / apache/datafusion

[Epic] A Collection of AVRO related tickets

Open
#14,096 0 comments 0 reactions 0 assignees View on GitHub
enhancement PROPOSAL EPIC
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

DataFusion can read avro files. For example see https://github.com/apache/datafusion/blob/main/datafusion/sqllogictest/test_files/avro.slt

```sql
CREATE EXTERNAL TABLE single_nan (
mycol FLOAT
)
STORED AS AVRO
LOCATION '../../testing/data/avro/single_nan.avro';
```

Here is a collection of items to improve the
- [ ] https://github.com/apache/datafusion/issues/11342
- [x] https://github.com/apache/datafusion/issues/14097

Contributor guide

Open the contributing guide

Research direction

Start with the existing AVRO example in datafusion/sqllogictest/test_files/avro.slt and review the remaining linked ticket, issue 11342. Determine the concrete AVRO improvements still required and use the checklist to define when the epic is complete.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, sql
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.