dlt-hub / dlt-hub/dlt

Support Avro format in filesystem destination

Open
#2,180 1 comment 4 reactions 1 assignee Claimed by @rudolfix View on GitHub
destination enhancement Feature needs decision
Dominant language
Python
Stars
5.9k
Forks
605
Avg merge
1d 14h
Merged PRs (30d)
38

Description

### Feature description

It would be great to have Avro format support to dump data as avro files to filesystem or cloud storage.

### Are you a dlt user?

I'd consider using dlt, but it's lacking a feature I need.

### Use case

Data Lake that uses Avro format by default to store raw data.

### Proposed solution

Implement format support as one of the options of `filesystem` destination similar to JSONL, Parquet and CSV.

### Related issues

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.