apache / apache/seatunnel

Support metadata column for file source connector

Open
#9,737 4 comments 0 reactions 1 assignee Claimed by @LiJie20190102 View on GitHub
good first issue help wanted
Dominant language
Java
Stars
9.7k
Forks
2.4k
Avg merge
3d 17h
Merged PRs (30d)
210

Description

### Search before asking

- [x] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.

### Description

We should add metadata column for file source.
So each seatunnel row from file will contains metadata info too. After this we can get these information for metadata transform.

The metadata should contains:
- FilePath
- FileCreateTime
- FileUpdateTime
- FileSize
- FileType

etc.

Please refer https://github.com/apache/seatunnel/pull/9586 and https://github.com/apache/seatunnel/blob/dev/docs/en/transform-v2/metadata.md

### Usage Scenario

_No response_

### Related issues

_No response_

### Are you willing to submit a PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.