feathr-ai / feathr-ai/feathr

[FR] Add a `LocalSource` for local file source

Open
#721 0 comments 0 reactions 1 assignee Claimed by @Yuqing-cat View on GitHub
feature
Dominant language
Scala
Stars
1.9k
Forks
247
PR merge metrics
No merged PRs in 30d

Description

### Willingness to contribute

Yes. I can contribute a fix for this bug independently.

### Feature Request Proposal

Currently, If user want to define a local file as feature source, there is no specific source to use.

### Motivation

> #### What is the use case for this feature?
It's for local spark scenario.

It's ok to leverage `hdfsSource` with SQL backend, however, purview backend won't work. Will trigger source 'type' not defined Error.

### Details

_No response_

### What component(s) does this feature request affect?

- [X] `Python Client`: This is the client users use to interact with most of our API. Mostly written in Python.
- [ ] `Computation Engine`: The computation engine that execute the actual feature join and generation work. Mostly in Scala and Spark.
- [ ] `Feature Registry API`: The frontend API layer supports SQL, Purview(Atlas) as storage. The API layer is in Python(FAST API)
- [ ] `Feature Registry Web UI`: The Web UI for feature registry. Written in React

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.