NVIDIA-Merlin / NVIDIA-Merlin/Merlin
[RMP] Schema Editor / Creator
@EvenOldridge is already working on this.
Since Feb 2, 2023.
- Dominant language
- Python
- Stars
- 907
- Forks
- 129
- PR merge metrics
- No merged PRs in 30d
Description
Problem:
-
Merlin is a framework with many libraries in the ecosystem. Merlin is designed that the libraries are well connected. However, as a user, I want to be able to try out a library without many dependencies. For example, I want to try out Merlin Models without NVTabular. This is not possible as I require a schema file, which is not easy to create.
-
I use NVTabular for feature engineering, but I forgot to add a tag. My dataset is very large and I do not want to rerun the full pipeline to add a Tag to a column. There should be an easy way to modify a schema file without running the NVT pipeline.
Goal:
- Easy way to create a schema file (from existing parquet files) without running NVT
- Easy way to modify a schema file
New Functionality
Example: It would be great to convert schema object to JSON and/or loading a schema file from JSON
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.