AbsaOSS / AbsaOSS/spline

Export / Import FULL lineage of a given file or a data source

Open
#1,437 0 comments 0 reactions 0 assignees View on GitHub
feature
Dominant language
Scala
Stars
667
Forks
155
Avg merge
3d 6h
Merged PRs (30d)
4

Description

Imaginary example:
1. I have a file `A` on HDFS, and its lineage in Spline
1. I want to copy `A` to a different infrastructure (network, cluster, cloud, you name it), monitored by another independent Spline instance. And I don't want to loose the lineage of `A`
1. Using Spline UI or CLI I dump `A`'s full lineage to a file and carry it with `A` to a new infrastructure
1. There the lineage dump can be imported manually (again by using UI or CLI), or even automatically on the first Spline tracked read from `A`.

_Originally posted by @wajda in https://github.com/AbsaOSS/spline/issues/23#issuecomment-519600846_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.