apache / apache/kyuubi

[TASK][EASY] Create simple atlas table entity in kyuubi lineage plugin

Open
#6,309 0 comments 0 reactions 1 assignee Claimed by @wForget View on GitHub
Dominant language
Scala
Stars
2.4k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

### What's the level of this task?

EASY

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before creating

- [X] I have searched in the [task list](https://github.com/orgs/apache/projects/343) and found no similar tasks.

### Mentor

- [X] I have sufficient expertise on this task, and I volunteer to be a mentor of this task to guide contributors through the task.

### Skill requirements

- knowledge on kyuubi and apache atlas

### Background and Goals

Currently, kyuubi lineage plugin only creates atlas `spark_process` entity. If table entity is not created in advance through other way, it will not be ingested into atlas.

### Implementation steps

We need to create table entities (spark_table or hive_table) while creating spark_process entity.

### Additional context

Introduction of [2024H1 Kyuubi Code Contribution Program](https://github.com/apache/kyuubi/issues/6232)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.