[Improvement] Can Gravitino replace HMS?
- Dominant language
- Java
- Stars
- 3.2k
- Forks
- 935
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 315
Description
Gravitino creates the catalog by relying on an external metastore storage system. Unlike unitycatalog, creating a catalog does not depend on other Metastores.
For example, spark + hms, replaced with spark + Gravitino, create a parquet format table:
create table demos (
id long,
name string
) using parquet
spark+Flink and Gravitino are used to store metadata, instead of relying on other table metadata such as hms, glue catalog, aliyun DLF, and jdbc.
Contributor guide
Research direction
Start by comparing the described Spark plus HMS workflow with Spark or Flink plus Gravitino, including the parquet table example and the listed metastore alternatives. Done would require a defined scope and evidence that Gravitino can provide the required catalog and metadata storage without those external metastores.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100