AbsaOSS / AbsaOSS/pramen

Add a metastore method that returns all available tables

Open
#133 1 comment 0 reactions 0 assignees View on GitHub
enhancement Pramen-Py Pramen-Scala
Dominant language
Scala
Stars
31
Forks
4
Avg merge
1d 10m
Merged PRs (30d)
4

Description

## Background
Since the metastore can be used as a library, it could be useful to enumerate which tables exist.

## Feature
Add a method to the metastore reader that lists all tables that are available.
- [ ] Scala
- [ ] Python

## Proposed Solution
```scala
val tables: Seq[String] = metastore.getTables()
```

An idea to discuss. Usually, metastores have the concept of databases. We can simulate it by a dot prefix (db.table1). We can use this to segregate uat and prod tables, for instance.
```scala
// Fetch all tables starting with 'uat.'
val tablesUat: Seq[String] = metastore.getTables("uat")
```

> Idea. What if instead of Seq[String] the method would return Seq[Table], which would contain table name and description?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.