Autodesk / Autodesk/pgbelt

Add the ability to exclude tables in config

Open
#598 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
22
Forks
8
PR merge metrics
No merged PRs in 30d

Description

Problem:

1. We have a `tables` key in the config to ensure only certain tables get replicated.
2. DBs that use AWS DMS have some DMS tables with different ownership and people need to avoid replicating those tables to avoid permission issues (also those DMS tables are for minor features and can be truncated any time).
3. To exclude tables right now, you need to list out every single table except the singular DMS table. People have 100+ tables and this is proving to be painful.

The above problem can affect anyone that needs to exclude a small set of tables, but instead have to list out every single table otherwise (that list can be much larger than the exclusion)

Definition of Done:

1. Add a way to exclude tables to help with the above problem.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named in the issue. Start by locating the configuration handling and table-selection logic, then check how existing table filters are tested; done means users can configure a small exclusion list while retaining the current inclusion behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, postgresql, python
Domain
cli, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.