llnl / llnl/elastic-stacker

Add the ability to filter which resources to load

Open
#7 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
7
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Right now, the load mechanism pulls in all files in given resource directory. For some use cases this is not enough -- at the moment the easiest way to do a selective import is to move only the dump files you want into a separate directory and load from that.

I'd like to introduce the ability to define a set of glob patterns which would be used to select or reject which dump files to load.
These could be specified in a profile, like:

profiles:
  prod:
    include: prod_*.json
    exclude: pre_*.json

Or at the command line, as in stacker roles load --include '*_admin.json' --exclude 'temp_admin.json'.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the load mechanism and the stacker roles load command, then inspect how profiles and resource directories are read. The work is done when include and exclude glob patterns can be supplied in profiles and on the command line to select which dump files load.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.