aws-samples / aws-samples/foundation-model-benchmarking-tool

parameterize configuration files

Open
#261 0 comments 0 reactions 1 assignee Claimed by @madhurprash View on GitHub
Dominant language
Jupyter Notebook
Stars
256
Forks
44
PR merge metrics
No merged PRs in 30d

Description

This issue aims to resolve the following:

The config file is a dump of all of the required information that is needed by fmbench to benchmark models, such as dataset details, experiment information, but in some cases, most of the parameters are placeholders and only a few parameters need to be changed. For this, we need to come up with a standard way to have a base config file and the most important parameters that a user would want to change parameterized as a part of command line arguments.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.