Cadene / Cadene/bootstrap.pytorch

Add script for basic testing

Open
#18 1 comment 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
196
Forks
30
PR merge metrics
No merged PRs in 30d

Description

## Feature
Add a script for some basic testing such as finding batch size, testing just the dataset or just the network.

## Motivation
When we are developing a new model we want to test parts of our pipeline before pursuing coding. Having a tool to just test some parts (e.g. : dataset, network creation/forward) and some setting tests before starting training (e.g. : batch size) would ease the use of the framework.

## Example of use
I imagine something like :
- `python -m bootstrap.test --batch_size 50 80 100 --options /path/to/options`
- `python -m bootstrap.test --network forward --options /path/to/options`
- `python -m bootstrap.test --dataset --options /path/to/options`

To test networks we would need datasets to generate empty items (so we don't need to load an entire dataset) so we can feed the network with batches really fast.

Contributor guide

No contributing guide indexed for this repository

Research direction

Use the proposed `python -m bootstrap.test` entry point and the example invocations as the starting contract. Define how batch-size checks, dataset-only checks, and network forward checks receive `/path/to/options`, including the empty-item dataset requirement. Done means the script supports these pipeline checks before training and documents the supported commands.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.