cirKITers / cirKITers/Split-Optimization

[BUG] Fix Test Model method

Open
#29 0 comments 0 reactions 0 assignees View on GitHub
bug lowprio
Dominant language
Jupyter Notebook
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

**Describe the bug**
Currently, the `test_dataloader` object is being used for testing **and** validation.
We should further discuss if it's required that we return all label predictions

**To Reproduce**
Run experiment

**Expected behavior**
Different dataset for validation and test

**Screenshots**
N/R

**Hardware**
N/R

**Additional context**
N/R

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by running the experiment and locating where the `test_dataloader` object is used for both validation and testing. Check how label predictions are returned and determine the intended separate validation and test datasets. Done means validation and test use different datasets, with the prediction behavior clarified.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.