havakv / havakv/pycox

no loss for training with small batch size,

Open
#124 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
995
Forks
203
PR merge metrics
No merged PRs in 30d

Description

When I train the Deepsurv model with small batch size (64), there is no loss and always early stop

![WX20220127-103418](https://user-images.githubusercontent.com/40010984/151341909-530874f3-5af8-41a9-94d6-fa808a798768.png)

However, if I train with larger batch size (1024), it almost always training properly
![WX20220127-103508](https://user-images.githubusercontent.com/40010984/151342043-e8ba0aa4-e7c5-4894-b8c6-096a625cbece.png)

May I ask what might be the possible reason ? I am not familiar with the progress bar

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the Deepsurv training behavior with batch sizes 64 and 1024, comparing the reported loss, early stopping, and progress bar output. No files or tests are named, so trace the training entry point used by Deepsurv before determining whether the issue is in training or only progress reporting. Done means the cause is established and the affected behavior is corrected or clearly documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.