MeteoSwiss / MeteoSwiss/ldcast

``eval_genforecast``: No output after "Sending batch ... "

Open
#6 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
146
Forks
19
PR merge metrics
No merged PRs in 30d

Description

Hi!
Really sorry to go over the top with bugs now.
I tried the other scripts they ran fine. For the ldcast model (with 1 gpu), I find that the output is stuck after "Sending batch ...". I have tried looking into ``nvidia-smi`` and ``htop`` but it seems there is no activity. Is there an issue with the processes not able to join?

https://github.com/MeteoSwiss/ldcast/blob/b2829aeec135d9bd8ac8dd59f4830ed009b90eb5/scripts/eval_genforecast.py#LL90C5-L90C31

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with scripts/eval_genforecast.py around line 90, where the report says execution stops after "Sending batch ...". Reproduce the ldcast evaluation with one GPU and inspect the process coordination and resource activity at that point. Done means the evaluation proceeds past the message and produces its expected output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.