ESMCI / ESMCI/inputdataTools

Possibly no safety check when staged file is corrupted with Cntrl-C Interrupt

Aperta
#23 5 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
0
Fork
2
Merge medio
3g 2h
PR unite (30g)
2

Descrizione

Hello,

I'm not sure if this is a question or a feature request, but I recently tried to rimport a new runoff dataset. Halfway through the first file, I interrupted it with Cntrl-C, and it looks like the file was corrupted in the staging area (about 8GB too small).

If I had permissions for relinking (which thankfully I didn't have) I think the original file would have be overwritten when I ran rimport again.

Is there anyway to have rimport be able to abort the copy operation cleanly? Or maybe have a check with checksums or at least file sizes to ensure consistency before relinking?

Also, Claude had me do `sudo -u cesmdata rm ` to get rid of the corrupted file, which worked (I hope?)

Thanks,
Manish V.

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Direzione di ricerca

Start with the rimport copy and relinking flow described in the report, and reproduce an interrupted copy with Cntrl-C. Determine how the staging file is handled before relinking; done should mean an interrupted or inconsistent copy cannot overwrite the original, with the chosen consistency check covered by tests.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python
Ambito
tooling
Tipo di issue
Bug
Difficoltà
4/5
Tempo stimato
3-5 giorni
Stato di attività
Tranquilla
Chiarezza
Da chiarire
Idoneità per principianti
38/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.