E3SM-Project / E3SM-Project/zstash

check errors disappear at the second try

Open
#174 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11
Forks
10
Avg merge
14h 18m
Merged PRs (30d)
1

Description

I encountered the errors below for a few files when specifying the tar file names.

When I retried it, they were checked successfully. What these errors mean? Why they disappear when trying again? Thanks.

```
INFO: Transferring file from HPSS: zstash/000103.tar
ERROR: Error=Transferring file from HPSS: 000103.tar, Command was `hsi -q "cd /home/t/tang30/E3SMv2/v2.NARRM.piControl; get 000103.tar"`. This command includes `hsi`. Be sure that you have logged into `hsi`.
Traceback (most recent call last):
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/bin/zstash", line 10, in
sys.exit(main())
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/main.py", line 68, in main
check()
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/check.py", line 12, in check
extract.extract(keep_files=False)
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/extract.py", line 44, in extract
failures: List[FilesRow] = extract_database(args, cache, keep_files)
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/extract.py", line 210, in extract_database
failures = extractFiles(matches, keep_files, config.keep, cache)
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/extract.py", line 374, in extractFiles
hpss_get(hpss, tfname, cache)
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/hpss.py", line 99, in hpss_get
hpss_transfer(hpss, file_path, "get", cache, False)
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/hpss.py", line 76, in hpss_transfer
run_command(command, error_str)
File "/global/common/software/e3sm/anaconda_envs/base/envs/e3sm_unified_1.5.1_nompi/lib/python3.8/site-packages/zstash/utils.py", line 55, in run_command
raise Exception(error_str)
Exception: Error=Transferring file from HPSS: 000103.tar, Command was `hsi -q "cd /home/t/tang30/E3SMv2/v2.NARRM.piControl; get 000103.tar"`. This command includes `hsi`. Be sure that you have logged into `hsi`.
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the traceback locations in zstash/check.py, extract.py, hpss.py, and utils.py, especially hpss_transfer and run_command. Reproduce the first and second check attempts if possible, then determine why the HPSS transfer fails initially and succeeds on retry; done should include a confirmed explanation and a clear corrective change or documented resolution.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.