hpc / hpc/mpifileutils

How to check if dtar succesfully finished?

Open
#577 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C
Stars
200
Forks
85
Avg merge
3d 21h
Merged PRs (30d)
2

Description

We have a data management pipeline to first tar the data and then archive it.
I need to check that the data is correct (not corrupted during tar process) before
archive. And All the data management pipeline is executed through script (
submit dtar job to slurm(pbs) and archive). I need some way to automatically
detect if dtar has success.

The doc says:

One cannot easily check the return codes of tools. Instead, inspect stdout and stderr output for errors.

maybe I need to use regular expression to match the ouput of dtar?(maybe slurm.out or something)?
Thanks

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Begin with the dtar documentation quoted in the issue and the pipeline’s Slurm/PBS job-output handling. Determine whether the current behavior exposes a documented completion signal; done means there is a reproducible, automatable way to distinguish successful and failed dtar runs, or a clearly scoped documentation change.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
cli
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.