juaml / juaml/junifer

[ENH]:

Open
#316 0 comments 0 reactions 2 assignees View on GitHub

@synchon is already working on this.

Since Mar 27, 2024.

enhancement triage
Dominant language
Python
Stars
16
Forks
13
Avg merge
10h 20m
Merged PRs (30d)
1

Description

Are you requiring a new dataset or marker?
  • I understand this is not a marker or dataset request
Which feature do you want to include?

I have prototyped a small command line utility to collect and aggregate logging information from junifer pipelines into convenient DataFrames. This DataFrame contains information about resources used (CPUs, time elapsed, memory, disk space used ...), warnings, job success etc. Each row corresponds to a junifer 'element'. For now, it is assumed that logs are from HTCondor as no other queueing backends are implemented in junifer.

As discussed with @fraimondo this could be integrated into junifer similarly to #315

How do you imagine this integrated in junifer?

as an additional command

or simply by linking to the tool in a list of curated external tools in the documentation

Do you have a sample code that implements this outside of junifer?
https://github.com/LeSasse/junilog
Anything else to say?

No response

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.