hashicorp / hashicorp/nomad

[feature] Output artificat for batch jobs

Open
#4,796 3 comments 9 reactions 0 assignees View on GitHub
stage/needs-discussion theme/batch type/enhancement
Dominant language
Go
Stars
17k
Forks
2.1k
Avg merge
1d 9h
Merged PRs (30d)
105

Description

Hi, we have been working with nomad for some months to test its capabilities for our use case (mostly batch processing). And we found that nomad was missing a feature for artifact management:
it would be really nice to have an output artifact stanza that will upload the batch results to S3 after the job completes. Something like:

```hcl
artifact {
output = true
source = "/output/batch_result.txt"
destination = "s3::https://minio.domain.com/"
options {
aws_access_key_id = "${aws_access_key_id}"
aws_access_key_secret = "${aws_access_key_secret}"
}
}
```

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by locating Nomad's existing artifact handling and batch-job completion flow, then determine how an output upload to S3 should behave; done should include a defined artifact stanza and successful upload of batch results after completion.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, go
Domain
backend, cloud
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.