AllenNeuralDynamics / AllenNeuralDynamics/aind-analysis-wrapper-template

consolidated output causes publishing errors

未關閉
#27 2 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Jupyter Notebook
星號
0
分支
4
PR 合併指標
30 天內沒有已合併 PR

描述

When a user runs the analysis pipeline and the data are saved as a flat output to the results director, a `metadata.nd.json` file gets written to the same location from each instance. This will result in errors that look like this:

```
ERROR ~ Failed to publish file: s3://codeocean-s3batchbucket-16itpvq060udk/3ba99f52-878c-4133-8b98-cb19529cb391/36/c75cc66611eb7fea49b8c3bf42b252/capsule/results/metadata.nd.json; to: s3://codeocean-s3resultsbucket-1182nktl2bh9f/8ea5a002-4e1f-4b03-9260-56c1200e17f3/3ba99f52-878c-4133-8b98-cb19529cb391/2cc3b4ff-6976-43ac-a88e-040b59ba00e6/results/metadata.nd.json [copy] -- See log file for details
```

This causes the process to fail. To get around this, a user needs to partition isolate the output into separate directories

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。