simonsobs / simonsobs/librarian
Have a maximum number of outgoing transfers
Open
@farhadcomp is already working on this.
Since Aug 17, 2026.
- Dominant language
- Python
- Stars
- 3
- Forks
- 0
- Avg merge
- 10d 21h
- Merged PRs (30d)
- 1
Description
Sometimes, during catch-up, we generate tens of thousands of outgoing transfers. These then become stale very quickly (before they've even had a chance to get their globus transfers out). It would be good to set a hard limit on the number of outgoing transfers, say up to 8192 (configurable) and only start creating new ones when this becomes smaller (say 2048)?
You'd need to look in the send_clone functions.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.