Downloading large event logs (`successful_transfers.csv`) in Globus Web Interface data transfer
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 24
- Forks
- 15
- Avg merge
- 10d 3h
- Merged PRs (30d)
- 1
Description
A user transferred data from Cheaha to our LTS using the Globus webApp. After the transfer, the user wanted to verify data integrity by comparing checksums before and after the transfer ( see this ticket: INC0873148).
Currently, it is possible to download the event log in Globus ( successful_transfers.csv) via the globus web interface. This log contains checksum information for each file and works well for smaller transfers.
See the sample successful_transfers.csv:
However, when large data is transferred, the successful_transfers.csv file can become very large, making it difficult to download through the globus web interface.
Plan:
Explore a solution that allows efficient access to large event logs (To be updated...).
Related issue: #996
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing related issue #996 and the described Globus web interface workflow for downloading successful_transfers.csv. Define an approach for efficient access to large event logs and document how checksum data can be retrieved and verified when the issue is complete.
Written by the indexing model from the issue text.
Assessment
- Domain
- web-dev
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100