flosell / flosell/trailscraper
Limit S3 downloads by time, not just by date to improve performance
Open
download-feature
enhancement
performance
- Dominant language
- Python
- Stars
- 838
- Forks
- 38
- Avg merge
- 2m
- Merged PRs (30d)
- 14
Description
At the moment, `trailscraper download` will download all logs for the days specified by `--from` and `--to`. Time that might also be specified in these arguments is ignored. Therefore, trailscraper downloads more files than requested by the user. Since `trailscraper generate` matches timestamps properly, this does not affect the outcome, only performance
Contributor guide
Assessment
This issue has not been assessed yet.