What are we supposed to do with a huge zimcheck result file?
- Dominant language
- Python
- Stars
- 16
- Forks
- 5
- PR merge metrics
- No merged PRs in 30d
Description
Task: https://farm.openzim.org/pipeline/ee1f7b21-6a43-4004-9fde-63f979224433
Zimcheck result: https://s3.us-west-1.wasabisys.com/org-kiwix-zimfarm-zimcheck-results/dd7f4ed4-9aff-d60a-d697-0a8a65fb2a3b_zimcheck.json
Zimcheck size : 745MB
Most errors seems irrelevant in that they relate to links to external resources, but these links come from the upstream so I see no reason we should remove them. At most, mark them with a special icon.
What are we supposed to do in such a situation? Such a big file is a storage concern (money on Wasabi S3) but also a performance issue (CMS will have to download this big JSON file and process it ...).
For now this has no operational impact besides time to upload result (but ZIM is way bigger) and storage money on S3 (still limited).
Contributor guide
Assessment
This issue has not been assessed yet.