MetOffice / MetOffice/CSET

Reduce website file count

Open
#2,156 7 comments 0 reactions 1 assignee Claimed by @ScottWales View on GitHub
enhancement
Dominant language
Python
Stars
33
Forks
19
Avg merge
1d 22h
Merged PRs (30d)
30

Description

### What problem does your feature request solve?

Our webserver serves files from a shared lustre file system, which has restrictions on how many files we can store. Large CSET runs will hit quota limits if they include a lot of files.

### Describe the solution you'd like

As part of the finalise webpage task tar up all of the plots and create an index json file recording their positions in the tarball. Use javascript to fetch the image directly out of the tarball using the [range](https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/Range) header.

We've done the same setup at NCI for obsmon and RES [(internal link)](https://git.nci.org.au/bom/ngm/tarwebplots).

### Describe alternatives you've considered

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.