epfl-dlab / epfl-dlab/IT-issues

enable auto cache clearing on dlabscratch

Open
#2 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

To avoid each user to redownload the model weights everytime, which wastes time and also storage, Julian has made this library:
```
from dlab_utils.paths import model_path, available_models
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(model_path("meta-llama/Meta-Llama-3-8B-Instruct"))
tokenizer = AutoTokenizer.from_pretrained(model_path("meta-llama/Meta-Llama-3-8B-Instruct"))

print(available_models())
```
This is really good and simple. Would be even better with autodownloading
What I can do in addition when I get sudo is to periodically delete cache directory so that people need to go for this if they don't want to redownload everytime (edited)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.