intel / intel/AI-Playground

bug with built-in question answering model in mistral

Open
#173 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
TypeScript
Stars
979
Forks
132
Avg merge
9h 23m
Merged PRs (30d)
8

Description

## Describe the bug
Downloading the mistral 24B in the ai playground required downloading around 80 gigabytes of model files, which was not actually required at that time. Because mistralai/Mistral-Small-24B-Instruct-2501 has a consolidated model file on hugging face, and 10 separate model files, which add together to form the consolidated file, Therefore, it is actually only necessary to download 40G files, but the bug is that if the file is not enough for 80G, an error will occur.

![Image](https://github.com/user-attachments/assets/cd7fd007-fe97-4bb9-9348-34855c560c6a)

![Image](https://github.com/user-attachments/assets/a3fc03ad-fd77-42ad-86a3-9be9301f8924)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.