explosion / explosion/spaCy

Mistral Instruct LLM doesn#t use chat template

Open
#13,481 1 comment 0 reactions 0 assignees View on GitHub
bug feat/llm
Dominant language
Python
Stars
33.9k
Forks
4.7k
Avg merge
3m
Merged PRs (30d)
1

Description

In the implementation of the mistral LLM connection an attribute is created which checks if the Instruct model version was selected. This check fails, as it is checked if lowercase "instruct" is in the model name. However, it should be checked for "Instruct", otherwise the attribute is always false and the wrong chat template is used.

## Info about spaCy

- **spaCy version:** 3.7.4
- **Platform:** Linux-6.5.13-1-pve-x86_64-with-glibc2.35
- **Python version:** 3.10.12

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.