InternLM / InternLM/lmdeploy

[Feature] may support Mistral-7B recently? whatever Turbomind or Pytorch

Open
#534 0 comments 0 reactions 0 assignees View on GitHub
backlog
Dominant language
Python
Stars
8.1k
Forks
748
Avg merge
6d 2h
Merged PRs (30d)
54

Description

### Motivation

The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters. Mistral-7B-v0.1 outperforms Llama 2 13B on all benchmarks as offical said.
We want to calculate the output logits, when compared to llama2 and other open sourced llm.
Thanks a lot!

### Related resources

https://huggingface.co/mistralai/Mistral-7B-v0.1

### Additional context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.