microsoft / microsoft/MInference
[Question]: What is the last stable commit in this repo? Is there any reproducible example?
@iofu728 is already working on this.
Since Apr 7, 2025.
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 82
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 1
Description
Describe the issue
I've been testing the library and found that the first example utilizing Hugging Face Transformers presented some challenges. My setup involved installing from source (commit 9ee9d4b), with torch==2.6.0, transformers==4.49.0, python version 3.12.9, Ubuntu 22.04.5. I noticed that changing the attn_type parameter resulted in a new error message each time I tried a different value. Furthermore, variations in the minor version of the transformers installation also seemed to influence the errors encountered, with different versions yielding different tracebacks. It seems there might be some inconsistencies between the example and the current state of the code or required dependencies.
The questions follows: is there any docker image or requirements.txt with more restrictions on dependencies versions?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.