microsoft / microsoft/MInference

[Question]: What is the last stable commit in this repo? Is there any reproducible example?

Open
#131 1 comment 0 reactions 1 assignee View on GitHub

@iofu728 is already working on this.

Since Apr 7, 2025.

bug question
Dominant language
Python
Stars
1.2k
Forks
82
Avg merge
1d 18h
Merged PRs (30d)
1

Description

Describe the issue

I've been testing the library and found that the first example utilizing Hugging Face Transformers presented some challenges. My setup involved installing from source (commit 9ee9d4b), with torch==2.6.0, transformers==4.49.0, python version 3.12.9, Ubuntu 22.04.5. I noticed that changing the attn_type parameter resulted in a new error message each time I tried a different value. Furthermore, variations in the minor version of the transformers installation also seemed to influence the errors encountered, with different versions yielding different tracebacks. It seems there might be some inconsistencies between the example and the current state of the code or required dependencies.
The questions follows: is there any docker image or requirements.txt with more restrictions on dependencies versions?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.