deepspeedai / deepspeedai/DeepSpeedExamples

Wrong import in inference quantization example

Open
#774 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
6.8k
Forks
1.1k
Avg merge
2d 16h
Merged PRs (30d)
1

Description

Hi,

At https://github.com/microsoft/DeepSpeedExamples/blob/master/inference/huggingface/zero_inference/README.md , the referenced import from deepspeed.compression.inference.quantization import _init_group_wise_weight_quantization is wrong.
The correct one is from deepspeed.inference.quantization import _init_group_wise_weight_quantization .

Can you please correct it?
Best regards,
Epliz

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Open inference/huggingface/zero_inference/README.md and find the quantization import in the example. Compare it with the import path stated in the issue, update the README reference, and verify that the example shows the corrected import.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.