huggingface / huggingface/optimum-nvidia

Instructions on how to set TP/PP

Open
#102 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1k
Forks
103
Avg merge
2m
Merged PRs (30d)
1

Description

https://github.com/huggingface/optimum-nvidia/blob/main/examples/text-generation.py is currently empty in that regard

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.