aws / aws/sagemaker-python-sdk

V3 support for many tasks as possible in Huggingface, starting with "text-to-image"

Open
#5,390 0 comments 3 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
1d 22h
Merged PRs (30d)
35

Description

With V2, the `HuggingFace` class allowed to do inference on many different models performing different tasks. Moving to V3 many of the available tasks are not functional anymore.

I would like to see them working again with the V3 `ModelBuilder` interface, and to be able to use a short code snippet to deploy a model.
Here's the complete list of the tasks we used to support:
```
"text-classification",
"token-classification",
"table-question-answering",
"question-answering",
"zero-shot-classification",
"translation",
"summarization",
"feature-extraction",
"text-generation",
"fill-mask",
"sentence-similarity",
"automatic-speech-recognition",
"text-to-image",
"text-to-speech",
"audio-to-audio",
"audio-classification",
"image-classification",
"object-detection",
"image-segmentation"
```

The most important tasks for us are "text-generation" (already working on V3) and "text-to-image" (currently broken). If you think you can make at least these two work it would be great.

An example of model that we would like to test is **black-forest-labs/FLUX.2-dev**.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.