huggingface / huggingface/setfit

Serving SeTFiT models in torchserve

Open
#300 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.8k
Forks
267
Avg merge
36m
Merged PRs (30d)
5

Description

Im trying to deploy my setfit model in torchserver using a custom handler for this task. The thing is that im not being able to do this since im getting multiple errors while registering the model on the service.
![image](https://user-images.githubusercontent.com/22087162/217019856-0c95f942-bfad-4dc8-8fd2-7447fdc25a05.png)
I was wondering if this is actually possible since i tried to serve `sentence-transformers` models before successfully.
Also to clarify, Im including setfit in requirements.txt

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.