lm-sys / lm-sys/FastChat

SillyTavern ui? FastChat compatible?

Open
#3,265 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
39.5k
Forks
4.8k
PR merge metrics
No merged PRs in 30d

Description

Hi, sorry I'm a big newb at this.

I love that fastchat uses multi gpus and I've gotten the webservice/worker setup, but I don't know how to config SillyTavern to use fastchat and its not listed as one of the API connections options... https://docs.sillytavern.app/usage/api-connections/

but I wonder if Fastchat is the same as like Oobabooga? or 1 of the other options? https://docs.sillytavern.app/usage/api-connections/

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the FastChat webservice/worker setup and the SillyTavern API Connections documentation linked in the issue. Done would require determining whether FastChat is compatible with an existing connection type and, if not, defining the integration or configuration needed.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.