cactus-compute / cactus-compute/cactus

Gemma 4 and Qwen TTS support

Open
#568 3 comments 1 reaction 0 assignees View on GitHub
Dominant language
C++
Stars
6k
Forks
501
Avg merge
1d 18h
Merged PRs (30d)
4

Description

According to your documentation you support Gemma 4 models https://docs.cactuscompute.com/latest/#supported-llms. I was wondering if we can use a single model instance for generation but also transcription. Instead of instantiating models with the same identifier for different tasks, e.g. a `CattusLLM` instance for completion and a `CactusSTT` for transcription. Ideally, I'd like a single `CactusModel` that supports both `transcribe` and `completion` uses.

Also, I was wondering if support for text to speech would be available through the Qwen 3 tts model family https://qwen.ai/blog?id=qwen3tts-0115

Happy to collaborate!

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the documented supported LLMs and the existing CattusLLM, CactusSTT, and CactusModel interfaces. Determine whether one model instance can expose both completion and transcription, and assess the requested Qwen 3 TTS support; done means the supported model capabilities and unified API behavior are defined and implemented.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
ai, audio-video-rtc
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.