cactus-compute / cactus-compute/cactus
Cactus VAD is 15% slower than ONNX runtime
- Dominant language
- C++
- Stars
- 6k
- Forks
- 501
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 4
Description
- Tested in `M4 Pro`.
- `cargo bench -p vad --all-features` for running https://github.com/fastrepl/char/blob/main/crates/vad/benches/vad.rs
- `silero-rs` use `ONNX runtime`(https://github.com/microsoft/onnxruntime, through https://github.com/pykeio/ort)
- `silero-rs` use [1.8 MB model](https://github.com/emotechlab/silero-rs/blob/main/models/silero_vad.onnx)
- Unzipped https://huggingface.co/Cactus-Compute/silero-vad/blob/main/weights/silero-vad-int8.zip is `664 KB`
Contributor guide
Research direction
Start with crates/vad/benches/vad.rs and run `cargo bench -p vad --all-features` as described. Compare the Cactus VAD benchmark with silero-rs using ONNX Runtime, accounting for the different model sizes; done means identifying and addressing the source of the reported performance gap and verifying it with the benchmark.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, rust
- Domain
- audio-video-rtc, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100