cactus-compute / cactus-compute/cactus

Cactus VAD is 15% slower than ONNX runtime

Open
#399 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
6k
Forks
501
Avg merge
1d 18h
Merged PRs (30d)
4

Description

Image

- Tested in `M4 Pro`.
- `cargo bench -p vad --all-features` for running https://github.com/fastrepl/char/blob/main/crates/vad/benches/vad.rs
- `silero-rs` use `ONNX runtime`(https://github.com/microsoft/onnxruntime, through https://github.com/pykeio/ort)
- `silero-rs` use [1.8 MB model](https://github.com/emotechlab/silero-rs/blob/main/models/silero_vad.onnx)
- Unzipped https://huggingface.co/Cactus-Compute/silero-vad/blob/main/weights/silero-vad-int8.zip is `664 KB`

Contributor guide

Open the contributing guide

Research direction

Start with crates/vad/benches/vad.rs and run `cargo bench -p vad --all-features` as described. Compare the Cactus VAD benchmark with silero-rs using ONNX Runtime, accounting for the different model sizes; done means identifying and addressing the source of the reported performance gap and verifying it with the benchmark.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, rust
Domain
audio-video-rtc, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.