Custom spectrogram filterbanks
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 799
- Avg merge
- 58m
- Merged PRs (30d)
- 3
Description
🚀 Feature
It would be great to have an ability to create non-mel and not linear filterbanking.
Motivation
Even though mel-scale ceptstral coefficients are (probably) the most popular, there exists many other ways to filterbank the frequencies of spectra - CQCC, Opus filterbanks, BFCC, etc. I was thinking that it would be nice if the Spectrogram transform would accept a filterbank argument and filter the spectrogram accordingly.
Pitch
Extension of Spectrogram API to accept filter_bank argument (with a fallback to current implementation). Maybe it could be a tensor of shape (num_banks, filter) where filter would consist of (min_freq, max_freq) with a triangular filterbank for the start?
Additional context
Somewhat relates to #942
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the Spectrogram transform entry point and the context in issue #942. Define how a filter_bank argument should represent custom banks, preserve the current implementation as the fallback, and verify that the transform applies the supplied banks, including the proposed triangular form.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- audio-video-rtc
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100