Support float16 on ARM CPUs with native float16 support
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 4.7k
- Forks
- 536
- Avg merge
- 12h 12m
- Merged PRs (30d)
- 4
Description
From https://github.com/guillaumekln/faster-whisper/issues/65
Some CPUs such as ARM Neoverse-N1 (Oracle Cloud free tier) support FP16 computation.
It would be nice to have this feature because there could be up to a 2x speedup in computation speed compared to float32.
I'm just creating the enhancement request and understand that there might not be a focus on this because it only applies to a small subset of CPUs.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no source files, tests, or entry points. Start by locating the CPU computation and float32 pathways, then determine how native ARM float16 support is detected and benchmarked; done means correct float16 computation on supported ARM CPUs with the expected performance improvement.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100