huggingface / huggingface/blog

Whisper-small Fine-Tune for Somali language

Open
#690 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
3.5k
Forks
1k
Avg merge
1d 20h
Merged PRs (30d)
19

Description

Thanks **Sanchit** for your blog https://huggingface.co/blog/fine-tune-whisper#combine-to-create-a-whisperprocessor.
Using this fine-tuning example you provided, with my own custom Somali dataset I trained the data with Colab GPU for around 3.5 hours and get 13.23, as shown below.

![image](https://user-images.githubusercontent.com/48266204/205455802-b9f6312f-7726-4859-b0db-9e99ed6d12d4.png)

I loaded the model with the runs into https://huggingface.co/MohamedUgas/whisper-small-so

My issue is when I tried to preload the fine-tuned model for the processor I got this error:

After running this:
from transformers import WhisperForConditionalGeneration, WhisperProcessor
model = WhisperForConditionalGeneration.from_pretrained("MohamedUgas/whisper-small-so")
processor = WhisperProcessor.from_pretrained("MohamedUgas/whisper-small-so")

I got this Error:

processor = WhisperProcessor.from_pretrained("MohamedUgas/whisper-small-so")
OSError: Can't load tokenizer for 'MohamedUgas/whisper-small-so'. If you were trying to load it from 'https://huggingface.co/models', make sure you don't have a local directory with the same name. Otherwise, make sure 'MohamedUgas/whisper-small-so' is the correct path to a directory containing all relevant files for a WhisperTokenizer tokenizer.

All the files are in https://huggingface.co/MohamedUgas/whisper-small-so including the Colab notebook jupiter code.

Thanks for your help.
Mohamed

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked Hugging Face model repository and its Colab Jupyter notebook, then reproduce the WhisperProcessor.from_pretrained call shown in the issue. Check the model repository contents against the files required for WhisperTokenizer; done means the fine-tuned model and processor load without the reported OSError.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, jupyter-notebook, python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.