pytorch / pytorch/audio

How to use my finetuned version of wave2vec2 for forced alignment as shown in example/

Open
#3,796 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2.9k
Forks
799
Avg merge
58m
Merged PRs (30d)
3

Description

🐛 Describe the bug

Example script i am following, it used default pretrained model, where as. i want to use my own finetuned model.

https://pytorch.org/audio/main/generated/torchaudio.pipelines.Wav2Vec2FABundle.html#torchaudio.pipelines.Wav2Vec2FABundle

Versions

[pip3] mypy-extensions==1.0.0
[pip3] numpy==1.24.4
[pip3] onnx==1.15.0
[pip3] onnxruntime==1.16.3
[pip3] torch==2.2.2
[pip3] torchaudio==2.2.2
[pip3] torchvision==0.15.2
[conda] numpy 1.24.4 pypi_0 pypi
[conda] torch 2.2.2 pypi_0 pypi
[conda] torchaudio 2.2.2 pypi_0 pypi
[conda] torchvision 0.15.2 pypi_0 pypi

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the example/ script and the linked Wav2Vec2FABundle documentation, then compare the default pretrained-model workflow with the requested finetuned-model use case. Done means the supported workflow is clearly documented or the missing compatibility is captured in a focused change with appropriate coverage.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
audio-video-rtc, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.