huggingface / huggingface/sentence-transformers

bert word embedding model from a local bin file

Open
#155 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
19.1k
Forks
2.9k
Avg merge
1d 19h
Merged PRs (30d)
61

Description

when i am trying to load the model from the local file using the path with this instruction:
word_embedding_model = models.BERT('models/bert-base-uncased-pytorch_model.bin')
i am getting this error:
UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 0: invalid start byte

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the failure from the issue using models.BERT with the local bert-base-uncased-pytorch_model.bin path, then inspect the BERT model-loading entry point and how it reads local files. Done means determining whether that local .bin file can be loaded through this instruction without the UnicodeDecodeError, with the expected behavior documented or covered by a relevant test.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.