huggingface / huggingface/local-gemma

Error Loading fbgemm.dll with PyTorch on Windows: OSError [WinError 126]

Open
#39 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
383
Forks
31
PR merge metrics
No merged PRs in 30d

Description

I encountered an error while running the local-gemma command with the --model 2b --preset speed options. The error message is as follows:

![image](https://github.com/user-attachments/assets/35143eda-4242-43a1-a1e5-a443e6d2eac6)

The error indicates that the fbgemm.dll file, or one of its dependencies, could not be found or loaded by the system.
This issue seems to be related to the PyTorch library, as the missing DLL is part of the torch package.
Possible Causes:

Missing DLL: The fbgemm.dll file might be missing or not properly installed.
Incompatibility: There might be a compatibility issue between the version of PyTorch and the system (e.g., Python version, Windows version, or GPU/CUDA configuration).
Missing Dependencies: Some dependencies required by fbgemm.dll might be missing.
Request for Assistance:

Could you please advise on how to resolve this issue? Specifically, I would appreciate guidance on whether I need to reinstall PyTorch, check for specific dependencies, or make any system adjustments to ensure compatibility.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.