huggingface / huggingface/transformers.js-examples

Unable to run Janus Pro locally using Chrome on Ubuntu 22.04 LTS

Open
#34 1 comment 2 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
2.1k
Forks
251
PR merge metrics
No merged PRs in 30d

Description

I am getting this error message when I load the model on my Workstation
- 16 Core / 32 Threads AMD Epyc CPU
- 64 GB Ram
- 1080 Ti
- Ubuntu 22.04 LTS
- Chrome 132.0.6834.159 (Official Build) (64-bit)

First I had issues enabling Vulkan and WebGPU which i eventually managed.

When loading the model I got this error message

```
u/huggingface_transformers.js?v=82803131:12815 Uncaught (in promise) Error: Can't create a session. failed to allocate a buffer of size 2079237968.
at Kt (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:12815:30)
at Cr (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:12820:123)
at pc (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13085:25)
at pn.loadModel (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13156:165)
at mn.createInferenceSessionHandler (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13205:28)
at e.create (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:4338:51)
at async createInferenceSession (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:13354:25)
at async http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:18985:29
at async Promise.all (index 0)
at async constructSessions (http://localhost:5173/node_modules/.vite/deps/@huggingface_transformers.js?v=82803131:18982:35)
```

After running it with this switch to increas max Ram using this command `google-chrome --args --js-flags="--max_old_space_size=8192"` I am getting this error message on the console.

```
Uncaught (in promise) 4168718248
```

I don't know what this means.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.