apple / apple/embedding-atlas

Launching with an unsupported GPU

Open
#60 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
TypeScript
Stars
4.9k
Forks
325
Avg merge
14h 48m
Merged PRs (30d)
7

Description

I'm using an Nvidia GTX 1080 which only supports up to CUDA 6.1. PyTorch wants at least CUDA 7.0.

I applied a forced device override to line 129 in ``/home/mark/.embedding-atlas/lib/python3.12/site-packages/embedding_atlas/projection.py`` and I was able to train and launch without issue.

```python
transformer = SentenceTransformer(model, trust_remote_code=trust_remote_code, device='cpu')
```

It might be worth adding a ``--device`` CLI flag for anyone else wanting to try this package out without needing a CUDA 7+-supported GPU.

Contributor guide

Open the contributing guide

Research direction

Start at projection.py around line 129, where SentenceTransformer is created with a forced CPU device, and trace how launch options reach that code. Add a way for the launcher to accept a device choice, then verify that CPU launching works on hardware without a supported CUDA version.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
cli, machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.