jina-ai / jina-ai/executor-text-transformers-torch-encoder

Executor doesn't support recent CUDA capabilities

Open
#13 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
9
Forks
2
PR merge metrics
No merged PRs in 30d

Description

When I try and use this executor on a compute server with an RTX 3090, I get the following warning:

```
executor0_1 | NVIDIA GeForce RTX 3090 with CUDA capability sm_86 is not compatible with the current PyTorch installation.
executor0_1 | The current PyTorch install supports CUDA capabilities sm_37 sm_50 sm_60 sm_70.
```

I'm using the `latest-gpu` tag of the executor, inside a Docker container, from running `jina export docker-compose` on this flow:

```yml
jtype: Flow
executors:
- uses: 'jinahub+docker://TransformerTorchEncoder/latest-gpu'
uses_with:
pretrained_model_name_or_path: 'sentence-transformers/distiluse-base-multilingual-cased-v2'
device: cuda
gpus: 1
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.