AlexsJones / AlexsJones/llmfit

[Feature]: mutiple GPU = total VRAM

Abierto
#1,018 1 comentario 0 reacciones 0 asignados Ver en GitHub
enhancement
Lenguaje dominante
Rust
Estrellas
36.5k
Forks
2.3k
Merge medio
3 d 1 h
PR fusionados (30 d)
95

Descripción

### Problem or motivation

Hi,

I have 2 GPUs, 5090 and 5080, and I run inferences with the total VRAM. I see who is not counted and does not limit itself to a single GPU.

### Proposed solution

Calculate the total VRAM + propose the llms that are capable of being played

### Alternatives considered

_No response_

### Feature area

Hardware detection (new GPU vendor, new hardware type)

### Would you be willing to contribute this?

No, just suggesting

### Additional context

_No response_

Guía de contribución

Abrir la guía de contribución

Línea de trabajo

Start at the hardware-detection entry point and trace how VRAM is currently counted and how model recommendations are produced. Define done as aggregating VRAM from multiple GPUs and limiting recommendations to models that fit the aggregate; add coverage for a two-GPU setup such as a 5090 and 5080 if the project’s existing test structure supports it.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
rust
Área
ai, cli
Tipo de issue
Nueva funcionalidad
Dificultad
4/5
Tiempo estimado
3-5 días
Estado de actividad
Activo
Claridad
Bastante claro
Aptitud para principiantes
48/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.