antirez / antirez/h3.c

CUDA backend for Linux/NVIDIA — interest in upstreaming?

Aperta
#42 0 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
C
Stelle
2.7k
Fork
210
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

I ported h3.c to Linux ARM64 with a native CUDA backend behind the existing `h3_gpu.h` API (CLI, checkpoint formats and the Metal path unchanged; backend selected at build time).

Measured on an NVIDIA GB10 (DGX Spark, CUDA 13.0), max-quality preset (1024x576, 107 frames, 50 steps/layers):
- full render: 33:37 -> **18:56 wall clock (1.78x)**
- video VAE decode: 1113 s -> 248 s via a tiled F32 attention kernel (4.49x)
- DiT attention: cuDNN SDPA BF16 (~84x on the long shape) with custom tiled fallback
- parity gates: CPU oracles (max_abs <= 2e-5), Compute Sanitizer clean, matched renders SSIM >= 0.999 on the short gate

The branch is ~6.8k lines across 3 commits (portable host/tokenizer, CUDA backend, integration + optimizations). Happy to open a PR if this is of interest, and to split or rework anything.

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.