karpathy / karpathy/llm.c

the provided PTX was compiled with an unsupported toolchain.

Open
#63 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
31k
Forks
3.8k
PR merge metrics
No merged PRs in 30d

Description

Does anyone know the required CUDA version to compile the train_gpt2cu?
I am getting the below error :
```bash
[GPT-2]
max_seq_len: 1024
vocab_size: 50257
num_layers: 12
num_heads: 12
channels: 768
num_parameters: 124439808
train dataset num_batches: 74
val dataset num_batches: 8
batch size: 4
sequence length: 1024
val_num_batches: 10
num_activations: 2456637440
[CUDA ERROR] at file train_gpt2.cu:341:
the provided PTX was compiled with an unsupported toolchain.
```
my cuda version is cuda12.1. thanks. or any recommendation to get over this? thanks.

Contributor guide

No contributing guide indexed for this repository

Research direction

Inspect train_gpt2.cu around line 341 and the reported PTX/toolchain error, using the CUDA 12.1 environment as the starting point. Done means identifying the compatible CUDA/toolchain combination or documenting a confirmed workaround for the unsupported PTX error.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.