RosettaCommons / RosettaCommons/RFdiffusion
RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)`
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 3.1k
- Forks
- 644
- PR merge metrics
- No merged PRs in 30d
Description
Hi community,
While running the macrocyclic example, I got this issue:
Error executing job with overrides: ['inference.output_prefix=my_files/out_macrocycle/macrocyclic_test', 'contigmap.contigs=[10-18]', 'inference.cyclic=True', "inference.cyc_chains='a'", 'inference.num_designs=5', 'diffuser.T=50']
Traceback (most recent call last):
File "D:\Peptide Design\RFdiffusion\scripts\run_inference.py", line 94, in main
px0, x_t, seq_t, plddt = sampler.sample_step(
File "d:\peptide design\rfdiffusion\rfdiffusion\inference\model_runners.py", line 686, in sample_step
msa_prev, pair_prev, px0, state_prev, alpha, logits, plddt = self.model(msa_masked,
File "D:\miniconda3\envs\SE3nv\lib\site-packages\torch\nn\modules\module.py", line 1051, in _call_impl
return forward_call(*input, **kwargs)
File "d:\peptide design\rfdiffusion\rfdiffusion\RoseTTAFoldModel.py", line 77, in forward
msa_latent, pair, state = self.latent_emb(msa_latent, seq, idx, cyclic_reses)
File "D:\miniconda3\envs\SE3nv\lib\site-packages\torch\nn\modules\module.py", line 1051, in _call_impl
return forward_call(*input, **kwargs)
File "d:\peptide design\rfdiffusion\rfdiffusion\Embeddings.py", line 96, in forward
msa = self.emb(msa) # (B, N, L, d_model) # MSA embedding
File "D:\miniconda3\envs\SE3nv\lib\site-packages\torch\nn\modules\module.py", line 1051, in _call_impl
return forward_call(*input, **kwargs)
File "D:\miniconda3\envs\SE3nv\lib\site-packages\torch\nn\modules\linear.py", line 96, in forward
return F.linear(input, self.weight, self.bias)
File "D:\miniconda3\envs\SE3nv\lib\site-packages\torch\nn\functional.py", line 1847, in linear
return torch._C._nn.linear(input, weight, bias)
RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling cublasCreate(handle)
Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.
Nobody got this so far. Please help me solve this problem
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the macrocyclic example through scripts/run_inference.py using the listed Hydra overrides. Trace the failing call through rfdiffusion/inference/model_runners.py, RoseTTAFoldModel.py, and Embeddings.py, and inspect the PyTorch CUDA environment around the cublasCreate failure. Done means the example completes inference without the CUBLAS_STATUS_NOT_INITIALIZED error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100