tensorflow / tensorflow/text

cuDNN raising error in Transformer execution

Open
#1,144 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
1.3k
Forks
379
Avg merge
3h 30m
Merged PRs (30d)
8

Description

Running the transformer tutorial raises an error executing the Cross Attention module.

I think the error is related to some mismatch in the versions of the notebook, because the error appears when executing the first block of the transformer, which in this case is the Cross Attention module.

The error is related with the cuDDN launch as you can see in the screenshot.
This is the error:
image

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the TensorFlow Text transformer tutorial and reproduce the failure in the Cross Attention module. Inspect the cuDNN launch error shown in the linked screenshot and compare the notebook and dependency versions; done means identifying and documenting a reproducible compatibility fix for the tutorial execution.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.