Lightning-AI / Lightning-AI/lightning-thunder
The coverage test `thunder/tests/coverage_tests/test_coverage_trace.py` fails
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.5k
- Forks
- 121
- PR merge metrics
- No merged PRs in 30d
Description
*Note*: If you have a model or program that is not supported yet but should be, please use the program coverage template.
## 🐛 Bug
```
FAILED thunder/tests/coverage_tests/test_coverage_trace.py::test_model_trace[facebook/bart-large] - NotImplementedError: casting a TensorProxy to a Python boolean is not suppo...
FAILED thunder/tests/coverage_tests/test_coverage_trace.py::test_model_trace[facebook/dinov2-small] - NotImplementedError: only modes 'nearest' and 'nearest-exact' are supported...
FAILED thunder/tests/coverage_tests/test_coverage_trace.py::test_model_trace[facebook/opt-1.3b] - NotImplementedError: casting a TensorProxy to a Python boolean is not suppo...
FAILED thunder/tests/coverage_tests/test_coverage_trace.py::test_model_trace[google/reformer-enwik8] - ValueError: If training, make sure that config.axial_pos_shape factors: (12...
FAILED thunder/tests/coverage_tests/test_coverage_trace.py::test_model_trace[google/vit-base-patch16-224] - TypeError: () got unexpected k...
FAILED thunder/tests/coverage_tests/test_coverage_trace.py::test_model_trace[t5-base] - ModuleNotFoundError: No module named 'fused_layer_norm_cuda'
FAILED thunder/tests/coverage_tests/test_coverage_trace.py::test_model_trace[xlnet-base-cased] - thunder.core.interpreter.InterpreterError: Encountered exception TypeError:...
```
https://dev.azure.com/Lightning-AI/lightning/_build/results?buildId=241769&view=logs&jobId=eb91186b-1c68-59cd-d743-62ff6863beba&j=eb91186b-1c68-59cd-d743-62ff6863beba&t=9d433d3f-ed0b-5632-e22f-28f1e5b8f0f8
### To Reproduce
```
cd lightning-thunder
PYTHONPATH=$(pwd)/thunder/tests pytest thunder/tests/test_coverage_trace.py
```
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by running the reproduction command from the issue and inspect thunder/tests/coverage_tests/test_coverage_trace.py. Investigate the seven reported model-trace failures and their individual exception messages. Done means the listed coverage cases pass without the reported errors.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100