bigscience-workshop / bigscience-workshop/promptsource
test `show_templates.py` will fail for datasets that require manual download
Open
- Dominant language
- Python
- Stars
- 3k
- Forks
- 375
- PR merge metrics
- No merged PRs in 30d
Description
this test (mostly for checking/render and print templates) is bound to fail for datasets that require manual download.
to do: handle these cases by returning a warning for instance? not even sure it's possible
Contributor guide
Research direction
Start with the test in show_templates.py, especially the checks for rendering and printing templates, and reproduce the failure with a dataset that requires manual download. Trace how that dataset is detected or loaded, then define and test the expected warning behavior for cases the test cannot download automatically.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100