deepspeedai / deepspeedai/DeepSpeedExamples
`AttributeError: readonly attribute` while trying to run training/HelloDeepSpeed
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6.8k
- Forks
- 1.1k
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 1
Description
I am trying to run training/HelloDeepSpeed example on a fresh python virtualenv but getting below error.
I have installed dependencies using https://github.com/microsoft/DeepSpeedExamples/blob/master/training/HelloDeepSpeed/requirements.txt
Traceback (most recent call last):
File "/media/home/hemant/src/DeepSpeedExamples/training/HelloDeepSpeed/train_bert.py", line 10, in <module>
import datasets
File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/__init__.py", line 34, in <module>
from .arrow_dataset import Dataset, concatenate_datasets
File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 46, in <module>
from .arrow_reader import ArrowReader
File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/arrow_reader.py", line 33, in <module>
from .table import InMemoryTable, MemoryMappedTable, Table, concat_tables
File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 331, in <module>
class InMemoryTable(TableBlock):
File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 358, in InMemoryTable
def from_pandas(cls, *args, **kwargs):
File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 21, in wrapper
out = wraps(arrow_table_method)(method)
File "/usr/lib/python3.10/functools.py", line 61, in update_wrapper
wrapper.__wrapped__ = wrapped
AttributeError: readonly attribute
Env details:
OS: Ubuntu 22.04
Python Version: 3.10.12
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with training/HelloDeepSpeed/train_bert.py and training/HelloDeepSpeed/requirements.txt, then reproduce the import failure in a fresh Python 3.10 environment. Trace the datasets import and its dependency versions to identify the compatibility issue; done means the HelloDeepSpeed training example imports successfully and can proceed past startup.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100