deepspeedai / deepspeedai/DeepSpeedExamples

`AttributeError: readonly attribute` while trying to run training/HelloDeepSpeed

Open
#878 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
6.8k
Forks
1.1k
Avg merge
2d 16h
Merged PRs (30d)
1

Description

I am trying to run training/HelloDeepSpeed example on a fresh python virtualenv but getting below error.
I have installed dependencies using https://github.com/microsoft/DeepSpeedExamples/blob/master/training/HelloDeepSpeed/requirements.txt

Traceback (most recent call last):
  File "/media/home/hemant/src/DeepSpeedExamples/training/HelloDeepSpeed/train_bert.py", line 10, in <module>
    import datasets
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/__init__.py", line 34, in <module>
    from .arrow_dataset import Dataset, concatenate_datasets
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/arrow_dataset.py", line 46, in <module>
    from .arrow_reader import ArrowReader
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/arrow_reader.py", line 33, in <module>
    from .table import InMemoryTable, MemoryMappedTable, Table, concat_tables
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 331, in <module>
    class InMemoryTable(TableBlock):
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 358, in InMemoryTable
    def from_pandas(cls, *args, **kwargs):
  File "/media/home/hemant/src/DeepSpeedExamples/venv/lib/python3.10/site-packages/datasets/table.py", line 21, in wrapper
    out = wraps(arrow_table_method)(method)
  File "/usr/lib/python3.10/functools.py", line 61, in update_wrapper
    wrapper.__wrapped__ = wrapped
AttributeError: readonly attribute

Env details:

OS: Ubuntu 22.04
Python Version: 3.10.12

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with training/HelloDeepSpeed/train_bert.py and training/HelloDeepSpeed/requirements.txt, then reproduce the import failure in a fresh Python 3.10 environment. Trace the datasets import and its dependency versions to identify the compatibility issue; done means the HelloDeepSpeed training example imports successfully and can proceed past startup.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.