Azure / Azure/MachineLearningNotebooks

AzureML pipeline designer pyarrow dependency while installing transformers

未關閉
#1,698 3 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Jupyter Notebook
星號
4.4k
分支
2.6k
PR 合併指標
30 天內沒有已合併 PR

描述

I was trying to import transformers in AzureML designer pipeline, it says for importing transformers and datasets the version of pyarrow needs to >=3.0.0, but then after upgrading pyarrow's version to 3.0.0 and importing transformers pyarrow version is reset to original version of 0.16.0. attaching few error samples. please have a look.

`Got exception when invoking script: 'RuntimeError: Failed to import transformers.trainer because of the following error (look up to see its traceback):To use datasets, the module pyarrow>=3.0.0 is required, and the current version of pyarrow doesn't match this condition.If you are running this in a Google Colab, you should probably just restart the runtime to use the right version of pyarrow.' azureml-designer-core 0.0.68 requires pyarrow==0.16.0, but you'll have pyarrow 3.0.0 which is incompatible.`

貢獻指南

這個儲存庫沒有索引到貢獻指南

研究方向

首先在 AzureML designer 管線中重現匯入,並將 transformers 和 datasets 的需求與 azureml-designer-core 0.0.68 進行比較,該版本將 pyarrow 固定為 0.16.0。完成標準是管線能夠匯入 transformers 和 datasets,同時不會降級 pyarrow 或產生版本衝突。

由索引模型根據 Issue 內容生成。

評估

技術堆疊
azure, python
領域
cloud, machine-learning
Issue 類型
缺陷
難度
4/5
預估耗時
3-5 天
活躍度
停滯
描述清晰度
需要釐清
新手友好度
25/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。