Azure / Azure/MachineLearningNotebooks

Dependency problems (docker/pywin32 and ruamel.yaml)

Open
#1,833 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
2.6k
PR merge metrics
No merged PRs in 30d

Description

Hello everyone! I'm having problems with Azure packages because apparently, they have some broken dependencies. I'm reporting the following problems:

* `docker`: Required by `azureml-core`, `docker` is pinned to a version lower than `6.0.0` . However, older versions of this library pin `pywin32 227`, and any version of `pywin32` below `300` breaks `default_azure_credential` when using it in `Windows`. This would automatically break `Azure CLI Login` (in my case this is happening). Also, version `6.0.0` fixes `pywin32` I think azure should just update it to `6.0.0` in order to fix the problem
* `ruamel.yaml`: The package `azureml-pipeline-core` depends on `ruamel.yaml` pinned on a version below `16`. This lib requires to compile some binaries in `C` while installing, and any version below `16` uses an installation method not supported by `pip` versions over `20.1`. To solve this, I had to downgrade `pip`, or install it using `poetry`, which is a package manager able to fix this bug

Considering all `AzureML SDK` packages were developed using modular packages, I really recommend using `Poetry` to manage dependencies, and `dependabot` (or something similar) to update automatically update deps. it would reduce installation time, and would prevent future conflicts.

I think `Azure` should fix these problems before fully migrating to `SDK v2` since there are some features still in beta.

Related links:
- [ruamel#1](https://stackoverflow.com/questions/49868091/python-error-when-installing-ruamel-yaml-package-with-pip)
- [ruamel#2](https://stackoverflow.com/questions/70136750/cant-install-azure-packages-with-pip-ruamel-yaml-error)
- [ruamel#3](https://stackoverflow.com/questions/71967150/problem-installing-azure-pipeline-due-to-ruamel-yaml)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.