huggingface / huggingface/diffusers

Attention test seems uncompatible with latest xformers

Open
#12,284 6 comments 0 reactions 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

https://github.com/huggingface/diffusers/blob/764b62473ac10afd9c52e6b3f3f528f719bc7a34/src/diffusers/models/attention.py#L244

It seems that the latest xformers has the memory_efficient_attention function under xops.ops and not xops in this case.

xops.__version__
'0.0.32.post2'

Maybe "import xformers as xops" should be "import xformers.ops as xops" ?

For reference:
https://github.com/facebookresearch/xformers/blob/c159edc05ae5a0192ab0558e834b946155790371/xformers/ops/fmha/__init__.py#L186

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.