huggingface / huggingface/alignment-handbook

Warning: Could not find `flash_attn`

Open
#213 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.7k
Forks
490
Avg merge
2m
Merged PRs (30d)
1

Description

I have activated an environment as mentioned in the repository and run `python -m pip install flash_attn --no-build-isolation`, but when I run the alignment handbook scripts as mentions it gives me
"Warning: Could not find flash_attn"
"Warning: Could not find xformers"
I've pip freezed to check if it's there and it is present.
I've checked if pip and python points to the environment, and if the environment is activated and it appears so.
I'm not sure what's going on. Here's my pip freeze dump:
```
absl-py==2.1.0
accelerate==1.4.0
aiohappyeyeballs==2.4.6
aiohttp==3.11.13
aiosignal==1.3.2
-e git+ssh://git@github.com/CMU-Trusted-AI-Challenge-Team/alignment-handbook-clone.git@7f01856a70f213eab823698d23625d648436a00c#egg=alignment_handbook&subdirectory=../../../code/alignment-handbook-clone
annotated-types==0.7.0
async-timeout==5.0.1
attrs==25.1.0
bitsandbytes==0.45.3
Brotli @ file:///croot/brotli-split_1736182456865/work
certifi @ file:///croot/certifi_1738623731865/work/certifi
charset-normalizer @ file:///croot/charset-normalizer_1721748349566/work
click==8.1.8
datasets==3.3.2
deepspeed==0.16.4
dill==0.3.8
docker-pycreds==0.4.0
docstring_parser==0.16
einops==0.8.1
evaluate==0.4.0
filelock @ file:///croot/filelock_1700591183607/work
flash_attn==2.0.2
frozenlist==1.5.0
fsspec==2024.12.0
gitdb==4.0.12
GitPython==3.1.44
gmpy2 @ file:///croot/gmpy2_1738085463648/work
grpcio==1.70.0
hf_transfer==0.1.9
hjson==3.1.0
huggingface-hub==0.29.1
idna @ file:///croot/idna_1714398848350/work
Jinja2 @ file:///croot/jinja2_1737760107953/work
Markdown==3.7
markdown-it-py==3.0.0
MarkupSafe @ file:///croot/markupsafe_1738584038848/work
mdurl==0.1.2
mkl-service==2.4.0
mkl_fft @ file:///io/mkl313/mkl_fft_1730824109137/work
mkl_random @ file:///io/mkl313/mkl_random_1730823916628/work
mpmath @ file:///croot/mpmath_1690848262763/work
msgpack==1.1.0
multidict==6.1.0
multiprocess==0.70.16
networkx @ file:///croot/networkx_1737039604450/work
ninja==1.11.1.3
numpy==1.26.4
nvidia-ml-py==12.570.86
packaging==24.2
pandas==2.2.3
peft==0.14.0
pillow @ file:///croot/pillow_1738010226202/work
platformdirs==4.3.6
propcache==0.3.0
protobuf==3.20.2
psutil==7.0.0
py-cpuinfo==9.0.0
pyarrow==19.0.1
pydantic==2.10.6
pydantic_core==2.27.2
Pygments==2.19.1
PySocks @ file:///home/builder/ci_310/pysocks_1640793678128/work
python-dateutil==2.9.0.post0
pytz==2025.1
PyYAML @ file:///croot/pyyaml_1728657952215/work
regex==2024.11.6
requests @ file:///croot/requests_1730999120400/work
responses==0.18.0
rich==13.9.4
safetensors==0.5.3
scipy==1.15.2
sentencepiece==0.2.0
sentry-sdk==2.22.0
setproctitle==1.3.5
shtab==1.7.1
six==1.17.0
smmap==5.0.2
sympy @ file:///croot/sympy_1738108488918/work
tensorboard==2.19.0
tensorboard-data-server==0.7.2
tokenizers==0.21.0
torch==2.1.2
torchaudio==2.1.2
torchvision==0.16.2
tqdm==4.67.1
transformers==4.49.0
trl==0.9.6
typeguard==4.4.2
typing_extensions @ file:///croot/typing_extensions_1734714854207/work
tyro==0.9.16
tzdata==2025.1
urllib3 @ file:///croot/urllib3_1737133630106/work
wandb==0.19.7
Werkzeug==3.1.3
xformers @ file:///home/conda/feedstock_root/build_artifacts/xformers_1699939412219/work
xxhash==3.5.0
yarl==1.18.3
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the alignment handbook scripts referenced in the report and inspect how they check for flash_attn and xformers; compare that runtime environment with the provided pip freeze and Python/pip environment checks. Done means the scripts recognize the installed dependencies or the cause of the warnings is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.