huggingface / huggingface/alignment-handbook
Warning: Could not find `flash_attn`
- Dominant language
- Python
- Stars
- 5.7k
- Forks
- 490
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
I have activated an environment as mentioned in the repository and run `python -m pip install flash_attn --no-build-isolation`, but when I run the alignment handbook scripts as mentions it gives me
"Warning: Could not find flash_attn"
"Warning: Could not find xformers"
I've pip freezed to check if it's there and it is present.
I've checked if pip and python points to the environment, and if the environment is activated and it appears so.
I'm not sure what's going on. Here's my pip freeze dump:
```
absl-py==2.1.0
accelerate==1.4.0
aiohappyeyeballs==2.4.6
aiohttp==3.11.13
aiosignal==1.3.2
-e git+ssh://git@github.com/CMU-Trusted-AI-Challenge-Team/alignment-handbook-clone.git@7f01856a70f213eab823698d23625d648436a00c#egg=alignment_handbook&subdirectory=../../../code/alignment-handbook-clone
annotated-types==0.7.0
async-timeout==5.0.1
attrs==25.1.0
bitsandbytes==0.45.3
Brotli @ file:///croot/brotli-split_1736182456865/work
certifi @ file:///croot/certifi_1738623731865/work/certifi
charset-normalizer @ file:///croot/charset-normalizer_1721748349566/work
click==8.1.8
datasets==3.3.2
deepspeed==0.16.4
dill==0.3.8
docker-pycreds==0.4.0
docstring_parser==0.16
einops==0.8.1
evaluate==0.4.0
filelock @ file:///croot/filelock_1700591183607/work
flash_attn==2.0.2
frozenlist==1.5.0
fsspec==2024.12.0
gitdb==4.0.12
GitPython==3.1.44
gmpy2 @ file:///croot/gmpy2_1738085463648/work
grpcio==1.70.0
hf_transfer==0.1.9
hjson==3.1.0
huggingface-hub==0.29.1
idna @ file:///croot/idna_1714398848350/work
Jinja2 @ file:///croot/jinja2_1737760107953/work
Markdown==3.7
markdown-it-py==3.0.0
MarkupSafe @ file:///croot/markupsafe_1738584038848/work
mdurl==0.1.2
mkl-service==2.4.0
mkl_fft @ file:///io/mkl313/mkl_fft_1730824109137/work
mkl_random @ file:///io/mkl313/mkl_random_1730823916628/work
mpmath @ file:///croot/mpmath_1690848262763/work
msgpack==1.1.0
multidict==6.1.0
multiprocess==0.70.16
networkx @ file:///croot/networkx_1737039604450/work
ninja==1.11.1.3
numpy==1.26.4
nvidia-ml-py==12.570.86
packaging==24.2
pandas==2.2.3
peft==0.14.0
pillow @ file:///croot/pillow_1738010226202/work
platformdirs==4.3.6
propcache==0.3.0
protobuf==3.20.2
psutil==7.0.0
py-cpuinfo==9.0.0
pyarrow==19.0.1
pydantic==2.10.6
pydantic_core==2.27.2
Pygments==2.19.1
PySocks @ file:///home/builder/ci_310/pysocks_1640793678128/work
python-dateutil==2.9.0.post0
pytz==2025.1
PyYAML @ file:///croot/pyyaml_1728657952215/work
regex==2024.11.6
requests @ file:///croot/requests_1730999120400/work
responses==0.18.0
rich==13.9.4
safetensors==0.5.3
scipy==1.15.2
sentencepiece==0.2.0
sentry-sdk==2.22.0
setproctitle==1.3.5
shtab==1.7.1
six==1.17.0
smmap==5.0.2
sympy @ file:///croot/sympy_1738108488918/work
tensorboard==2.19.0
tensorboard-data-server==0.7.2
tokenizers==0.21.0
torch==2.1.2
torchaudio==2.1.2
torchvision==0.16.2
tqdm==4.67.1
transformers==4.49.0
trl==0.9.6
typeguard==4.4.2
typing_extensions @ file:///croot/typing_extensions_1734714854207/work
tyro==0.9.16
tzdata==2025.1
urllib3 @ file:///croot/urllib3_1737133630106/work
wandb==0.19.7
Werkzeug==3.1.3
xformers @ file:///home/conda/feedstock_root/build_artifacts/xformers_1699939412219/work
xxhash==3.5.0
yarl==1.18.3
```
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the alignment handbook scripts referenced in the report and inspect how they check for flash_attn and xformers; compare that runtime environment with the provided pip freeze and Python/pip environment checks. Done means the scripts recognize the installed dependencies or the cause of the warnings is documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100