microsoft / microsoft/TRELLIS

How do you specify in the app.py to not use flash_attn ??

Open
#11 8 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13.7k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

How do you specify in the app.py to not use flash_attn ??

I did not install flash_attn (because it's giving me an error) but it still tries to use it. How do I prevent this?

Error trying to install flash_attn:

(trellis) C:\inetpub\wwwroot\TRELLIS>pip install flash-attn
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting flash-attn
Downloading flash_attn-2.7.0.post2.tar.gz (2.7 MB)
---------------------------------------- 2.7/2.7 MB 8.5 MB/s eta 0:00:00
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [22 lines of output]
fatal: not a git repository (or any of the parent directories): .git
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "C:\Users\jeffc\AppData\Local\Temp\pip-install-34xtqzwr\flash-attn_72812057375a47f494a81dc7ec330502\setup.py", line 162, in
_, bare_metal_version = get_cuda_bare_metal_version(CUDA_HOME)
File "C:\Users\jeffc\AppData\Local\Temp\pip-install-34xtqzwr\flash-attn_72812057375a47f494a81dc7ec330502\setup.py", line 82, in get_cuda_bare_metal_version
raw_output = subprocess.check_output([cuda_dir + "/bin/nvcc", "-V"], universal_newlines=True)
File "C:\Users\jeffc\anaconda3\envs\trellis\lib\subprocess.py", line 421, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "C:\Users\jeffc\anaconda3\envs\trellis\lib\subprocess.py", line 503, in run
with Popen(*popenargs, **kwargs) as process:
File "C:\Users\jeffc\anaconda3\envs\trellis\lib\subprocess.py", line 971, in init
self._execute_child(args, executable, preexec_fn, close_fds,
File "C:\Users\jeffc\anaconda3\envs\trellis\lib\subprocess.py", line 1456, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] The system cannot find the file specified

  torch.__version__  = 2.4.0


  [end of output]

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inspecting app.py and the dependency or import path that triggers flash_attn, then compare it with the reported Windows installation error from pip install flash-attn. Done should mean the application has a documented way to run without flash_attn, or the issue clearly identifies the supported installation requirements.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.