google-deepmind / google-deepmind/brave

Config help would be appreciated

Open
#1 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
52
Forks
3
PR merge metrics
No merged PRs in 30d

Description

Hi,

I am having difficulty setting up this program to use my GPU (nvidia RTX 2070). I am relatively new to configuring nvidia drivers and cuda versions in general and I attempted to do so in Ubuntu 20.04. For your information, I am running the brave program within a Python3.9 venv (not Anaconda).

I tried 2 approaches:

1. On Windows host, I created a UbuntuServer20.04 VM in VirtualBox. I did not go very far with this, because stumbled upon a post suggesting that I cannot use my host's GPU with full functionality through VirtualBox VM (only an emulated version with cuda cores inaccessible).

2. Dual-booted my machine with Ubuntu Desktop 20.04. I was able to install Cuda 10.1 (as per noted is needed for jaxlib in the brave documentation). To install cuda, I followed steps on this website : https://medium.com/@stephengregory_69986/installing-cuda-10-1-on-ubuntu-20-04-e562a5e724a0

When on Linux host, I have no issue displaying my GPU drivers and cuda version with terminal commands, however, there seems to be a default path I forgot to set somewhere so that the brave code knows where to look for my cuda binaries.

When I run the long command (python -m brave.evaluate_video_embeddings) with "--batch_size 8", I see many warnings regarding "*cuda*.so", then my CPU fan makes a lot of noise, but I do not see any print statements. Eventually "Killed" is printed on the terminal and the program stops.

When I run the long command (python -m brave.evaluate_video_embeddings) with "--batch_size 1", I see the same warnings regarding "*cuda*.so" and "xla_bridge.py:234] No GPU/TPU found, falling back to CPU. (Set TF_CPP_MIN_LOG_LEVEL=0 and rerun for more info.)".

However, I get to see the following "completed embedding" progressing, which is nice!
![Progress](https://user-images.githubusercontent.com/48818196/151888179-4cae9944-a314-4a90-ab68-5501cac79b47.png)
I stopped the program because I had other things to do and clearly have no idea of how long this process could take. This said, this is the most progress I made although the warnings suggest that the code exclusively used my CPU (not GPU).

My questions:

1. Is a cuda enabled GPU necessary to run this program or does it just make it run faster?

2. Is there something obviously wrong with my GPU configuration attempts that I do not see? Please recommend a different approach or point me to relevant documentation.

3. How long does the "brave.evaluate_video_embeddings --batch_size 1" command take to execute approximately? I have a i7 9700k + RTX 2070 and everything stored on SSD.

Thank you very much for your time. I am excited to get this code to run.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.