AOSSIE-Org / AOSSIE-Org/EduAid

Bugs in the backend/server.py and script.sh

Offen
#212 1 Kommentar 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
JavaScript
Sterne
171
Forks
425
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

### `script.sh` and `server.py` discrepancies

There are some serious issues in the backend...

**The Issue:**

1. _`script.sh`_

> the script does not do what is expected of it in `README.md` ... this is done by https://github.com/SnehaChaursia in #188 but ill still add the PR anyway

2. `server.py`

>Many of the libraries that it imports have some dependency modules that are deprecated. Reason for this maybe because they're too old to be maintained, or have been removed by the maintainers, or just renamed to something else.

> When you try to import `similarity` library _(like in `backend/server.py` and `backend/Generator/main.py` )_ ... you get an import error...
**reason:** the `jaro_winkler` module from library `jellyfish` doesnt exist anymore..
its been renamed to `jaro_winkler_similarity`

![Image](https://github.com/user-attachments/assets/34393872-768c-444b-8fb9-cc4773ec244e)

> In some computers with limited GPU, the issue occurred because the `server.py` script attempted to load a large model on a GPU with insufficient VRAM (1.96GB), causing a CUDA Out of Memory error

![Image](https://github.com/user-attachments/assets/f45a9927-29cb-4fc0-806a-a0d9c8b1ac7e)

**What I propose:**

- [x] Replace every instance of `jors_winkler` to `jors_winkler_similarity`

- [x] Force use CPU instead of GPU if insufficient VRAM is present
- [x] before running `server.py` , set the environment variable `os.environ["PYTORCH_CUDA_ALLOC_CONF"] = "expandable_segments:True"`

Beitragsleitfaden

Für dieses Repository ist kein Beitragsleitfaden indexiert

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.