Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugs in the backend/server.py and script.sh #212

Open
3 tasks done
Dasux opened this issue Feb 13, 2025 · 0 comments
Open
3 tasks done

Bugs in the backend/server.py and script.sh #212

Dasux opened this issue Feb 13, 2025 · 0 comments

Comments

@Dasux
Copy link

Dasux commented Feb 13, 2025

script.sh and server.py discrepancies

There are some serious issues in the backend...

The Issue:

  1. script.sh

the script does not do what is expected of it in README.md ... this is done by https://github.com/SnehaChaursia in #188 but ill still add the PR anyway

  1. server.py

Many of the libraries that it imports have some dependency modules that are deprecated. Reason for this maybe because they're too old to be maintained, or have been removed by the maintainers, or just renamed to something else.

When you try to import similarity library (like in backend/server.py and backend/Generator/main.py ) ... you get an import error...
reason: the jors_winkler module from library jellyfish doesnt exist anymore..
its been renamed to jors_winkler_similarity

Image

In some computers with limited GPU, the issue occurred because the server.py script attempted to load a large model on a GPU with insufficient VRAM (1.96GB), causing a CUDA Out of Memory error

Image

What I propose:

  • Replace every instance of jors_winkler to jors_winkler_similarity

  • Force use CPU instead of GPU if insufficient VRAM is present

  • before running server.py , set the environment variable os.environ["PYTORCH_CUDA_ALLOC_CONF"] = "expandable_segments:True"

Dasux added a commit to Dasux/EduAid that referenced this issue Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant