to get a better understanding and introduction to NLP, decided to do a pet project about it. You need a gpu to run this, since the glove and llama model need one to function.
venvs are optional, but highly recommended just in general
To create your virtual enviornment, open the terminal in your repository folder and enter
/path/to/python.exe -m venv venv_name
For the word movers distance, install one of the gloves and extract the zip into the repository. then edit the gloveInputFile
String in the code with the path to the glove model of your choosing
https://nlp.stanford.edu/projects/glove/
Make sure you have installed c++ tools from this link
https://visualstudio.microsoft.com/visual-cpp-build-tools/
And install the nvidia cuda toolkit
https://developer.nvidia.com/cuda-toolkit
run the requirements.txt
file
and run this command to install the spacy english language model
python -m spacy download en_core_web_sm
Open an admin access terminal and run this code so you can activate the virtual enviornment
Set-ExecutionPolicy -ExecutionPolicy RemoteSigned
Then open the terminal in your repository folder and enter
venv_name/Scripts/activate
Run the python file like usual, and follow the directions
Once your done running your code, run this in a terminal inside your repository folder
venv_name/Scripts/deactivate
And run this in an admin access terminal
Set-ExecutionPolicy -ExecutionPolicy Undefined