Prereq: Ensure node and mongo installations.
- Clone the server repository: `git clone https://github.com/Helpout-G12/Server'
- Open the Server directory in terminal:
cd Server
- Setup the AI server using below instructions.
- Launch the server using
npm start
- Clone `https://github.com/ggerganov/llama.cpp
- Navigate to lamma.cpp:
cd llama.cpp
- Follow the instructions in the Readme.md for llama.cpp to setup llama.cpp
- Download the
ggml-alpaca-7b-q4.bin
for alpaca model weights. - Download the llama
tokenizer.model
for llama. - Use the convert script as directed in the Readme.md for llama.cpp:
python convert.py ggml-alpaca-7b-q4.bin
- Your AI model should be ready. (Run the main executable to test)
- Add the path to the main executable and model to generate.js
- Run generate.js with
node generate.js