A simple chatbot with Llama_cpp library and Mistral 7B Open Orca model
New update for this voice chatbot:
- Offline mode is Mistral 7B Open Orca model + Llama_cpp
- Online mode is Google Gemini API
-
References
- Llama_cpp and chatgpt local: https://github.com/conanak99/sample-gpt-local/tree/master
- Voice chatbot: https://github.com/nguyen-tho/python-chatbot
- Please get your Gemini API key in this URL: https://aistudio.google.com/apikey
-
How to use
Setup environment by virtual environment (virtualenv or venv)
python -m virtualenv <path to setup environment directory>
Activate virtual environment
# move to envinronment directory cd <path to directory> # activate environment source ./Scripts/activate
Install necessary modules
pip install -r requirements.txt
create your Gemini API key and copy it to this file:
key.txt
Run program by app.py
python app.py
-
Contact:
Please contact with me at this email address to discuss: nguyencongtho116@gmail.com