Skip to content

A simple chatbot with Llama_cpp library and Mistral 7B Open Orca model

Notifications You must be signed in to change notification settings

nguyen-tho/simple-chatbot

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

simple-chatbot

A simple chatbot with Llama_cpp library and Mistral 7B Open Orca model

New update for this voice chatbot:

  • Offline mode is Mistral 7B Open Orca model + Llama_cpp
  • Online mode is Google Gemini API
  1. References

  2. How to use

    Setup environment by virtual environment (virtualenv or venv)

    python -m virtualenv <path to setup environment directory>

    Activate virtual environment

    # move to envinronment directory
    cd <path to directory>
    # activate environment
    source ./Scripts/activate

    Install necessary modules

    pip install -r requirements.txt

    create your Gemini API key and copy it to this file:

    key.txt

    Run program by app.py

    python app.py
  3. Contact:

    Please contact with me at this email address to discuss: nguyencongtho116@gmail.com

About

A simple chatbot with Llama_cpp library and Mistral 7B Open Orca model

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages