Create Chatbot to Answer questions based on playstore review data
This project uses:
- Python 3.11
- Mistral:7b on Ollama
Please open this link to see how to install Ollama on your platform
ollama pull mistral
Install dependencies required for this project by execute:
make install
Please follow these steps below
We use data from spotify review dataset then sample it to only ~200 because computation limit. Download the data from above url then do:
python sampler.py
This command below to ingest data to faiss vectordb
python ingest.py
Execute the command below to run the chatbot
make run
- The solution above has limitation on prompt context length so it decrease the accuracy. For large data, we need to try another approach such as using agents or function calling so we can process the whole dataset
- We use mistral:7b which is free and open source llm so the accuracy is not so well. We need to try using gpt3.5 or gpt4 (but i have no money :sadpepe)
- Need to try to improve the prompt for better accuracy