sql-helper

Text-to-SQL using LLM and RAG

How to run

pip3 install -r requirements.txt

bin/run-local.sh

Development plan

LLM:

• platform:
  • OpenAI ChatGPT
  • Cohere Command R+ ?
  • Claude
  • Meta Llama 3 ?

RAG:

• database:
  • chromadb (standalone)
  • postgres pgvector
• embedding model:
  • sentence transformers:
    • all-MiniLM-L6-v2 (*max len = 256)
• index (VSS):
  • HNSW
  • IVF-PQ ?

TODO

• Implement standalone application with ChromaDB
• Implement CRUD with an admin page
• Set a docker environment
• Implement a vector store for PGVector