An intelligent agent-powered chatbot API built using LangGraph, Groq LLMs, and FastAPI, enhanced with real-time search using TavilySearchResults. Supports multiple large models such as LLaMA 3, Mixtral, and Gemma.
π Live Repo: github.com/Srinikhil/AI-Agent-LangGraph-Chatbot
- π FastAPI backend for handling chat requests
- π§ Agent-based reasoning via
LangGraph's ReAct pattern - π Integrated web search using
TavilySearchResults - π Supports multiple LLMs via
Groq:llama3-70b-8192distil-whisper-large-v3-engemma2-9b-itmixtral-8x7b-32768
- π‘ API-first design for frontend or app integrations
| Model Name | Description |
|---|---|
llama3-70b-8192 |
Meta's latest high-accuracy LLM |
distil-whisper-large-v3-en |
Efficient speech recognition (English) |
gemma2-9b-it |
Fine-tuned conversational model |
mixtral-8x7b-32768 |
Sparse Mixture-of-Experts model |
- Clone the repo:
git clone https://github.com/Srinikhil/AI-Agent-LangGraph-Chatbot.git
cd AI-Agent-LangGraph-Chatbot- Install dependencies:
pip install -r requirements.txt- Add API keys in app.py:
groq_api_key = 'your_groq_api_key_here'
os.environ["TAVILY_API_KEY"] = 'your_tavily_api_key_here'- Run
uvicorn app:app --reload
# API at: http://127.0.0.1:8000/chat- Run UI
streamlit run UI.py