Skip to content

Add interactive chatbot mode for real-time math Q&A #31

@Praharsh7270

Description

@Praharsh7270

Currently, inference.py only runs a single hardcoded math problem. It would be useful to have an interactive chat mode where users can type math questions on the spot and receive instant solutions without needing to restart the script.

Problem
Users must edit inference.py every time they want to test a new question
Model reloads for each run (slow on limited hardware)
No continuous conversation experience
Proposed Solution

Add a new chat.py script that:
Loads the model once at startup
Runs an interactive loop accepting user questions
Generates step-by-step solutions in real-time
Allows users to exit gracefully with quit/exit commands

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions