Interactive Evaluation Dashboard

[sanju234-san]

Create an interactive web-based dashboard (using Streamlit or Gradio) that provides real-time insights into the OpenMath model's performance on math problems. This dashboard will allow users to explore evaluation results, analyze error patterns, and understand where the model excels or struggles.🎯 Key Features1. Live Problem Solver

Input box for users to enter custom math problems
Real-time step-by-step solution display
Shows intermediate reasoning steps
Displays final answer with confidence score
2. Batch Evaluation Interface

Upload custom test sets (JSON/CSV)
Run evaluation on GSM8K test set (with configurable sample size)
Live progress bar during evaluation
Save evaluation results for later analysis
3. Performance Metrics Dashboard

Overall Accuracy (with visual gauge/meter)
Accuracy by Problem Type:

Addition/Subtraction
Multiplication/Division
Multi-step word problems
Percentage/Ratio problems

Accuracy by Difficulty:

Easy (1-2 steps)
Medium (3-4 steps)
Hard (5+ steps)

Charts/graphs showing performance trends

[Rafiaminhaj]

Hi @AshChadha-iitg 👋
I would like to work on this issue under OSCG’26.
This is a very impactful enhancement, and I’m interested in building an interactive and user-friendly evaluation dashboard for the OpenMath model.
Proposed Approach:
Develop the dashboard using Streamlit (preferred for quick interactive analytics) or Gradio, depending on project preference.
Implement a Live Problem Solver with:
Input box for custom math problems
Step-by-step reasoning display
Final answer + confidence score
Build a Batch Evaluation Interface:
JSON/CSV upload support
GSM8K test evaluation with configurable sample size
Live progress indicator
Option to store evaluation results
Create a Performance Metrics Section:
Overall accuracy gauge
Accuracy breakdown by problem type
Accuracy by difficulty level
Interactive charts for trend analysis
I will ensure the UI is clean, responsive, and easy to interpret, with well-structured code for maintainability.
Please let me know if I can proceed with the implementation. Thank you!