Skip to content

feat: implement bounty #1 weighted quality scoring engine#8

Open
sungdark wants to merge 1 commit intoMint-Claw:mainfrom
sungdark:bounty/issue-1-score-engine
Open

feat: implement bounty #1 weighted quality scoring engine#8
sungdark wants to merge 1 commit intoMint-Claw:mainfrom
sungdark:bounty/issue-1-score-engine

Conversation

@sungdark
Copy link

@sungdark sungdark commented Feb 26, 2026

Implements issue #1 bounty requirements for multi-dimensional quality scoring.

What’s included

  • Added scoring.py with weighted rubric scoring across 5 dimensions:
    • Completeness (0.30)
    • Format Compliance (0.20)
    • Coverage (0.25)
    • Clarity (0.15)
    • Validity (0.10)
  • Auto format detection for JSON / markdown / code / text
  • Output contract: {weighted_score, quality_rating, scores, feedback, pass_threshold}
  • Added API endpoints:
    • POST /api/quality/score
    • POST /api/quality/benchmark
  • Added tests (test_scoring.py) including a 100-submission runtime check (<10s)
  • Added sample scorecards (sample_scorecards.json) and README usage docs

Validation

python3 -m unittest -v passes locally.

Closes #1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BOUNTY $10] Multi-Dimensional Quality Scoring for Structured Outputs

1 participant