Compute and print mean single-pass uncertainty metrics during model test #4
Open
samrat-rm wants to merge 3 commits intoOrion-AI-Lab:mainfrom
Open
Compute and print mean single-pass uncertainty metrics during model test #4samrat-rm wants to merge 3 commits intoOrion-AI-Lab:mainfrom
samrat-rm wants to merge 3 commits intoOrion-AI-Lab:mainfrom
Conversation
7 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This change adds single-pass entropy-based uncertainty estimation to the model testing pipeline.
The model now computes uncertainty from softmax probabilities and reports the mean uncertainty alongside Pixel Accuracy and mIoU in the terminal output.
This implementation currently serves as a prototype for uncertainty estimation during model evaluation and can also be extended to the model training pipeline in the future for deeper analysis and experimentation.
Changes
AI usage disclosure :
AI tools like Chat GPT were used to assist with understanding concepts and drafting parts of the implementation. The final code was reviewed, tested, and validated.