Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About calculate noise rate by using clean eval-dataset #9

Open
Yuxin-Du-Lab opened this issue Apr 26, 2023 · 2 comments
Open

About calculate noise rate by using clean eval-dataset #9

Yuxin-Du-Lab opened this issue Apr 26, 2023 · 2 comments

Comments

@Yuxin-Du-Lab
Copy link

Thank you very much for your interesting work.
I have a question about this line: in noise learning, is it a normal way to use a clean eval-set to calculate the noise rate (or something similar)? (If you have a test set to do the final test)
I'm just new to this field and don't know the rules very well.
Looking forward to your answer.

@Yuxin-Du-Lab
Copy link
Author

Add a little bit of my understanding: assuming a manually set ratio, the trainer can adjust the hyperparameter using the result of eval. Your work just automates the process.
Is this the correct understanding?

@nazmul-karim170
Copy link
Owner

To your first question, the noise rate is calculated from the training set. We use a clean eval-set for calculating the validation accuracy.

To your second question, yes, we do not adjust the hyperparameters for different noise rates. Same HP for all noise rates.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants