Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Benchmark table is not consistent (am I wrong?) #44

Open
tryanbot opened this issue Apr 2, 2023 · 2 comments
Open

Benchmark table is not consistent (am I wrong?) #44

tryanbot opened this issue Apr 2, 2023 · 2 comments

Comments

@tryanbot
Copy link

tryanbot commented Apr 2, 2023

I read the paper and compare it to this website : https://www.indobenchmark.com/leaderboard.html . It seems that the sequence labelling benchmark is not the same. I also tried my own fine-tuning, and the result is closer to the one on the paper rather than that in the website. is there any explanation regarding this problem?
@gentaiscool
Copy link
Contributor

Thank you for creating the issue. The numbers on the website is outdated. You can refer to the paper for the more updated results.

@tryanbot
Copy link
Author

tryanbot commented Apr 3, 2023

It seems the result on the web is better than that on the paper. If the one on the paper is the latest, how come the performance is decreased?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gentaiscool @tryanbot