Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Krippendorff’s alpha? #19

Open
ericphanson opened this issue Feb 1, 2021 · 3 comments
Open

Add Krippendorff’s alpha? #19

ericphanson opened this issue Feb 1, 2021 · 3 comments

Comments

@ericphanson
Copy link
Member

It is a measure of inter-rater reliability and there is a Julia package to compute it: https://discourse.julialang.org/t/ann-krippendorff-jl/54261

@ararslan
Copy link
Member

ararslan commented Feb 1, 2021

I'd be interested to hear @mbwestover's opinion here.

@ericphanson
Copy link
Member Author

We discussed this during our sync meeting today; the consensus was it would be great to have as an additional interrater-reliability measure but wasn't a priority for us to implement in Lighthouse.

@FPGro if you or anyone else were up for adding it to Lighthouse, we'd be glad to get a PR!

@FPGro
Copy link

FPGro commented Feb 19, 2021

Sounds reasonable. I'll come back to this as soon as I have enough tests in place to feel confident registering the package.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants