Skip to content
This repository has been archived by the owner on Aug 27, 2019. It is now read-only.

Huber/Robust regression; optimize sigma #7

Open
tlienart opened this issue Aug 21, 2019 · 0 comments
Open

Huber/Robust regression; optimize sigma #7

tlienart opened this issue Aug 21, 2019 · 0 comments

Comments

@tlienart
Copy link
Owner

tlienart commented Aug 21, 2019

Huber regression in its default format works fine; Sklearn optimises an additional scale factor;

Probably can get to something similar by doing r ./= sigma and having a gradient in sigma etc; needs a bit of thinking if only because sklearn ensures sigma is positive by using LBFGSB and not just LBFGS.

Probably something that could be added optionally leaving the possibility for the user to CV it. Needs a bit of proper thinking as to blocking delta, blocking delta * sigma etc.

Allegedly it might make more sense to keep things as they are and CV the delta (or at least keep this possible) Though not directly comparable to sklearn as a result.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant