Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WeightedBlockSolver for multiple lambdas #229

Open
ericmjonas opened this issue Feb 13, 2016 · 1 comment
Open

WeightedBlockSolver for multiple lambdas #229

ericmjonas opened this issue Feb 13, 2016 · 1 comment

Comments

@ericmjonas
Copy link

We often perform a sweep over lambdas to figure out the right regularization -- it matters a lot.

@shivaram mentioned that it's possible for the weighted solver to potentially solve for a large number of lambdas with minimal overhead. There was evidently some code in a repo associated with a paper that is an example of this. It might be possible (per Shiv's suggestion) that @tomerk could hack on this?

@shivaram
Copy link
Contributor

I misremembered things a little bit - we've never done multi-lambda for the old BlockWeightedLeastSquares. But for the new PerClassWeightedLeastSquares it should be pretty simple to add it by just following wherever we have a loop around lambdas in the unweighted implementation [1].

FWIW If we want feature compatibility across the solvers, the other one should also be possible -- but my guess is that it'll not be that cheap in terms of sharing costs and need some new code.

[1] https://github.com/amplab/ml-matrix/blob/c0c0d7c754f3873c419af85bc298cdde2cb4cdfe/src/main/scala/edu/berkeley/cs/amplab/mlmatrix/BlockCoordinateDescent.scala#L88

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants