Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fit mixture coefficients on holdout set #69

Open
gngdb opened this issue Mar 16, 2015 · 0 comments
Open

Fit mixture coefficients on holdout set #69

gngdb opened this issue Mar 16, 2015 · 0 comments
Assignees
Milestone

Comments

@gngdb
Copy link
Member

gngdb commented Mar 16, 2015

We should be able to do some optimisation on the mixing coefficients when we average submission csvs to optimise our score on the leaderboard. We can do this using the holdout set.

Best way to code it is probably to call the function in check_test_score that produces predictions and then input this to sklearn. Then, fit a logistic regression model to each class individually (one vs. all) in the holdout set. Check the weights that we get out doing this to make sure they're reasonable.

@gngdb gngdb added this to the Improvements milestone Mar 16, 2015
@gngdb gngdb added the ready label Mar 16, 2015
@gngdb gngdb added in progress and removed ready labels Mar 16, 2015
@dnstanciu dnstanciu reopened this Dec 9, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants