Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[mlr3automl] Error there is no package called ‘mlr3learners’ in CI #392

Open
PGijsbers opened this issue Sep 3, 2021 · 2 comments
Open
Labels
bug Something isn't working external For issues which will be fixed by an external party framework For issues with frameworks in the current benchmark

Comments

@PGijsbers
Copy link
Collaborator

PGijsbers commented Sep 3, 2021

See e.g.: https://github.com/openml/automlbenchmark/runs/3499152666#step:7:18384

Looks like it has to do with Github's policy to only use PATs , though I am not clear as to why because all downloaded repos are public, not private.

@PGijsbers PGijsbers added bug Something isn't working framework For issues with frameworks in the current benchmark labels Sep 3, 2021
@PGijsbers
Copy link
Collaborator Author

I think it should be fixed in an upcoming release, as per this open issue.

@PGijsbers PGijsbers added the external For issues which will be fixed by an external party label Sep 8, 2021
@PGijsbers
Copy link
Collaborator Author

So it will never be truly fixed, as the default PAT will still be rate limited. We'd need to create a way to add a custom PAT. The primary reason for this is CI, where the framework gets installed multiple times - I don't think we have a guarantee that a custom PAT will also not be affected by the rate limit. For large scale experiments it is advised to build an image with the preinstalled setup which bypasses this problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working external For issues which will be fixed by an external party framework For issues with frameworks in the current benchmark
Projects
None yet
Development

No branches or pull requests

1 participant