Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to load components from private hub #575

Open
RobbeSneyders opened this issue Oct 30, 2023 · 0 comments
Open

Add ability to load components from private hub #575

RobbeSneyders opened this issue Oct 30, 2023 · 0 comments
Labels

Comments

@RobbeSneyders
Copy link
Member

The pipeline SDK only provides an API to either load reusable components from the "fondant hub", which is currently still the components directory in the fondant repository, or to load a custom component from the local file system.

We should make it easy to share components using a private hub as well. Only the fondant_component.yaml specs need to be available in such a hub, which could be done on a remote file system. We could parametrize the current from_registry mechanism to accept a url to a private registry and use fsspec to access it.

Credentials would be needed as well, but since this runs "locally" during compile time, these can be set in the user environment, and might only need documentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: Breakdown
Development

No branches or pull requests

1 participant