Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dependencies not being pulled #151

Closed
DarkIceXD opened this issue Jul 3, 2024 · 2 comments · May be fixed by #162
Closed

Dependencies not being pulled #151

DarkIceXD opened this issue Jul 3, 2024 · 2 comments · May be fixed by #162

Comments

@DarkIceXD
Copy link

DarkIceXD commented Jul 3, 2024 •
edited
Loading

I can't find a way to upload a pipeline with dependencies.
I created this test pipeline:
test.py:

"""
title: Test pipline
requirements: llama-index-vector-stores-qdrant
"""

from typing import List, Union, Generator, Iterator

class Pipeline:
    def __init__(self):
        pass
    
    def pipe(
        self, user_message: str, model_id: str, messages: List[dict], body: dict
    ) -> Union[str, Generator, Iterator]:
        return "hello world"

Notice the llama-index requirement. I then added the pipeline through the UI and checked the installed modules by doing docker exec pipelines pip list | grep llama-index-vector-stores-qdrant and it would't find it. I am not sure if its an issue with Pipelines or WebUI.

I also can't use PIPELINES_URLS because i would have to upload the pipeline publicly which isn't an option.
@Marenz
Copy link
Contributor

Marenz commented Jul 12, 2024 •
edited
Loading

From what I can tell the PIPELINE_URLS is the only way to do this currently.
But you don't have to upload something publicly for that:

  • You can use a private gist that only works when you know the link
  • You start a minimal http server and host it yourself for the few seconds its starting up, just ask chatgpt or any LLM of your choice to give you a simple single file http server

@DarkIceXD
Copy link
Author

its kind of hacky. i might look into implementing it myself and opening a PR. as far as i can see its just implementing this in python.

@DarkIceXD DarkIceXD mentioned this issue Jul 16, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Added automatic requirements installation from docstring DarkIceXD/pipelines
3 participants
@Marenz @DarkIceXD @justinh-rahb