Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve dbtpal.telescope speed #18

Open
PJGaetan opened this issue Apr 2, 2023 · 1 comment
Open

Improve dbtpal.telescope speed #18

PJGaetan opened this issue Apr 2, 2023 · 1 comment
Labels
help wanted Extra attention is needed

Comments

@PJGaetan
Copy link

PJGaetan commented Apr 2, 2023

Right now every time we want to open the telescope picker, we have to run the dbt cli.

We could make use of some kind of caching strategy to speed up the process.
We would store the state of the output, using the state of files inside the dbt project, we would redirect to the cached result when none had changed.
Even better we could attached the function responsible to generate the model state when a buffer is saved, to try to avoid cold start to a maximum.

I'm up to looking into such a thing, but do you have another view on how to reason about this thing ?

@PedramNavid
Copy link
Owner

There's not a lot of great options at the moment. dbt-rpc which would have been perfect, has been deprecated. dbt-server is not really in a state where I can develop against.

Caching is definitely possible, if you'd like to contribute I'd be happy to accept a PR. Happy to assist with that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants