Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

'high' and/or 'low' VRAM usage modes #312

Open
tazlin opened this issue Aug 25, 2024 · 0 comments
Open

'high' and/or 'low' VRAM usage modes #312

tazlin opened this issue Aug 25, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@tazlin
Copy link
Member

tazlin commented Aug 25, 2024

This is more pertinent to the worker use case but certain recent changes by ComfyUI and myself have highlighted that there could be some better finessing of memory conditions. While I do feel that it should be largely in the realm of ComfyUI internals to manage this, that project has changed or added a large amount of functionality which is harmful to the worker use case.

  • In particular the change in commit 4e99a01 highlights that there should be at least a 'high vram' mode which opts-in to either default comfy behavior or the deliberately more aggressive use of memory we occasionally use.
@tazlin tazlin added the enhancement New feature or request label Aug 25, 2024
tazlin added a commit that referenced this issue Aug 25, 2024
This is a patent "temporary" fix to prevent extremely large models, such as cascade models, from being forced to fully load. I will track the resolution of this in an issue: #312
tazlin added a commit that referenced this issue Aug 26, 2024
This is a patent "temporary" fix to prevent extremely large models, such as cascade models, from being forced to fully load. I will track the resolution of this in an issue: #312
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant