Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"KCPP SD Failed to create context!" after trying to load flux.1-schnell #1217

Open
tororon1231 opened this issue Nov 16, 2024 · 3 comments
Open

Comments

@tororon1231
Copy link

Downloaded weights for FLUX.1-schnell. After that this error was shown:


Welcome to KoboldCpp - Version 1.78
For command line arguments, please refer to --help


Auto Selected CUDA Backend...

Attempting to use CPU library.
Initializing dynamic library: koboldcpp_default.dll

ImageGen Init - Load Model: C:\Users\flux1-schnell-q4_k.gguf

Error: KCPP SD Failed to create context!
Load Image Model OK: False

Error: Could not load image model: C:\Users\flux1-schnell-q4_k.gguf

@LostRuins
Copy link
Owner

LostRuins commented Nov 16, 2024

Did you load the t5xxl, clip-l and vae as well? Those are required for flux.
https://huggingface.co/comfyanonymous/flux_text_encoders/tree/main

Also make sure you load the image model in the right place (NOT the text model)

@tororon1231
Copy link
Author

tororon1231 commented Nov 16, 2024

-1-A cat holding a sign that says Nice to meet you!
@LostRuins Nice it worked! I used quantized text encorders, so it doesn't use much space on my machine. Unfortunately the GUI only supports .safetensors, so I needed to change the file extension from .gguf to .safetensors. Could you please add support for selecting .gguf file extensions for text encoders in the launch GUI?

@LostRuins
Copy link
Owner

Oh, I didn't know anyone actually made quantized text encoders. Sure, I can do that.

Glad flux is working well for you. Do share and help others as I've noticed many people struggling to get it to work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants