Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate (local) StableDiffusion support #7

Open
inFocus7 opened this issue Jan 1, 2024 · 0 comments
Open

Investigate (local) StableDiffusion support #7

inFocus7 opened this issue Jan 1, 2024 · 0 comments
Labels
enhancement New feature or request Project: Listicles

Comments

@inFocus7
Copy link
Owner

inFocus7 commented Jan 1, 2024

We should support users who want to run as much as they can locally. There are many reasons why someone would want to do this:

  1. Save $$$ by not using APIs. From my tests, generating 12 prompts + images costs ~$1.5 USD.
  2. Generate content offline.
  3. Not hit any content filters denying generations.

This is an initial investigation to create multiple issues as it would involve multiple steps, such as

  • Investigating different local image GAN libraries (ex. stablediffusion a1111),
  • Updating the UI/UX to cleanly support choosing between using DALL-E vs StableDiffusion
    • This portion could get messy since the prompting would also differ and we'd likely have a separate UI for each.
  • (Optionally) doing the above + refactoring to allow plug-ability of more support in the future.

https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/API

  • in a nutshell, could probably curl to its localhost port.

  • doing a GET: /sdapi/v1/sd-models returns available models, which i could display a name in the dropdown mapped to the full model name (theres a name and title field in the return)

  • could then, based on user input, perform a POST: /sdapi/v1/txt2img with all prompt data + chosen model and size (might be opinianated on sizes to standard cover 512x512 sizes and portrait).

  • note since a1111 ui + this are gradio they both get exposed on the same port, so will need to change mine.

@inFocus7 inFocus7 added enhancement New feature or request Project: Listicles labels Jan 1, 2024
@inFocus7 inFocus7 added this to the Stable Diffusion Support milestone Jan 1, 2024
@inFocus7 inFocus7 changed the title Investigate how to support StableDiffusion Investigate (local) StableDiffusion support Jan 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Project: Listicles
Projects
None yet
Development

No branches or pull requests

1 participant