One step costs one minute?

[conanwsz]

I followed the quick start guide and ran it on my laptop (equipped with an RTX 4070 8G graphics card) via WSL Ubuntu 22.04 and the Gradio demo.
Each step takes approximately one minute. Is this normal or have I made some error?

[able2608]

Can you provide us with the generation details like the input and output size, and how many images are used for conditioning and the size of them? These info are required for us to diagnose your problem as they influence the generation time a lot.

[conanwsz]

Can you provide us with the generation details like the input and output size, and how many images are used for conditioning and the size of them? These info are required for us to diagnose your problem as they influence the generation time a lot.

I tried the second demo and set both height and width to 512.

[able2608]

Since you have ticked the use_input_image_size_as_output option, the set output size is ignored and the original reference image size 2000×3000 is used. 8G of VRAM is quite low in OmniGen's standard, and I believe that extensive offloading or system RAM fallback happens in the background when you are generating, hence the miserable speed. You might want to first downsize the image to a reasonable size (like 1024×680) and keep that option on, or untick the option and set the output size lower. To generate at 2000×3000 you might need something beefier.

[conanwsz]

Since you have ticked the use_input_image_size_as_output option, the set output size is ignored and the original reference image size 2000×3000 is used. 8G of VRAM is quite low in OmniGen's standard, and I believe that extensive offloading or system RAM fallback happens in the background when you are generating, hence the miserable speed. You might want to first downsize the image to a reasonable size (like 1024×680) and keep that option on, or untick the option and set the output size lower. To generate at 2000×3000 you might need something beefier.

Setting both separate_cfg_infer and offload_model to true will significantly enhance the speed. Thanks.