Extremely Experimental Libs

⚠️Warning⚠️: Not Officially Supported! Do not open issues if you are using a modified library configuration.

✅ Working
⚠️ Usable, but with issues
❌ Broken

Issues

1. Does not run.
2. May run, but training results are deformed.
3. VRAM does not clear properly; Must manually restart project to clear.

Torch

(Standard) ✅ torch-1.12.1+cu116
✅ torch-1.13.1+cu116
2⚠️ torch-1.13.1+cu117
3⚠️ torch-2.0.0.dev20230106

Xformers

(Standard) ✅ 0.0.14.dev0
2❌ 0.0.14
2❌ 0.0.15.dev0
2❌ 0.0.15
2❌ 0.0.16

Potentially related issues

1. NaNs in backward pass when training with the huggingface diffusers-style trainer and unet. #631

BitsAndBytes

(Standard) ✅ 0.35.0
2. ❌ 0.36.0.post2

Potentially related issues

1. Regression in 0.36.0, training broken when fine-tuning RoBERTa on 3090 #121

Diffusers

(Standard) ✅ 0.10.2
1❌ 0.11.1