Skip to content

Commit

Permalink
Update README
Browse files Browse the repository at this point in the history
  • Loading branch information
rockerBOO committed Jan 20, 2024
1 parent 5a90638 commit 125107c
Showing 1 changed file with 39 additions and 32 deletions.
71 changes: 39 additions & 32 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,28 @@

Rust version of [LoRA inspector](https://github.com/rockerBOO/lora-inspector)

Web based tool for inspecting your LoRAs. All done in the browser, no servers. Private. No dependencies like torch or python.

![Screenshot 2023-12-05 at 03-50-31 LoRA Inspector](https://github.com/rockerBOO/lora-inspector-rs/assets/15027/344cea55-9b1e-4321-93c8-3e3ddc70a9d2)

See the different blocks of the different networks. Ideally uses the more common format but still good to see how the weights are effectively. We use Frobenius norm for the magnitude and a vector norm for the strength.

![Screenshot 2023-12-05 at 03-33-38 LoRA Inspector](https://github.com/rockerBOO/lora-inspector-rs/assets/15027/e128240f-ef1a-4c6c-a019-4548e57892e9)

See the different settings for the LoRA file. What model it was trained on. Any VAE. Network Dim/Rank and Alpha. Learning rates. Optimizer settings, Learning rate schedulers.

![8efa06b5-4b86-4ffb-bf19-8842eaed5503](https://github.com/rockerBOO/lora-inspector-rs/assets/15027/0df99556-73bf-4e2b-a576-2e2f0693377e)

Dataset with buckets. Bucket resolutions.

![aef217c2-59a2-40c1-b2a3-bef3df800895](https://github.com/rockerBOO/lora-inspector-rs/assets/15027/26c8daec-353c-45da-a6a2-1e6a791dbf42)

Subsets showing the different subset datasets, image augments, captions.

![c2182030-8b1f-4eff-8007-3feafa60b577](https://github.com/rockerBOO/lora-inspector-rs/assets/15027/cff02f1b-5f75-48ba-a126-3f781bcb1005)

Tags used (tags are phrases separated by , )

- WASM version
- Binary (coming soon)

Expand All @@ -16,49 +38,34 @@ Rust version of [LoRA inspector](https://github.com/rockerBOO/lora-inspector)
### Build

```bash
wasm-pack build --target web
wasm-pack build --target no-modules --out-dir pkg crates/lora-inspector-wasm --release
```

### Deploy
### Usage

Any http-server works (like python or nginx)

```bash
fly deploy
cd crates/lora-inspector-wasm
npx http-server
```

## Contributions
Then we can view it in the browser.

Welcome
```
http://localhost:8080
```

## Bugs
### Deploy

X Loading a new file doesn't unload the previous LoRA properly (be aware of loading multiple LoRAS in the future)
X Loading some LoRAs fail to be loaded into the buffer
```bash
fly deploy
```

- Loading some LoRAs fail to load their block weights (undefined error)
- Average TE/UNet blocks are now invalid (generally)
## Contributions

- Skeletor_v1 bf16 safetensors do not process block weights
X show precision type of LoRA
Welcome

### Metadata options
### Missing metadata options

- CLIP skip
- LR Warmup

- Max token length
- output name
- prior loss weight

- full_fp16
- full_bf16

- training comment

- ss_training_finished_at
- ss_training_started_at

- ss_num_train_images

- ss_caption_dropout_every_n_epochs
- ss_caption_dropout_rate
- ss_caption_tag_dropout_rate

0 comments on commit 125107c

Please sign in to comment.