Skip to content

Commit

Permalink
rename evo models
Browse files Browse the repository at this point in the history
  • Loading branch information
mkshing committed Mar 13, 2024
1 parent a462165 commit 7e49bde
Show file tree
Hide file tree
Showing 5 changed files with 8 additions and 8 deletions.
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,9 +12,9 @@ This is an official repository of [Evolutionary Optimization of Model Merging Re
| 2 | [WizardMath 7B V1.1](https://huggingface.co/WizardLM/WizardMath-7B-V1.1) | 18.4 | 60.1 |
| 3 | [Abel 7B 002](https://huggingface.co/GAIR/Abel-7B-002) | 30.0 | 56.5 |
| 4 | [Arithmo2 Mistral 7B](https://huggingface.co/upaya07/Arithmo2-Mistral-7B) | 24.0 | 56.4 |
| 5 | [(Ours) EvoLLM-v1-JP-7B-A](https://huggingface.co/SakanaAI/EvoLLM-v1-JP-7B-A) | **52.4** | **69.0** |
| 6 | [(Ours) EvoLLM-v1-JP-7B](https://huggingface.co/SakanaAI/EvoLLM-v1-JP-7B) | **52.0** | **70.5** |
| 7 | [(Ours) EvoLLM-v1-JP-10B](https://huggingface.co/SakanaAI/EvoLLM-v1-JP-10B) | **55.6** | **68.2** |
| 5 | [(Ours) EvoLLM-JP-A-v1-7B](https://huggingface.co/SakanaAI/EvoLLM-JP-A-v1-7B) | **52.4** | **69.0** |
| 6 | [(Ours) EvoLLM-JP-v1-7B](https://huggingface.co/SakanaAI/EvoLLM-JP-v1-7B) | **52.0** | **70.5** |
| 7 | [(Ours) EvoLLM-JP-v1-10B](https://huggingface.co/SakanaAI/EvoLLM-JP-v1-10B) | **55.6** | **68.2** |

### VLM

Expand All @@ -23,7 +23,7 @@ This is an official repository of [Evolutionary Optimization of Model Merging Re
| [LLaVA-1.6-Mistral-7B](https://llava-vl.github.io/blog/2024-01-30-llava-next/) | 14.32 | 41.10 |
| [Japanese Stable VLM](https://huggingface.co/stabilityai/japanese-stable-vlm) | - | 40.50 |
| [Heron BLIP Japanese StableLM Base 7B llava-620k](https://huggingface.co/turing-motors/heron-chat-blip-ja-stablelm-base-7b-v1-llava-620k)\* | 8.73 | 27.37 |
| [(Ours) EvoVLM-v1-JP-7B](https://huggingface.co/SakanaAI/EvoVLM-v1-JP-7B) | **19.70** | **51.25** |
| [(Ours) EvoVLM-JP-v1-7B](https://huggingface.co/SakanaAI/EvoVLM-JP-v1-7B) | **19.70** | **51.25** |

* \* We are checking with the authors to see if this current results are valid.

Expand Down
2 changes: 1 addition & 1 deletion configs/llm/evollm-v1-jp-10b.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
model:
target: evofactory.CausalLMWithvLLM
params:
model_path: SakanaAI/EvoLLM-v1-JP-10B
model_path: SakanaAI/EvoLLM-JP-v1-10B
model_kwargs:
trust_remote_code: true
enforce_eager: true
Expand Down
2 changes: 1 addition & 1 deletion configs/llm/evollm-v1-jp-7b-a.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
model:
target: evofactory.CausalLMWithvLLM
params:
model_path: SakanaAI/EvoLLM-v1-JP-7B-A
model_path: SakanaAI/EvoLLM-JP-A-v1-7B
model_kwargs:
dtype: bfloat16
template: ja-alpaca-cot
Expand Down
2 changes: 1 addition & 1 deletion configs/llm/evollm-v1-jp-7b.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
model:
target: evofactory.CausalLMWithvLLM
params:
model_path: SakanaAI/EvoLLM-v1-JP-7B
model_path: SakanaAI/EvoLLM-JP-v1-7B
model_kwargs:
dtype: bfloat16
template: ja-alpaca-cot
Expand Down
2 changes: 1 addition & 1 deletion configs/vlm/evovlm-v1-jp-7b.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
model:
target: evofactory.LLaVA
params:
model_path: SakanaAI/EvoVLM-v1-JP-7B
model_path: SakanaAI/EvoVLM-JP-v1-7B
template: ja-shisa-vqa
model_kwargs:
torch_dtype: torch.float16
Expand Down

0 comments on commit 7e49bde

Please sign in to comment.