Skip to content

Commit

Permalink
refactor(benchmarks) Update evaluation accuracy for general NLP chall…
Browse files Browse the repository at this point in the history
…enge (#4286)
  • Loading branch information
yan-gao-GY authored Oct 6, 2024
1 parent 849ab1d commit 7a7d912
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions benchmarks/flowertune-llm/evaluation/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,9 +17,9 @@ The default template generated by `flwr new` (see the [Project Creation Instruct

### General NLP

| | MT-1 | MT-2 | MT-Avg |
|:--------:|:----:|:----:|:------:|
| MT Score | 5.54 | 5.52 | 5.53 |
| | STEM | SS | Humanities | Avg |
|:-------:|:-----:|:-----:|:----------:|:-----:|
| Acc (%) | 12.37 | 13.49 | 12.60 | 12.82 |

### Finance

Expand Down

0 comments on commit 7a7d912

Please sign in to comment.