Skip to content

Latest commit

 

History

History

evaluation

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 

RegMix Evaluation

Using lm-eval-harness

First you should install the lm-eval package from the github repository, run:

git clone https://github.com/EleutherAI/lm-evaluation-harness
cd lm-evaluation-harness
pip install -e .

Then you can use the eval_lm_eval_harness.sh to evaluate your model. Please remember to modify model_args in the script.