mbpp pass@1 is lower than mbppplus pass@1 on starcoder2?

[Liuzzyg]

I evaluate pretrain model of starcoder2 3b/7b, with the bash script
accelerate launch bigcode-evaluation-harness/main.py --model bigcode/starcoder2-3b --max_length_generation 512 --tasks mbpp --n_samples 200 --batch_size 100 --temperature 0.2 --precision bf16 --allow_code_execution --use_auth_token
and
accelerate launch bigcode-evaluation-harness/main.py --model bigcode/starcoder2-3b --max_length_generation 512 --tasks mbppplus --n_samples 200 --batch_size 100 --temperature 0.2 --precision bf16 --allow_code_execution --use_auth_token, but get
`"mbpp": {
"pass@1": 0.41799000000000003
}

"mbppplus": {
"pass@1": 0.47734126984126984
}`
even I change different configs, its the same.