Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SPRT Elo #1924

Open
gahtan-syarif opened this issue Apr 4, 2024 · 1 comment
Open

SPRT Elo #1924

gahtan-syarif opened this issue Apr 4, 2024 · 1 comment

Comments

@gahtan-syarif
Copy link

Right now the Elo from SPRT is derived from equation 6.1 of this document: https://hardy.uhasselt.be/Fishtest/brownian_approximation.pdf. so basically the SPRT elo implemented in fishtest right now is caclulated using the results of the GSPRT. i have issues with this as a tester as the resulting elo can behave quite weirdly such as elo being negative when theres more wins than losses. It would be preffered if regular pentanomial elo thats independent of the SPRT bounds are shown to get an accurate representation of the tested engines strength such as those that are displayed in fixed tests. a solution to this is by displaying both elo with the GSPRT approximated elo being labeled as SPRT Elo or Adjusted Elo while the regular elo is labelled as just Elo.
@cj5716
Copy link

cj5716 commented Apr 4, 2024

IMO we can replace the LOS "speedometer" with this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cj5716 @gahtan-syarif