Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set the reference nps for sf_16.1 wrt sf_11 #1900

Conversation

ppigazzini
Copy link
Collaborator

@ppigazzini ppigazzini commented Feb 24, 2024

Fishtest with Stockfish 11 (#635) had 1.6 Mnps as reference core nps
and 0.7 Mnps as threshold nps to stop a slow worker.
Set the new reference core nps to 691680 nps according to the 56.77% slowdown
of sf_16.1 wrt sf_11 on the ARCH=x86-64-bmi2 of the Ryzen 7 PRO 7840U.
Set the new threshold for slow worker to 208082 nps according to the 70.27%
slowdown of sf_16.1 wrt sf_11 on the ARCH=x86-64-sse41-popcnt of the
Core i7 3770K.

Stockfish compiled with clang++ 18.1.0
Parallel speedup with bench at depth 13

  • ARCH=x86-64-bmi2 (AMD Ryzen 7 PRO 7840U)
sf_base =  3451831 +/-   6037 (95%)
sf_test =  1492232 +/-   3012 (95%)
diff    = -1959598 +/-   4685 (95%)
speedup = -56.770% +/- 0.136% (95%)
  • ARCH=x86-84-bmi2 (Intel Xeon E5-2680 v3)
sf_base =  1918881 +/-   1002 (95%)
sf_test =   649033 +/-    675 (95%)
diff    = -1269847 +/-   1154 (95%)
speedup = -66.176% +/- 0.060% (95%)
  • ARCH=x86-64-sse41-popcnt (Intel Core i7 3770K)
sf_base =  2099079 +/-   9345 (95%)
sf_test =   623973 +/-   2121 (95%)
diff    = -1475105 +/-   7601 (95%)
speedup = -70.274% +/- 0.362% (95%)

Raise worker version to 230 (also server side)

@ppigazzini ppigazzini added worker update code changes requiring a worker update update code change to account external change (Stockfish, book etc.) labels Feb 24, 2024
@ppigazzini ppigazzini force-pushed the set_reference_threshold_nps_v16.1 branch from cdbb479 to 87ab74e Compare February 26, 2024 16:46
@ppigazzini ppigazzini changed the title Set the reference nps for sf_16.1 Set the reference nps for sf_16.1 wrt sf_11 Feb 26, 2024
@ppigazzini
Copy link
Collaborator Author

Data as reference to show:

  • difference in speedup between bench at 13 depth (average on 100 iterations) and bench at 20 depth (average on 10 iterations)
  • the correction factor can be safely computed composing the speedup for consecutive corrections.

Tables

  • AMD Ryzen 7 PRO 7840U - bmi2
depth;iter vs speedup % composed direct
20;10 11 vs 16 -21.041 0.78959
16 vs 16.1 -39.773 0.60227
11 vs 16.1 -53.131 0.475546369 0.46869
13;100 11 vs 16 -28.324 0.71676
16 vs 16.1 -39.239 0.60761
11 vs 16.1 -56.77 0.435510544 0.4323
  • Intel Xeon E5-2680 v3 - bmi2
depth;iter vs speedup % composed direct
20;10 11 vs 16 -27.657 0.72343
16 vs 16.1 -49.305 0.50695
11 vs 16.1 -62.164 0.366742839 0.37836
13;100 11 vs 16 -35.427 0.64573
16 vs 16.1 -47.327 0.52673
11 vs 16.1 -66.176 0.340125363 0.33824
  • Intel Core i7 3770K - sse41-popcnt
depth;iter vs speedup % composed direct
20;10 11 vs 16 -34.159 0.65841
16 vs 16.1 -51.062 0.48938
11 vs 16.1 -67.457 0.322212686 0.32543
13;100 11 vs 16 -40.87 0.5913
16 vs 16.1 -50.08 0.4992
11 vs 16.1 -70.274 0.29517696 0.29726

Fishtest with Stockfish 11 (official-stockfish#635) had 1.6 Mnps as reference core nps
and 0.7 Mnps as threshold nps to stop a slow worker.
Set the new reference core nps to 691680 nps according to the 56.77% slowdown
of sf_16.1 wrt sf_11 on the ARCH=x86-64-bmi2 of the Ryzen 7 PRO 7840U.
Set the new threshold for slow worker to 208082 nps according to the 70.27%
slowdown of sf_16.1 wrt sf_11 on the ARCH=x86-64-sse41-popcnt of the
Core i7 3770K.

Stockfish compiled with clang++ 18.1.0
Parallel speedup with bench at depth 13

- ARCH=x86-64-bmi2 (AMD Ryzen 7 PRO 7840U)
```
sf_base =  3451831 +/-   6037 (95%)
sf_test =  1492232 +/-   3012 (95%)
diff    = -1959598 +/-   4685 (95%)
speedup = -56.770% +/- 0.136% (95%)
```
- ARCH=x86-84-bmi2 (Intel Xeon E5-2680 v3)
```
sf_base =  1918881 +/-   1002 (95%)
sf_test =   649033 +/-    675 (95%)
diff    = -1269847 +/-   1154 (95%)
speedup = -66.176% +/- 0.060% (95%)
```
- ARCH=x86-64-sse41-popcnt (Intel Core i7 3770K)
```
sf_base =  2099079 +/-   9345 (95%)
sf_test =   623973 +/-   2121 (95%)
diff    = -1475105 +/-   7601 (95%)
speedup = -70.274% +/- 0.362% (95%)
```

Raise worker version to 230 (also server side)
@ppigazzini ppigazzini force-pushed the set_reference_threshold_nps_v16.1 branch from 87ab74e to b274f2e Compare February 26, 2024 22:10
@ppigazzini ppigazzini merged commit 9af4606 into official-stockfish:master Feb 26, 2024
19 checks passed
@ppigazzini ppigazzini deleted the set_reference_threshold_nps_v16.1 branch February 26, 2024 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
update code change to account external change (Stockfish, book etc.) worker update code changes requiring a worker update
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant