-
Notifications
You must be signed in to change notification settings - Fork 79
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Guilherme/proto 3082 fix actor score ema initialization #714
Guilherme/proto 3082 fix actor score ema initialization #714
Conversation
The latest Buf updates on your PR. Results from workflow Buf Linter / buf (pull_request).
|
dd8c641
to
707af31
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Well done! The init/export genesis func are missing the new stores, I've implemented it in #712 if you want
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me :)
Many of the conversations @spooktheducks incited will be resolved in #718 . Resolving for now, but not forgotten. |
Purpose of Changes and their Description
This PR introduces a new score initialization mechanism for new participants using the formula:
initialEmaScore = lowestEmaScoreInActiveSet - lambda * standardDeviationOfEmaScoresInActiveSet
This provides a reasonable starting point that requires consistent good performance to enter the active set.
The lambda parameter (lambda > 0) allows governance to adjust how challenging it is for new participants to enter the active set:
We update the topic's initial EMA score for each actor (inferer, forecaster, and reputer) during reward distribution.
When an actor submits their payload, we check if they are a new actor. If they are, we initialize their score using the topic's initial EMA score, calculated using the active set's statistics.
Link(s) to Ticket(s) or Issue(s) resolved by this PR
https://linear.app/alloralabs/issue/PROTO-3082/fix-actor-score-ema-initialization
Are these changes tested and documented?
Unreleased
section ofCHANGELOG.md
?Still Left Todo
Fill this out if this is a Draft PR so others can help.