-
Notifications
You must be signed in to change notification settings - Fork 33
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refactor config structure #60
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me, and I just wish we could figure this out earlier.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One small nit on the default value in the comment.
Rename `EighConfig` and add `EigenDecompositionConfig`
@tsunghsienlee has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
@tsunghsienlee merged this pull request in b5dd2f2. |
This refactor clearly separates the configs for matrix functions and the preconditioner computation in
DistributedShampoo
.Please especially focus on
matrix_functions_types.py
,shampoo_types.py
, and the change to the signature ofDistributedShampoo
indistributed_shampoo.py
.