Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor config structure #60

Closed
wants to merge 15 commits into from
Closed

Refactor config structure #60

wants to merge 15 commits into from

Conversation

runame
Copy link
Collaborator

@runame runame commented Dec 6, 2024

This refactor clearly separates the configs for matrix functions and the preconditioner computation in DistributedShampoo.

Please especially focus on matrix_functions_types.py, shampoo_types.py, and the change to the signature of DistributedShampoo in distributed_shampoo.py.

@runame runame added the enhancement New feature or request label Dec 6, 2024
@runame runame self-assigned this Dec 6, 2024
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 6, 2024
Copy link
Contributor

@tsunghsienlee tsunghsienlee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, and I just wish we could figure this out earlier.

Copy link
Contributor

@tsunghsienlee tsunghsienlee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One small nit on the default value in the comment.

distributed_shampoo/distributed_shampoo.py Outdated Show resolved Hide resolved
matrix_functions_types.py Outdated Show resolved Hide resolved
@runame runame requested a review from tsunghsienlee December 17, 2024 11:13
@facebook-github-bot
Copy link
Contributor

@tsunghsienlee has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@tsunghsienlee merged this pull request in b5dd2f2.

@runame runame deleted the configs-refactor branch December 18, 2024 18:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. enhancement New feature or request Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants