Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resolve run_opts before passing it to the workspace #755

Merged
merged 1 commit into from
Aug 16, 2023

Conversation

manav-a
Copy link
Contributor

@manav-a manav-a commented Aug 16, 2023

Summary:
We were resolving the default values for runopts during the dryrun call on the scheduler. This made the ops passed to the workspace not have the defaults correctly populated for workspace opts. This change also resolves the runopts in the runner dryrun and scheduler submit apis.

Haven't removed the runopts resolution in scheduler dry run here as a lot of other tests broke with it and it seems reasonable to also have runopts resolved for just the scheduler dryrun. The double resolving of runopts for the runner dryrun and scheduler submit cases shouldnt cause any meaningful differences.

There is a separate question on whether workspace should also be built during scheduler dryrun but that can be a follow up change.

Differential Revision: D48395915

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 16, 2023
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48395915

@codecov
Copy link

codecov bot commented Aug 16, 2023

Codecov Report

Merging #755 (3b59d99) into main (744706b) will increase coverage by 0.00%.
The diff coverage is 100.00%.

@@           Coverage Diff           @@
##             main     #755   +/-   ##
=======================================
  Coverage   92.80%   92.80%           
=======================================
  Files          96       96           
  Lines        6071     6073    +2     
=======================================
+ Hits         5634     5636    +2     
  Misses        437      437           
Flag Coverage Δ
unittests 92.80% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
torchx/runner/api.py 96.35% <100.00%> (+0.01%) ⬆️
torchx/schedulers/api.py 94.39% <100.00%> (+0.05%) ⬆️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48395915

manav-a added a commit to manav-a/torchx that referenced this pull request Aug 16, 2023
Summary:
Pull Request resolved: pytorch#755

We were resolving the default values for runopts during the dryrun call on the scheduler. This made the ops passed to the workspace not have the defaults correctly populated for workspace opts. This change also resolves the runopts in the runner dryrun and scheduler submit apis.

Haven't removed the runopts resolution in scheduler dry run here as a lot of other tests broke with it and it seems reasonable to also have runopts resolved for just the scheduler dryrun. The double resolving of runopts for the runner dryrun and scheduler submit cases shouldnt cause any meaningful differences.

There is a separate question on whether workspace should also be built during scheduler dryrun but that can be a follow up change.

Differential Revision: D48395915

fbshipit-source-id: 7a6cef7667998c6d83886a697138ccb024c453d5
Summary:
Pull Request resolved: pytorch#755

We were resolving the default values for runopts during the dryrun call on the scheduler. This made the ops passed to the workspace not have the defaults correctly populated for workspace opts. This change also resolves the runopts in the runner dryrun and scheduler submit apis.

Haven't removed the runopts resolution in scheduler dry run here as a lot of other tests broke with it and it seems reasonable to also have runopts resolved for just the scheduler dryrun. The double resolving of runopts for the runner dryrun and scheduler submit cases shouldnt cause any meaningful differences.

There is a separate question on whether workspace should also be built during scheduler dryrun but that can be a follow up change.

Differential Revision: D48395915

fbshipit-source-id: c076e933fe3b8c64ff1d9a6b68c37815f73ab060
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D48395915

Copy link
Contributor

@kurman kurman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Re-running failing tests

Copy link
Contributor

@kurman kurman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Config resolution can be eager, we probably should move to that direction.

@kurman
Copy link
Contributor

kurman commented Aug 16, 2023

Created issues #757 and #758, those have been broken.

@manav-a manav-a merged commit 413db85 into pytorch:main Aug 16, 2023
21 of 23 checks passed
@manav-a manav-a deleted the export-D48395915 branch August 16, 2023 17:58
miqueljubert pushed a commit to miqueljubert/torchx that referenced this pull request Aug 17, 2023
…h#755) (pytorch#755)"

Summary:
Original commit changeset: b3e964613444

Original Phabricator Diff: D48395915

Differential Revision: D48430887

fbshipit-source-id: 3fdbe84652f8ad07083b16724eadbc2aa7e828f0
KPostOffice pushed a commit to KPostOffice/torchx that referenced this pull request Sep 7, 2023
…torch#755)

Summary:
Pull Request resolved: pytorch#755

We were resolving the default values for runopts during the dryrun call on the scheduler. This made the ops passed to the workspace not have the defaults correctly populated for workspace opts. This change also resolves the runopts in the runner dryrun and scheduler submit apis.

Haven't removed the runopts resolution in scheduler dry run here as a lot of other tests broke with it and it seems reasonable to also have runopts resolved for just the scheduler dryrun. The double resolving of runopts for the runner dryrun and scheduler submit cases shouldnt cause any meaningful differences.

There is a separate question on whether workspace should also be built during scheduler dryrun but that can be a follow up change.

Differential Revision: D48395915

fbshipit-source-id: c076e933fe3b8c64ff1d9a6b68c37815f73ab060
MichaelClifford pushed a commit to project-codeflare/torchx that referenced this pull request Sep 8, 2023
…torch#755)

Summary:
Pull Request resolved: pytorch#755

We were resolving the default values for runopts during the dryrun call on the scheduler. This made the ops passed to the workspace not have the defaults correctly populated for workspace opts. This change also resolves the runopts in the runner dryrun and scheduler submit apis.

Haven't removed the runopts resolution in scheduler dry run here as a lot of other tests broke with it and it seems reasonable to also have runopts resolved for just the scheduler dryrun. The double resolving of runopts for the runner dryrun and scheduler submit cases shouldnt cause any meaningful differences.

There is a separate question on whether workspace should also be built during scheduler dryrun but that can be a follow up change.

Differential Revision: D48395915

fbshipit-source-id: c076e933fe3b8c64ff1d9a6b68c37815f73ab060
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants