Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DistGB] save as graphbolt graph directly after partition #7690

Open
wants to merge 36 commits into
base: master
Choose a base branch
from

Conversation

CfromBU
Copy link
Collaborator

@CfromBU CfromBU commented Aug 13, 2024

Simplify the graphbolt graph generation process, now we no longer need to save the DGLGraph to generate the FusedCSCSamplingGraph in partition process

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 13, 2024

To trigger regression tests:

  • @dgl-bot run [instance-type] [which tests] [compare-with-branch];
    For example: @dgl-bot run g4dn.4xlarge all dmlc/master or @dgl-bot run c5.9xlarge kernel,api dmlc/master

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 13, 2024

Commit ID: 589f45c6eb7a5dde89105b710f39d8d268696c71

Build ID: 1

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 13, 2024

Commit ID: 4fc54fd804644fa0e2053708307d1a51f5bb0fc8

Build ID: 2

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 13, 2024

Commit ID: f051c87ea4703e2f8c2e825ddeb13db9af9626f2

Build ID: 3

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 13, 2024

Commit ID: 087c99e2480a8977b54cf91bf13de47297e3079e

Build ID: 4

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 13, 2024

Commit ID: 63c4de9fccdc7800ef4c3129bf4f41eaa24e1dd0

Build ID: 5

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 13, 2024

Commit ID: 54525fa4104fc5cdc67df0819628c0d99d0caa8f

Build ID: 6

Status: ❌ CI test failed in Stage [Torch CPU Unit test].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 14, 2024

Commit ID: 9d4f778be278681d7704d5913894c7a580768627

Build ID: 7

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 14, 2024

Commit ID: 2979ffdc1c1a9276dbe01221d36c05dd7b6da386

Build ID: 8

Status: ❌ CI test failed in Stage [Distributed Torch CPU Unit test].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 14, 2024

Commit ID: fc462f639c0fa0ea0f187229db3bed374c14d47d

Build ID: 9

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@Rhett-Ying Rhett-Ying self-requested a review August 14, 2024 06:31
@Rhett-Ying Rhett-Ying changed the title [DistGB]Fix #7151 simplify the graphbolt graph generation process [DistGB] save as graphbolt graph directly after partition Aug 14, 2024
@Rhett-Ying Rhett-Ying removed their request for review August 14, 2024 06:36
@Rhett-Ying
Copy link
Collaborator

if this pR is ready for review. please add me into the reviewer.

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 14, 2024

Commit ID: c5e8e10339645ccca53bb95a4ca477c5abca6682

Build ID: 10

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 14, 2024

Commit ID: 5d66e2e

Build ID: 11

Status: ❌ CI test failed in Stage [Distributed Torch CPU Unit test].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 19, 2024

Commit ID: 2f23bd8a017acb26fb14f62cbc661dc1deb4ec4e

Build ID: 17

Status: ❌ CI test failed in Stage [Distributed Torch CPU Unit test].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 20, 2024

Commit ID: 8170ab610da82ecd04cd4fd2571a0f4a879e4c67

Build ID: 18

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 20, 2024

Commit ID: b7b6fdaa24a6585aad377c331639440f6978e46c

Build ID: 19

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

examples/distributed/graphsage/ip_config.txt Outdated Show resolved Hide resolved
python/dgl/distributed/partition.py Outdated Show resolved Hide resolved
python/dgl/distributed/partition.py Outdated Show resolved Hide resolved
python/dgl/distributed/partition.py Outdated Show resolved Hide resolved
python/dgl/distributed/partition.py Outdated Show resolved Hide resolved
python/dgl/distributed/partition.py Outdated Show resolved Hide resolved
python/dgl/distributed/partition.py Show resolved Hide resolved
tests/scripts/task_distributed_test.sh Outdated Show resolved Hide resolved
tests/tools/test_dist_part.py Outdated Show resolved Hide resolved
python/dgl/distributed/partition.py Outdated Show resolved Hide resolved
@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 21, 2024

Commit ID: b65b9438037cef817eedaff2e6aaac7fac71219d

Build ID: 20

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 21, 2024

Commit ID: 6a888c2b959608dd12a3606598790b45408ba695

Build ID: 21

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 21, 2024

Commit ID: 37922c4eb01cd9f1c7197b8e9c15bc36837e51c7

Build ID: 22

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 21, 2024

Commit ID: 3dac145c7e61f53b333c453b44af7d5e21cf27fa

Build ID: 23

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

@CfromBU
Copy link
Collaborator Author

CfromBU commented Aug 21, 2024

order:
#7724 partition test case
#7727 partition
#7728 dist partition
#7690 dist partition test case

@dgl-bot
Copy link
Collaborator

dgl-bot commented Aug 21, 2024

Commit ID: 3ed4756098cc3c2a068732621257d3880c586c21

Build ID: 24

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Sep 8, 2024

Commit ID: 59038c0a6e9f54cd983157da49ca84d797e02ae8

Build ID: 25

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Sep 8, 2024

Commit ID: dac0c4290329e1f779d0af9ab2fc5db370afeba3

Build ID: 26

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Sep 8, 2024

Commit ID: 4076dda260d64435f68dd3786c27d4cc01c74cbc

Build ID: 27

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

@dgl-bot
Copy link
Collaborator

dgl-bot commented Sep 8, 2024

Commit ID: 57e24271e4a12bc6dbc194be2cd1d103fd098383

Build ID: 28

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants