Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About Scenario 2 #34

Open
4fee8fea opened this issue Dec 27, 2021 · 1 comment
Open

About Scenario 2 #34

4fee8fea opened this issue Dec 27, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@4fee8fea
Copy link

Thanks for the exciting program!

I am suffering from finding the optimal GNN model on the node classification task. This problem is caused by too much freedom of choice within and between layers. In other words, there are too many models to choose from and too many hyperparameters to optimize.

Referring to ogb's leaderboard to find the optimal model is a potential solution, but as the paper showed,

the best GNN designs for different tasks differ drastically.

From my understanding, GraphGym has provided the idea that similar tasks can share the optimal model design.

As mentioned,

GraphGym provides a simple interface to try out thousands of GNNs in parallel and understand the best designs for your specific task.
GraphGym also recommends a "go-to" GNN design space, after investigating 10 million GNN model-task combinations.

I would like to know if there are off-the-shelf model-task combinations that I can use directly, without using the interface to try out GNN designs.

@JiaxuanYou JiaxuanYou added the enhancement New feature or request label Jan 16, 2022
@JiaxuanYou
Copy link
Collaborator

Thanks for the question. This is a good feature request.
Currently, I recommend trying out the design space of 96 GNN models, shown here:
https://github.com/snap-stanford/GraphGym/blob/master/run/grids/example.txt

You could take a look at the jupyter notebook here, regarding how to compute task similarity:
https://github.com/snap-stanford/GraphGym/blob/master/analysis/design_space.ipynb

We are also actively working on enriching the functionalities of GraphGym.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants