Skip to content

Commit

Permalink
Merge pull request #20 from gunrock/develop
Browse files Browse the repository at this point in the history
Added gunrock-version comparisons gunrock/io#60
  • Loading branch information
jowens authored May 28, 2020
2 parents 11cfe9d + 00bc17b commit 5e2d7e2
Show file tree
Hide file tree
Showing 32 changed files with 271 additions and 24 deletions.
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Betweenness Centrality: Average Process Time (Best)

[BC Average Process Time](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_bc_avg_process_time_best_table.html ':include :type=markdown')
3 changes: 3 additions & 0 deletions docs/analysis/gunrock_primitives_bc_mteps_best_table.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Betweenness Centrality: MTEPS (Best)

[BC MTEPS](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_bc_mteps_best_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Forward-Only Breadth First Search: Average Process Time (Best)

[Forward-Only BFS Average Process Time](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_bfs_avg_process_time_best_table.html ':include :type=markdown')
3 changes: 3 additions & 0 deletions docs/analysis/gunrock_primitives_bfs_mteps_best_table.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Forward-Only Breadth First Search: MTEPS (Best)

[Forward-Only BFS MTEPS](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_bfs_mteps_best_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Breadth First Search: Average Process Time (Best)

[BFS Average Process Time](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_dobfs_avg_process_time_best_table.html ':include :type=markdown')
3 changes: 3 additions & 0 deletions docs/analysis/gunrock_primitives_dobfs_mteps_best_table.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Breadth First Search: MTEPS (Best)

[BFS MTEPS](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_dobfs_mteps_best_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# PageRank: Average Process Time (Best)

[PR Average Process Time](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_bc_avg_process_time_best_table.html ':include :type=markdown')
3 changes: 3 additions & 0 deletions docs/analysis/gunrock_primitives_pr_mteps_best_table.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# PageRank: MTEPS (Best)

[PR MTEPS](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_bc_mteps_best_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Single-Source Shortest Path: Average Process Time (Best)

[SSSP Average Process Time](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_sssp_avg_process_time_best_table.html ':include :type=markdown')
3 changes: 3 additions & 0 deletions docs/analysis/gunrock_primitives_sssp_mteps_best_table.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Single-Source Shortest Path: MTEPS (Best)

[SSSP MTEPS](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_primitives_sssp_mteps_best_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Betweenness Centrality / Tesla K40/80 / combined options

[BC K40/80 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_K40_80_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Betweenness Centrality / Tesla K40/80 / separated options

[BC K40/80 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_K40_80_undirected_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Betweenness Centrality / Tesla V100 / combined options

[BC V100 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_V100_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Betweenness Centrality / Tesla V100 / separated options

[BC V100 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_V100_undirected_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Breadth-First Search / Tesla K40/80 / combined options

[BFS K40/80 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_K40_80_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Breadth-First Search / Tesla K40/80 / separated options

[BFS K40/80 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_K40_80_undirected_idempotence_markpred_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Breadth-First Search / Tesla V100 / combined options

[BFS V100 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_V100_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Breadth-First Search / Tesla V100 / separated options

[BFS V100 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_V100_undirected_idempotence_markpred_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on PageRank / Tesla K40/80 / combined options

[PR K40/80 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_K40_80_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on PageRank / Tesla K40/80 / separated options

[PR K40/80 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_K40_80_undirected_pull_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on PageRank / Tesla V100 / combined options

[PR V100 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_V100_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on PageRank / Tesla V100 / separated options

[PR V100 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_V100_undirected_pull_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Single-Source Shortest Path / Tesla K40/80 / combined options

[SSSP K40/80 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_sssp_Tesla_K40_80_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Single-Source Shortest Path / Tesla K40/80 / separated options

[SSSP K40/80 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_sssp_Tesla_K40_80_undirected_markpred_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Single-Source Shortest Path / Tesla V100 / combined options

[SSSP V100 combined options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_sssp_Tesla_V100_all_table.html ':include :type=markdown')
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Comparing Gunrock Versions on Single-Source Shortest Path / Tesla V100 / separated options

[SSSP V100 separated options](https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_sssp_Tesla_V100_undirected_markpred_table.html ':include :type=markdown')
40 changes: 40 additions & 0 deletions docs/analysis/gunrock_version_comparison_bc.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
# Comparing Gunrock Versions on Betweenness Centrality

These results are primarily for internal use. We normalize the performance of every Gunrock version against Gunrock 1.0+ so that we can identify performance regressions. These results are shown in two ways: first, fastest Gunrock run on this primitive/dataset combination; second, with options separated out into different rows. We present these comparisons on two different GPUs (Tesla K40/K80 and Tesla V100).

Tables of data for the below results, including links to JSON summaries with command lines for each experiment: [
[BC fastest results, combining all options, Tesla V100](analysis/gunrock_version_compare_bc_Tesla_V100_all_table.md) |
[BC fastest results, separating all options, Tesla_V100](analysis/gunrock_version_compare_bc_Tesla_V100_undirected_table.md) |
[BC fastest results, combining all options, Tesla K40/80](analysis/gunrock_version_compare_bc_Tesla_K40_80_all_table.md) |
[BC fastest results, separating all options, Tesla K40/80](analysis/gunrock_version_compare_bc_Tesla_K40_80_undirected_table.md)
]

Note these plots (rendered with [Altair](https://altair-viz.github.io/)) are interactive (you can click, drag, and zoom; select items in the legend; and mousing over a data point shows the data associated with that point).

<script type="text/javascript">
var spec_gunrock_version_compare_bc_Tesla_V100_all = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_V100_all.json";
vegaEmbed('#vis_gunrock_version_compare_bc_Tesla_V100_all', spec_gunrock_version_compare_bc_Tesla_V100_all).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_bc_Tesla_V100_undirected = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_V100_undirected.json";
vegaEmbed('#vis_gunrock_version_compare_bc_Tesla_V100_undirected', spec_gunrock_version_compare_bc_Tesla_V100_undirected).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_bc_Tesla_K40_80_all = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_K40_80_all.json";
vegaEmbed('#vis_gunrock_version_compare_bc_Tesla_K40_80_all', spec_gunrock_version_compare_bc_Tesla_K40_80_all).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_bc_Tesla_K40_80_undirected = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bc_Tesla_K40_80_undirected.json";
vegaEmbed('#vis_gunrock_version_compare_bc_Tesla_K40_80_undirected', spec_gunrock_version_compare_bc_Tesla_K40_80_undirected).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

</script>

<div id="vis_gunrock_version_compare_bc_Tesla_V100_all"></div>
<div id="vis_gunrock_version_compare_bc_Tesla_V100_undirected"></div>
<div id="vis_gunrock_version_compare_bc_Tesla_K40_80_all"></div>
<div id="vis_gunrock_version_compare_bc_Tesla_K40_80_undirected"></div>
40 changes: 40 additions & 0 deletions docs/analysis/gunrock_version_comparison_bfs.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
# Comparing Gunrock Versions on Breadth-First Search

These results are primarily for internal use. We normalize the performance of every Gunrock version against Gunrock 1.0+ so that we can identify performance regressions. These results are shown in two ways: first, fastest Gunrock run on this primitive/dataset combination; second, with options separated out into different rows. We present these comparisons on two different GPUs (Tesla K40/K80 and Tesla V100).

Tables of data for the below results, including links to JSON summaries with command lines for each experiment: [
[BFS fastest results, combining all options, Tesla V100](analysis/gunrock_version_compare_bfs_Tesla_V100_all_table.md) |
[BFS fastest results, separating all options, Tesla_V100](analysis/gunrock_version_compare_bfs_Tesla_V100_undirected_idempotence_markpred_table.md) |
[BFS fastest results, combining all options, Tesla K40/80](analysis/gunrock_version_compare_bfs_Tesla_K40_80_all_table.md) |
[BFS fastest results, separating all options, Tesla K40/80](analysis/gunrock_version_compare_bfs_Tesla_K40_80_undirected_idempotence_markpred_table.md)
]

Note these plots (rendered with [Altair](https://altair-viz.github.io/)) are interactive (you can click, drag, and zoom; select items in the legend; and mousing over a data point shows the data associated with that point).

<script type="text/javascript">
var spec_gunrock_version_compare_bfs_Tesla_V100_all = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_V100_all.json";
vegaEmbed('#vis_gunrock_version_compare_bfs_Tesla_V100_all', spec_gunrock_version_compare_bfs_Tesla_V100_all).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_bfs_Tesla_V100_undirected_idempotence_markpred = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_V100_undirected_idempotence_markpred.json";
vegaEmbed('#vis_gunrock_version_compare_bfs_Tesla_V100_undirected_idempotence_markpred', spec_gunrock_version_compare_bfs_Tesla_V100_undirected_idempotence_markpred).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_bfs_Tesla_K40_80_all = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_K40_80_all.json";
vegaEmbed('#vis_gunrock_version_compare_bfs_Tesla_K40_80_all', spec_gunrock_version_compare_bfs_Tesla_K40_80_all).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_bfs_Tesla_K40_80_undirected_idempotence_markpred = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_bfs_Tesla_K40_80_undirected_idempotence_markpred.json";
vegaEmbed('#vis_gunrock_version_compare_bfs_Tesla_K40_80_undirected_idempotence_markpred', spec_gunrock_version_compare_bfs_Tesla_K40_80_undirected_idempotence_markpred).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

</script>

<div id="vis_gunrock_version_compare_bfs_Tesla_V100_all"></div>
<div id="vis_gunrock_version_compare_bfs_Tesla_V100_undirected_idempotence_markpred"></div>
<div id="vis_gunrock_version_compare_bfs_Tesla_K40_80_all"></div>
<div id="vis_gunrock_version_compare_bfs_Tesla_K40_80_undirected_idempotence_markpred"></div>
40 changes: 40 additions & 0 deletions docs/analysis/gunrock_version_comparison_pr.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
# Comparing Gunrock Versions on PageRank

These results are primarily for internal use. We normalize the performance of every Gunrock version against Gunrock 1.0+ so that we can identify performance regressions. These results are shown in two ways: first, fastest Gunrock run on this primitive/dataset combination; second, with options separated out into different rows. We present these comparisons on two different GPUs (Tesla K40/K80 and Tesla V100).

Tables of data for the below results, including links to JSON summaries with command lines for each experiment: [
[PR fastest results, combining all options, Tesla V100](analysis/gunrock_version_compare_pr_Tesla_V100_all_table.md) |
[PR fastest results, separating all options, Tesla_V100](analysis/gunrock_version_compare_pr_Tesla_V100_undirected_pull_table.md) |
[PR fastest results, combining all options, Tesla K40/80](analysis/gunrock_version_compare_pr_Tesla_K40_80_all_table.md) |
[PR fastest results, separating all options, Tesla K40/80](analysis/gunrock_version_compare_pr_Tesla_K40_80_undirected_pull_table.md)
]

Note these plots (rendered with [Altair](https://altair-viz.github.io/)) are interactive (you can click, drag, and zoom; select items in the legend; and mousing over a data point shows the data associated with that point).

<script type="text/javascript">
var spec_gunrock_version_compare_pr_Tesla_V100_all = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_V100_all.json";
vegaEmbed('#vis_gunrock_version_compare_pr_Tesla_V100_all', spec_gunrock_version_compare_pr_Tesla_V100_all).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_pr_Tesla_V100_undirected_pull = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_V100_undirected_pull.json";
vegaEmbed('#vis_gunrock_version_compare_pr_Tesla_V100_undirected_pull', spec_gunrock_version_compare_pr_Tesla_V100_undirected_pull).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_pr_Tesla_K40_80_all = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_K40_80_all.json";
vegaEmbed('#vis_gunrock_version_compare_pr_Tesla_K40_80_all', spec_gunrock_version_compare_pr_Tesla_K40_80_all).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

var spec_gunrock_version_compare_pr_Tesla_K40_80_undirected_pull = "https://raw.githubusercontent.com/gunrock/io/master/plots/gunrock_version_compare_pr_Tesla_K40_80_undirected_pull.json";
vegaEmbed('#vis_gunrock_version_compare_pr_Tesla_K40_80_undirected_pull', spec_gunrock_version_compare_pr_Tesla_K40_80_undirected_pull).then(function(result) {
// Access the Vega view instance (https://vega.github.io/vega/docs/api/view/) as result.view
}).catch(console.error);

</script>

<div id="vis_gunrock_version_compare_pr_Tesla_V100_all"></div>
<div id="vis_gunrock_version_compare_pr_Tesla_V100_undirected_pull"></div>
<div id="vis_gunrock_version_compare_pr_Tesla_K40_80_all"></div>
<div id="vis_gunrock_version_compare_pr_Tesla_K40_80_undirected_pull"></div>
Loading

0 comments on commit 5e2d7e2

Please sign in to comment.