Skip to content

Commit

Permalink
Updates
Browse files Browse the repository at this point in the history
  • Loading branch information
kamilkisiela committed Aug 2, 2024
1 parent ccfad4b commit f6fa8f3
Show file tree
Hide file tree
Showing 56 changed files with 283 additions and 6,457 deletions.
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,11 +6,11 @@ This repository contains a set of tests and a tool to evaluate and compare the c

| Gateway | Compatibility | Test Cases | Test Suites |
| :---------------------------: | :-----------: | :----------: | :---------: |
| Apollo Router | 100.00% | 🟢 161 | 🟢 38 |
| GraphQL Mesh | 100.00% | 🟢 161 | 🟢 38 |
| Apollo Router (Rust-based QP) | 95.65% | 🟢 1547 | 🟢 353 |
| Cosmo Router | 65.84% | 🟢 10655 | 🟢 1919 |
| Grafbase Gateway | 46.58% | 🟢 75 ❌ 86 | 🟢 12 ❌ 26 |
| Apollo Router | 100.00% | 🟢 162 | 🟢 39 |
| GraphQL Mesh | 100.00% | 🟢 162 | 🟢 39 |
| Apollo Router (Rust-based QP) | 96.30% | 🟢 1566 | 🟢 372 |
| Cosmo Router | 63.58% | 🟢 10359 | 🟢 1821 |
| Grafbase Gateway | 46.91% | 🟢 76 ❌ 86 | 🟢 13 ❌ 26 |

<!-- gateways:end -->

Expand Down
26 changes: 18 additions & 8 deletions REPORT.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,11 +4,11 @@

| Gateway | Compatibility | Test Cases | Test Suites |
| :---------------------------: | :-----------: | :----------: | :---------: |
| Apollo Router | 100.00% | 🟢 161 | 🟢 38 |
| GraphQL Mesh | 100.00% | 🟢 161 | 🟢 38 |
| Apollo Router (Rust-based QP) | 95.65% | 🟢 1547 | 🟢 353 |
| Cosmo Router | 65.84% | 🟢 10655 | 🟢 1919 |
| Grafbase Gateway | 46.58% | 🟢 75 ❌ 86 | 🟢 12 ❌ 26 |
| Apollo Router | 100.00% | 🟢 162 | 🟢 39 |
| GraphQL Mesh | 100.00% | 🟢 162 | 🟢 39 |
| Apollo Router (Rust-based QP) | 96.30% | 🟢 1566 | 🟢 372 |
| Cosmo Router | 63.58% | 🟢 10359 | 🟢 1821 |
| Grafbase Gateway | 46.91% | 🟢 76 ❌ 86 | 🟢 13 ❌ 26 |

## Detailed Results

Expand Down Expand Up @@ -56,6 +56,8 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<pre>🟢🟢</pre>
<a href="./src/test-suites/nested-provides">nested-provides</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/node">node</a>
<pre>🟢</pre>
<a href="./src/test-suites/non-resolvable-interface-object">non-resolvable-interface-object</a>
<pre>🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
Expand Down Expand Up @@ -140,6 +142,8 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<pre>🟢🟢</pre>
<a href="./src/test-suites/nested-provides">nested-provides</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/node">node</a>
<pre>🟢</pre>
<a href="./src/test-suites/non-resolvable-interface-object">non-resolvable-interface-object</a>
<pre>🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
Expand Down Expand Up @@ -219,11 +223,13 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<a href="./src/test-suites/interface-object-with-requires">interface-object-with-requires</a>
<pre>🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/mutations">mutations</a>
<pre>🟢🟢</pre>
<pre>🟢🟢🟢</pre>
<a href="./src/test-suites/mysterious-external">mysterious-external</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/nested-provides">nested-provides</a>
<pre>🟢🟢</pre>
<a href="./src/test-suites/node">node</a>
<pre>🟢</pre>
<a href="./src/test-suites/non-resolvable-interface-object">non-resolvable-interface-object</a>
<pre>🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
Expand Down Expand Up @@ -308,6 +314,8 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<pre>🟢🟢</pre>
<a href="./src/test-suites/nested-provides">nested-provides</a>
<pre>❌❌</pre>
<a href="./src/test-suites/node">node</a>
<pre>🟢</pre>
<a href="./src/test-suites/non-resolvable-interface-object">non-resolvable-interface-object</a>
<pre>🟢🟢🟢🟢🟢🟢🟢</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
Expand All @@ -319,9 +327,9 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<a href="./src/test-suites/parent-entity-call-complex">parent-entity-call-complex</a>
<pre>❌</pre>
<a href="./src/test-suites/provides-on-interface">provides-on-interface</a>
<pre>🟢🟢</pre>
<pre>❌❌</pre>
<a href="./src/test-suites/provides-on-union">provides-on-union</a>
<pre>🟢🟢</pre>
<pre>❌❌</pre>
<a href="./src/test-suites/requires-interface">requires-interface</a>
<pre>🟢🟢❌🟢🟢</pre>
<a href="./src/test-suites/requires-requires">requires-requires</a>
Expand Down Expand Up @@ -392,6 +400,8 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
<pre>🟢🟢</pre>
<a href="./src/test-suites/nested-provides">nested-provides</a>
<pre>❌❌</pre>
<a href="./src/test-suites/node">node</a>
<pre>🟢</pre>
<a href="./src/test-suites/non-resolvable-interface-object">non-resolvable-interface-object</a>
<pre>❌🟢❌🟢🟢🟢❌</pre>
<a href="./src/test-suites/override-type-interface">override-type-interface</a>
Expand Down
2 changes: 1 addition & 1 deletion gateways/cosmo/install.sh
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ set -u

BINARY_DOWNLOAD_PREFIX="https://github.com/wundergraph/cosmo/releases/download"

DOWNLOAD_VERSION="0.98.2"
DOWNLOAD_VERSION="0.99.3"

download_binary() {
downloader --check
Expand Down
12 changes: 7 additions & 5 deletions gateways/cosmo/results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,8 @@ mysterious-external
..
nested-provides
XX
node
.
non-resolvable-interface-object
.......
override-type-interface
Expand All @@ -43,9 +45,9 @@ X
parent-entity-call-complex
X
provides-on-interface
..
XX
provides-on-union
..
XX
requires-interface
..X..
requires-requires
Expand Down Expand Up @@ -76,6 +78,6 @@ union-intersection
XXXXXXXX

---
Total: 161
Passed: 106
Failed: 55
Total: 162
Passed: 103
Failed: 59
2 changes: 1 addition & 1 deletion gateways/grafbase/install.sh
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ set -euo pipefail
# I took their install script and modified it to download the gateway binary
# to the current directory instead of /usr/local/bin

VERSION="0.6.1"
VERSION="0.7.0"

error() {
echo -e "${Red}error${Color_Off}:" "$@" >&2
Expand Down
6 changes: 4 additions & 2 deletions gateways/grafbase/results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,8 @@ mysterious-external
..
nested-provides
XX
node
.
non-resolvable-interface-object
X.X...X
override-type-interface
Expand Down Expand Up @@ -76,6 +78,6 @@ union-intersection
XXXXXXXX

---
Total: 161
Passed: 75
Total: 162
Passed: 76
Failed: 86
2 changes: 1 addition & 1 deletion gateways/mesh/install.sh
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
# It's just to install dependencies and make it ready for `run.sh` script
npx --yes @graphql-mesh/[email protected].8 mesh-serve --help
npx --yes @graphql-mesh/[email protected].9 mesh-serve --version
6 changes: 4 additions & 2 deletions gateways/mesh/results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,8 @@ mysterious-external
..
nested-provides
..
node
.
non-resolvable-interface-object
.......
override-type-interface
Expand Down Expand Up @@ -76,6 +78,6 @@ union-intersection
........

---
Total: 161
Passed: 161
Total: 162
Passed: 162
Failed: 0
2 changes: 1 addition & 1 deletion gateways/mesh/run.sh
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
npm start supergraph -- --cwd ./gateways/mesh --test $1
npx --yes @graphql-mesh/[email protected].8 mesh-serve --port 4000 --fork 1 --supergraph supergraph.graphql
npx --yes @graphql-mesh/[email protected].9 mesh-serve --port 4000 --fork 1 --supergraph supergraph.graphql
10 changes: 6 additions & 4 deletions gateways/router-new/results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -27,11 +27,13 @@ input-object-intersection
interface-object-with-requires
.......
mutations
..X
...
mysterious-external
..
nested-provides
..
node
.
non-resolvable-interface-object
.......
override-type-interface
Expand Down Expand Up @@ -76,6 +78,6 @@ union-intersection
........

---
Total: 161
Passed: 154
Failed: 7
Total: 162
Passed: 156
Failed: 6
6 changes: 4 additions & 2 deletions gateways/router/results.txt
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,8 @@ mysterious-external
..
nested-provides
..
node
.
non-resolvable-interface-object
.......
override-type-interface
Expand Down Expand Up @@ -76,6 +78,6 @@ union-intersection
........

---
Total: 161
Passed: 161
Total: 162
Passed: 162
Failed: 0
Loading

0 comments on commit f6fa8f3

Please sign in to comment.