Update to latest and add new test (#90)

the-guild-org · Nov 29, 2024 · 5e0cd99 · 5e0cd99
1 parent 77ed27c
commit 5e0cd99
Show file tree

Hide file tree

Showing 24 changed files with 350 additions and 148 deletions.
diff --git a/README.md b/README.md
@@ -10,12 +10,12 @@ This repository contains a set of tests to evaluate and compare the compatibilit
 
 |                             Gateway                             | Compatibility |  Test Cases  | Test Suites |
 | :-------------------------------------------------------------: | :-----------: | :----------: | :---------: |
-| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) |    100.00%    |    🟢 171    |    🟢 41    |
-|         [Apollo Router](https://www.apollographql.com/)         |    97.66%     | 🟢 167 ❌ 4  | 🟢 39 ❌ 2  |
-|        [Apollo Gateway](https://www.apollographql.com/)         |    97.08%     | 🟢 166 ❌ 5  | 🟢 38 ❌ 3  |
-|            [Grafbase Gateway](https://grafbase.com)             |    76.02%     | 🟢 130 ❌ 41 | 🟢 29 ❌ 12 |
-|             [Cosmo Router](https://wundergraph.com)             |    71.93%     | 🟢 123 ❌ 48 | 🟢 21 ❌ 20 |
-|                [Inigo Gateway](https://inigo.io)                |    46.78%     | 🟢 80 ❌ 91  | 🟢 12 ❌ 29 |
+| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) |    100.00%    |    🟢 179    |    🟢 41    |
+|         [Apollo Router](https://www.apollographql.com/)         |    97.77%     | 🟢 175 ❌ 4  | 🟢 39 ❌ 2  |
+|        [Apollo Gateway](https://www.apollographql.com/)         |    97.21%     | 🟢 174 ❌ 5  | 🟢 38 ❌ 3  |
+|            [Grafbase Gateway](https://grafbase.com)             |    77.09%     | 🟢 138 ❌ 41 | 🟢 29 ❌ 12 |
+|             [Cosmo Router](https://wundergraph.com)             |    73.18%     | 🟢 131 ❌ 48 | 🟢 21 ❌ 20 |
+|                [Inigo Gateway](https://inigo.io)                |    49.16%     | 🟢 88 ❌ 91  | 🟢 12 ❌ 29 |
 
 <!-- gateways:end -->
 

diff --git a/REPORT.md b/REPORT.md
@@ -4,12 +4,12 @@
 
 |                             Gateway                             | Compatibility |  Test Cases  | Test Suites |
 | :-------------------------------------------------------------: | :-----------: | :----------: | :---------: |
-| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) |    100.00%    |    🟢 171    |    🟢 41    |
-|         [Apollo Router](https://www.apollographql.com/)         |    97.66%     | 🟢 167 ❌ 4  | 🟢 39 ❌ 2  |
-|        [Apollo Gateway](https://www.apollographql.com/)         |    97.08%     | 🟢 166 ❌ 5  | 🟢 38 ❌ 3  |
-|            [Grafbase Gateway](https://grafbase.com)             |    76.02%     | 🟢 130 ❌ 41 | 🟢 29 ❌ 12 |
-|             [Cosmo Router](https://wundergraph.com)             |    71.93%     | 🟢 123 ❌ 48 | 🟢 21 ❌ 20 |
-|                [Inigo Gateway](https://inigo.io)                |    46.78%     | 🟢 80 ❌ 91  | 🟢 12 ❌ 29 |
+| [Hive Gateway](https://the-guild.dev/graphql/hive/docs/gateway) |    100.00%    |    🟢 179    |    🟢 41    |
+|         [Apollo Router](https://www.apollographql.com/)         |    97.77%     | 🟢 175 ❌ 4  | 🟢 39 ❌ 2  |
+|        [Apollo Gateway](https://www.apollographql.com/)         |    97.21%     | 🟢 174 ❌ 5  | 🟢 38 ❌ 3  |
+|            [Grafbase Gateway](https://grafbase.com)             |    77.09%     | 🟢 138 ❌ 41 | 🟢 29 ❌ 12 |
+|             [Cosmo Router](https://wundergraph.com)             |    73.18%     | 🟢 131 ❌ 48 | 🟢 21 ❌ 20 |
+|                [Inigo Gateway](https://inigo.io)                |    49.16%     | 🟢 88 ❌ 91  | 🟢 12 ❌ 29 |
 
 ## Detailed Results
 
@@ -39,15 +39,15 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
 <a href="./src/test-suites/enum-intersection">enum-intersection</a>
 <pre>🟢🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends-resolvable">fed1-external-extends-resolvable</a>
 <pre>🟢</pre>
 <a href="./src/test-suites/fed1-external-extension">fed1-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extends">fed2-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extension">fed2-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/include-skip">include-skip</a>
 <pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/input-object-intersection">input-object-intersection</a>
@@ -132,15 +132,15 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
 <a href="./src/test-suites/enum-intersection">enum-intersection</a>
 <pre>🟢🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends-resolvable">fed1-external-extends-resolvable</a>
 <pre>🟢</pre>
 <a href="./src/test-suites/fed1-external-extension">fed1-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extends">fed2-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extension">fed2-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/include-skip">include-skip</a>
 <pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/input-object-intersection">input-object-intersection</a>
@@ -225,15 +225,15 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
 <a href="./src/test-suites/enum-intersection">enum-intersection</a>
 <pre>🟢🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends-resolvable">fed1-external-extends-resolvable</a>
 <pre>🟢</pre>
 <a href="./src/test-suites/fed1-external-extension">fed1-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extends">fed2-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extension">fed2-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/include-skip">include-skip</a>
 <pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/input-object-intersection">input-object-intersection</a>
@@ -318,15 +318,15 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
 <a href="./src/test-suites/enum-intersection">enum-intersection</a>
 <pre>🟢🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends-resolvable">fed1-external-extends-resolvable</a>
 <pre>🟢</pre>
 <a href="./src/test-suites/fed1-external-extension">fed1-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extends">fed2-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extension">fed2-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/include-skip">include-skip</a>
 <pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/input-object-intersection">input-object-intersection</a>
@@ -411,15 +411,15 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
 <a href="./src/test-suites/enum-intersection">enum-intersection</a>
 <pre>🟢🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends-resolvable">fed1-external-extends-resolvable</a>
 <pre>❌</pre>
 <a href="./src/test-suites/fed1-external-extension">fed1-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extends">fed2-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extension">fed2-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/include-skip">include-skip</a>
 <pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/input-object-intersection">input-object-intersection</a>
@@ -504,15 +504,15 @@ You can look at the full list of tests [here](./src/test-suites/). Every test id
 <a href="./src/test-suites/enum-intersection">enum-intersection</a>
 <pre>❌❌❌❌❌</pre>
 <a href="./src/test-suites/fed1-external-extends">fed1-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed1-external-extends-resolvable">fed1-external-extends-resolvable</a>
 <pre>❌</pre>
 <a href="./src/test-suites/fed1-external-extension">fed1-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extends">fed2-external-extends</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/fed2-external-extension">fed2-external-extension</a>
-<pre>🟢🟢</pre>
+<pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/include-skip">include-skip</a>
 <pre>🟢🟢🟢🟢</pre>
 <a href="./src/test-suites/input-object-intersection">input-object-intersection</a>

diff --git a/gateways/apollo-gateway/results.txt b/gateways/apollo-gateway/results.txt
@@ -11,15 +11,15 @@ corrupted-supergraph-node-id
 enum-intersection
 .....
 fed1-external-extends
-..
+....
 fed1-external-extends-resolvable
 .
 fed1-external-extension
-..
+....
 fed2-external-extends
-..
+....
 fed2-external-extension
-..
+....
 include-skip
 ....
 input-object-intersection
@@ -82,6 +82,6 @@ union-intersection
 ........
 
 ---
-Total: 171
-Passed: 166
+Total: 179
+Passed: 174
 Failed: 5
diff --git a/gateways/apollo-router/install.sh b/gateways/apollo-router/install.sh
@@ -1,2 +1,2 @@
 # https://github.com/apollographql/router/releases
-curl -sSL https://router.apollo.dev/download/nix/v1.57.1 | sh
+curl -sSL https://router.apollo.dev/download/nix/v1.58.0 | sh
diff --git a/gateways/apollo-router/results.txt b/gateways/apollo-router/results.txt
@@ -11,15 +11,15 @@ corrupted-supergraph-node-id
 enum-intersection
 .....
 fed1-external-extends
-..
+....
 fed1-external-extends-resolvable
 .
 fed1-external-extension
-..
+....
 fed2-external-extends
-..
+....
 fed2-external-extension
-..
+....
 include-skip
 ....
 input-object-intersection
@@ -82,6 +82,6 @@ union-intersection
 ........
 
 ---
-Total: 171
-Passed: 167
+Total: 179
+Passed: 175
 Failed: 4
diff --git a/gateways/cosmo-router/install.sh b/gateways/cosmo-router/install.sh
@@ -8,7 +8,7 @@ set -u
 BINARY_DOWNLOAD_PREFIX="https://github.com/wundergraph/cosmo/releases/download"
 
 # https://github.com/wundergraph/cosmo/releases
-DOWNLOAD_VERSION="0.144.1"
+DOWNLOAD_VERSION="0.145.1"
 
 download_binary() {
     downloader --check

diff --git a/gateways/cosmo-router/results.txt b/gateways/cosmo-router/results.txt
@@ -11,15 +11,15 @@ X....X....
 enum-intersection
 .....
 fed1-external-extends
-..
+....
 fed1-external-extends-resolvable
 X
 fed1-external-extension
-..
+....
 fed2-external-extends
-..
+....
 fed2-external-extension
-..
+....
 include-skip
 ....
 input-object-intersection
@@ -82,6 +82,6 @@ union-intersection
 ...XX..X
 
 ---
-Total: 171
-Passed: 123
+Total: 179
+Passed: 131
 Failed: 48
diff --git a/gateways/grafbase-gateway/results.txt b/gateways/grafbase-gateway/results.txt
@@ -11,15 +11,15 @@ X.X..X....
 enum-intersection
 .....
 fed1-external-extends
-..
+....
 fed1-external-extends-resolvable
 .
 fed1-external-extension
-..
+....
 fed2-external-extends
-..
+....
 fed2-external-extension
-..
+....
 include-skip
 ....
 input-object-intersection
@@ -82,6 +82,6 @@ union-intersection
 ...X...X
 
 ---
-Total: 171
-Passed: 130
+Total: 179
+Passed: 138
 Failed: 41
diff --git a/gateways/hive-gateway/install.sh b/gateways/hive-gateway/install.sh
@@ -1,2 +1,2 @@
 # https://github.com/graphql-hive/gateway/releases
-curl -sSL https://graphql-hive.com/install-gateway.sh | sh -s "1.5.2"
+curl -sSL https://graphql-hive.com/install-gateway.sh | sh -s "1.5.4"
diff --git a/gateways/hive-gateway/results.txt b/gateways/hive-gateway/results.txt
@@ -11,15 +11,15 @@ corrupted-supergraph-node-id
 enum-intersection
 .....
 fed1-external-extends
-..
+....
 fed1-external-extends-resolvable
 .
 fed1-external-extension
-..
+....
 fed2-external-extends
-..
+....
 fed2-external-extension
-..
+....
 include-skip
 ....
 input-object-intersection
@@ -82,6 +82,6 @@ union-intersection
 ........
 
 ---
-Total: 171
-Passed: 171
+Total: 179
+Passed: 179
 Failed: 0
diff --git a/gateways/inigo-gateway/results.txt b/gateways/inigo-gateway/results.txt
@@ -11,15 +11,15 @@ corrupted-supergraph-node-id
 enum-intersection
 XXXXX
 fed1-external-extends
-..
+....
 fed1-external-extends-resolvable
 X
 fed1-external-extension
-..
+....
 fed2-external-extends
-..
+....
 fed2-external-extension
-..
+....
 include-skip
 ....
 input-object-intersection
@@ -82,6 +82,6 @@ union-intersection
 XXXXXXXX
 
 ---
-Total: 171
-Passed: 80
+Total: 179
+Passed: 88
 Failed: 91