feat: add Api approval tests #1538
ci.yml
on: pull_request
Test (MacOS)
13m 31s
Test (Ubuntu)
10m 17s
Test (Windows)
17m 48s
Test (.NET Framework)
8m 50s
Test (Examples)
4m 13s
Annotations
24 errors and 12 warnings
Test (Ubuntu)
Process returned exit code 1
Launched as "bash --noprofile --norc -eo pipefail /home/runner/work/_actions/Wandalen/wretry.action/v1.4.10_js_action/src/script.sh"
Launched at "/home/runner/work/Testably.Abstractions/Testably.Abstractions"
Attempts exhausted, made 2 attempts :
Attempt #1 started at : 16:57:29 GMT+0000 (Coordinated Universal Time)
Attempt #2 started at : 17:00:55 GMT+0000 (Coordinated Universal Time)
|
Test (MacOS)
Process returned exit code 1
Launched as "bash --noprofile --norc -eo pipefail /Users/runner/work/_actions/Wandalen/wretry.action/v1.4.10_js_action/src/script.sh"
Launched at "/Users/runner/work/Testably.Abstractions/Testably.Abstractions"
Attempts exhausted, made 2 attempts :
Attempt #1 started at : 16:57:07 GMT+0000 (Coordinated Universal Time)
Attempt #2 started at : 17:02:31 GMT+0000 (Coordinated Universal Time)
|
Test (Windows)
Process returned exit code 1
Launched as "pwsh -command ". 'D:\a\_actions\Wandalen\wretry.action\v1.4.10_js_action\src\script.ps1'""
Launched at "/D/a/Testably.Abstractions/Testably.Abstractions"
Attempts exhausted, made 2 attempts :
Attempt #1 started at : 16:57:28 GMT+0000 (Coordinated Universal Time)
Attempt #2 started at : 17:04:49 GMT+0000 (Coordinated Universal Time)
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("net6.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_Mac-1710348796408_2024-03-13_16_58_47.trx
_Mac-1710348796408_2024-03-13_17_04_06[1].trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27675 but was 26230. Strings differ at index 1863.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("net7.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_Mac-1710348796408_2024-03-13_16_58_47.trx
_Mac-1710348796408_2024-03-13_17_04_06[1].trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27820 but was 26230. Strings differ at index 1863.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("net8.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_Mac-1710348796408_2024-03-13_16_58_47.trx
_Mac-1710348796408_2024-03-13_17_04_06[1].trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27647 but was 26057. Strings differ at index 1863.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("netstandard2.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_Mac-1710348796408_2024-03-13_16_58_47.trx
_Mac-1710348796408_2024-03-13_17_04_06[1].trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 26791 but was 25428. Strings differ at index 1752.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("netstandard2.1"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_Mac-1710348796408_2024-03-13_16_58_47.trx
_Mac-1710348796408_2024-03-13_17_04_06[1].trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27190 but was 25827. Strings differ at index 1752.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("net6.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_fv-az1269-41_2024-03-13_16_58_07.trx
_fv-az1269-41_2024-03-13_17_01_31.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27675 but was 26230. Strings differ at index 1863.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("net7.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_fv-az1269-41_2024-03-13_16_58_07.trx
_fv-az1269-41_2024-03-13_17_01_31.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27820 but was 26230. Strings differ at index 1863.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("net8.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_fv-az1269-41_2024-03-13_16_58_07.trx
_fv-az1269-41_2024-03-13_17_01_31.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27647 but was 26057. Strings differ at index 1863.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("netstandard2.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_fv-az1269-41_2024-03-13_16_58_07.trx
_fv-az1269-41_2024-03-13_17_01_31.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 26791 but was 25428. Strings differ at index 1752.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsTesting("netstandard2.1"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L62
Failed test found in:
_fv-az1269-41_2024-03-13_16_58_07.trx
_fv-az1269-41_2024-03-13_17_01_31.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 27190 but was 25827. Strings differ at index 1752.
Expected: "...eHandle) { }\n }\n public sealed class FileSystemWatch..."
But was: "...eHandle) { }\n }\n public interface IAccessControlStra..."
----------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractions("net6.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L18
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 1838 but was 1806. Strings differ at index 37.
Expected: "...ly: System.CLSCompliant(true)]\r\n[assembly: System.Reflecti..."
But was: "...ly: System.CLSCompliant(true)]\n[assembly: System.Reflectio..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractions("net7.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L18
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 1838 but was 1806. Strings differ at index 37.
Expected: "...ly: System.CLSCompliant(true)]\r\n[assembly: System.Reflecti..."
But was: "...ly: System.CLSCompliant(true)]\n[assembly: System.Reflectio..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractions("netstandard2.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L18
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 1848 but was 1816. Strings differ at index 37.
Expected: "...ly: System.CLSCompliant(true)]\r\n[assembly: System.Reflecti..."
But was: "...ly: System.CLSCompliant(true)]\n[assembly: System.Reflectio..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsAccessControl("net6.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L29
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 4571 but was 4518. Strings differ at index 37.
Expected: "...ly: System.CLSCompliant(true)]\r\n[assembly: System.Reflecti..."
But was: "...ly: System.CLSCompliant(true)]\n[assembly: System.Reflectio..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsAccessControl("net7.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L29
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 4571 but was 4518. Strings differ at index 37.
Expected: "...ly: System.CLSCompliant(true)]\r\n[assembly: System.Reflecti..."
But was: "...ly: System.CLSCompliant(true)]\n[assembly: System.Reflectio..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsAccessControl("netstandard2.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L29
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 4677 but was 4624. Strings differ at index 37.
Expected: "...ly: System.CLSCompliant(true)]\r\n[assembly: System.Reflecti..."
But was: "...ly: System.CLSCompliant(true)]\n[assembly: System.Reflectio..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsCompression("net6.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L40
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 4358 but was 4301. Strings differ at index 120.
Expected: "...y/Testably.Abstractions.git")]\r\n[assembly: System.Runtime...."
But was: "...y/Testably.Abstractions.git")]\n[assembly: System.Runtime.C..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsCompression("net7.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L40
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 4469 but was 4409. Strings differ at index 120.
Expected: "...y/Testably.Abstractions.git")]\r\n[assembly: System.Runtime...."
But was: "...y/Testably.Abstractions.git")]\n[assembly: System.Runtime.C..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsCompression("net8.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L40
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 5446 but was 5379. Strings differ at index 120.
Expected: "...y/Testably.Abstractions.git")]\r\n[assembly: System.Runtime...."
But was: "...y/Testably.Abstractions.git")]\n[assembly: System.Runtime.C..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsCompression("netstandard2.0"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L40
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 3928 but was 3876. Strings differ at index 120.
Expected: "...y/Testably.Abstractions.git")]\r\n[assembly: System.Runtime...."
But was: "...y/Testably.Abstractions.git")]\n[assembly: System.Runtime.C..."
---------------------------------------------^
|
Testably.Abstractions.Api.Tests.ApiApprovalTests ► VerifyPublicApiForTestablyAbstractionsCompression("netstandard2.1"):
Tests/Api/Testably.Abstractions.Api.Tests/ApiApprovalTests.cs#L40
Failed test found in:
runneradmin_fv-az1495-557_2024-03-13_16_58_04.trx
runneradmin_fv-az1495-557_2024-03-13_17_05_27.trx
Error:
Assert.That(publicApi, Is.EqualTo(expectedApi))
Expected string length 4368 but was 4311. Strings differ at index 120.
Expected: "...y/Testably.Abstractions.git")]\r\n[assembly: System.Runtime...."
But was: "...y/Testably.Abstractions.git")]\n[assembly: System.Runtime.C..."
---------------------------------------------^
|
Test (Examples)
Environment variable 'INPUT_GITHUB_CONTEXT' exceeds the maximum supported length. Environment variable length: 35568 , Maximum supported length: 32766
|
Test (Examples)
Environment variable 'INPUT_GITHUB_CONTEXT' exceeds the maximum supported length. Environment variable length: 35568 , Maximum supported length: 32766
|
Test (Examples)
Environment variable 'INPUT_GITHUB_CONTEXT' exceeds the maximum supported length. Environment variable length: 35568 , Maximum supported length: 32766
|
Test (Examples)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Test (.NET Framework)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: darenm/Setup-VSTest@v1, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Test (.NET Framework)
The following actions uses node12 which is deprecated and will be forced to run on node16: darenm/Setup-VSTest@v1. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
|
Test (Ubuntu)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Test (MacOS)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Test (Windows)
Environment variable 'INPUT_GITHUB_CONTEXT' exceeds the maximum supported length. Environment variable length: 35567 , Maximum supported length: 32766
|
Test (Windows)
Environment variable 'INPUT_GITHUB_CONTEXT' exceeds the maximum supported length. Environment variable length: 35567 , Maximum supported length: 32766
|
Test (Windows)
Environment variable 'INPUT_GITHUB_CONTEXT' exceeds the maximum supported length. Environment variable length: 35567 , Maximum supported length: 32766
|
Test (Windows)
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
PR_NUMBER
Expired
|
5 Bytes |
|
Test results (.NET Framework)
Expired
|
5.4 MB |
|
Test results (MacOS)
Expired
|
105 MB |
|
Test results (Ubuntu)
Expired
|
104 MB |
|
Test results (Windows)
Expired
|
104 MB |
|