Tests fail

[yurivict]

-- xeus version: v1.1.0
-- xeus binary version: v2.0.0
-- XEUS_ZMQ_BUILD_SHARED_LIBS:          ON
-- XEUS_ZMQ_BUILD_STATIC_LIBS:          ON
-- XEUS_ZMQ_STATIC_DEPENDENCIES:        OFF
-- XEUS_ZMQ_BUILD_TESTS:                ON
-- CMAKE_CXX_FLAGS: -O2 -pipe -fstack-protector-strong -fno-strict-aliasing
-- CMAKE_CXX_FLAGS: -O2 -pipe -fstack-protector-strong -fno-strict-aliasing
-- tests enabled
-- Forcing tests build type to Release
Found xeus-zmq shared library.
-- Configuring done (0.1s)
-- Generating done (0.0s)
-- Build files have been written to: /usr/ports/devel/xeus-zmq/work/.build
ninja: no work to do.
[  0% 1/1] cd /usr/ports/devel/xeus-zmq/work/.build && /usr/local/bin/ctest --force-new-ctest-process
Test project /usr/ports/devel/xeus-zmq/work/.build
    Start 1: test_kernel
1/3 Test #1: test_kernel ......................***Failed    4.22 sec
============================= test session starts ==============================
platform freebsd13 -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
Using --randomly-seed=2794064595
rootdir: /usr/ports/devel/xeus-zmq/work/.build/test
plugins: forked-1.6.0, mypy-plugins-1.11.1, cov-2.9.0, randomly-3.12.0, timeout-2.1.0, rerunfailures-11.1.2, flaky-3.7.0, xdist-2.5.0, env-0.6.2, mock-3.10.0, requests-mock-1.10.0, flake8-1.1.1, hypothesis-6.75.2, typeguard-4.0.0
collected 13 items

test_kernel.py s..sF..s.s.s.                                             [100%]

=================================== FAILURES ===================================
_______________________ XeusKernelTests.test_xeus_stderr _______________________

self = <test_kernel.XeusKernelTests testMethod=test_xeus_stderr>

    def test_xeus_stderr(self):
        reply, output_msgs = self.execute_helper(code='error')
>       self.assertEqual(output_msgs[0]['msg_type'], 'stream')
E       IndexError: list index out of range

test_kernel.py:30: IndexError
=============================== warnings summary ===============================
../../../../../../local/lib/python3.9/site-packages/jupyter_client/connect.py:20
  /usr/local/lib/python3.9/site-packages/jupyter_client/connect.py:20: DeprecationWarning: Jupyter is migrating its paths to use standard platformdirs
  given by the platformdirs library.  To remove this warning and
  see the appropriate new directories, set the environment variable
  `JUPYTER_PLATFORM_DIRS=1` and then run `jupyter --paths`.
  The use of platformdirs will be the default in `jupyter_core` v6
    from jupyter_core.paths import jupyter_data_dir, jupyter_runtime_dir, secure_write

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
FAILED test_kernel.py::XeusKernelTests::test_xeus_stderr - IndexError: list i...
============== 1 failed, 7 passed, 5 skipped, 1 warning in 2.88s ===============

    Start 2: test_kernel_control
2/3 Test #2: test_kernel_control ..............***Failed    4.24 sec
============================= test session starts ==============================
platform freebsd13 -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
Using --randomly-seed=748209324
rootdir: /usr/ports/devel/xeus-zmq/work/.build/test
plugins: forked-1.6.0, mypy-plugins-1.11.1, cov-2.9.0, randomly-3.12.0, timeout-2.1.0, rerunfailures-11.1.2, flaky-3.7.0, xdist-2.5.0, env-0.6.2, mock-3.10.0, requests-mock-1.10.0, flake8-1.1.1, hypothesis-6.75.2, typeguard-4.0.0
collected 13 items

test_kernel_control.py ..sFsss...s..                                     [100%]

=================================== FAILURES ===================================
_______________________ XeusKernelTests.test_xeus_stderr _______________________

self = <test_kernel_control.XeusKernelTests testMethod=test_xeus_stderr>

    def test_xeus_stderr(self):
        reply, output_msgs = self.execute_helper(code='error')
>       self.assertEqual(output_msgs[0]['msg_type'], 'stream')
E       IndexError: list index out of range

test_kernel_control.py:30: IndexError
=============================== warnings summary ===============================
../../../../../../local/lib/python3.9/site-packages/jupyter_client/connect.py:20
  /usr/local/lib/python3.9/site-packages/jupyter_client/connect.py:20: DeprecationWarning: Jupyter is migrating its paths to use standard platformdirs
  given by the platformdirs library.  To remove this warning and
  see the appropriate new directories, set the environment variable
  `JUPYTER_PLATFORM_DIRS=1` and then run `jupyter --paths`.
  The use of platformdirs will be the default in `jupyter_core` v6
    from jupyter_core.paths import jupyter_data_dir, jupyter_runtime_dir, secure_write

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
FAILED test_kernel_control.py::XeusKernelTests::test_xeus_stderr - IndexError...
============== 1 failed, 7 passed, 5 skipped, 1 warning in 2.89s ===============

    Start 3: test_kernel_shell
3/3 Test #3: test_kernel_shell ................***Failed    4.24 sec
============================= test session starts ==============================
platform freebsd13 -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
Using --randomly-seed=757488044
rootdir: /usr/ports/devel/xeus-zmq/work/.build/test
plugins: forked-1.6.0, mypy-plugins-1.11.1, cov-2.9.0, randomly-3.12.0, timeout-2.1.0, rerunfailures-11.1.2, flaky-3.7.0, xdist-2.5.0, env-0.6.2, mock-3.10.0, requests-mock-1.10.0, flake8-1.1.1, hypothesis-6.75.2, typeguard-4.0.0
collected 13 items

test_kernel_shell.py s....ss..sFs.                                       [100%]

=================================== FAILURES ===================================
_______________________ XeusKernelTests.test_xeus_stderr _______________________

self = <test_kernel_shell.XeusKernelTests testMethod=test_xeus_stderr>

    def test_xeus_stderr(self):
        reply, output_msgs = self.execute_helper(code='error')
>       self.assertEqual(output_msgs[0]['msg_type'], 'stream')
E       IndexError: list index out of range

test_kernel_shell.py:30: IndexError
=============================== warnings summary ===============================
../../../../../../local/lib/python3.9/site-packages/jupyter_client/connect.py:20
  /usr/local/lib/python3.9/site-packages/jupyter_client/connect.py:20: DeprecationWarning: Jupyter is migrating its paths to use standard platformdirs
  given by the platformdirs library.  To remove this warning and
  see the appropriate new directories, set the environment variable
  `JUPYTER_PLATFORM_DIRS=1` and then run `jupyter --paths`.
  The use of platformdirs will be the default in `jupyter_core` v6
    from jupyter_core.paths import jupyter_data_dir, jupyter_runtime_dir, secure_write

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
=========================== short test summary info ============================
FAILED test_kernel_shell.py::XeusKernelTests::test_xeus_stderr - IndexError: ...
============== 1 failed, 7 passed, 5 skipped, 1 warning in 2.88s ===============


0% tests passed, 3 tests failed out of 3

Total Test time (real) =  12.70 sec

The following tests FAILED:
	  1 - test_kernel (Failed)
	  2 - test_kernel_control (Failed)
	  3 - test_kernel_shell (Failed)
Errors while running CTest
FAILED: CMakeFiles/test.util 
cd /usr/ports/devel/xeus-zmq/work/.build && /usr/local/bin/ctest --force-new-ctest-process

Version: 1.1.0
python-3.9
FreeBSD 13.2

[JohanMabille]

Can you confirm that xeus-zmq links with xeus 3.1.1 ? Notice that the following lines

-- xeus version: v1.1.0
-- xeus binary version: v2.0.0

are misleading since they actually print the version of xeus-zmq, not xeus; this is fixed in #30 (wihch also updates the minimal required version of xeus).