Skip to content

Commit

Permalink
updated testing guide
Browse files Browse the repository at this point in the history
  • Loading branch information
llpeterson committed Feb 8, 2024
1 parent 391cfa0 commit 14ff6b3
Show file tree
Hide file tree
Showing 11 changed files with 87 additions and 555 deletions.
4 changes: 2 additions & 2 deletions index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -56,9 +56,9 @@
:glob:

testing/about_system_tests
testing/integration_tests
testing/aether-roc-tests
testing/system-tests
testing/acceptance_specification


.. toctree::
:maxdepth: 2
Expand Down
25 changes: 7 additions & 18 deletions intro.rst
Original file line number Diff line number Diff line change
Expand Up @@ -36,10 +36,10 @@ Other Aether guides available on this site include:
* :doc:`Test Automation </testing/about_system_tests>`: Learn how Aether
components are tested.

Note that Aether was originally deployed as a centrally-manged,
Note that Aether was originally deployed as a centrally-managed,
ONF-operated cloud service, with the expectation that organizations
would participate in Aether by connecting their edge site to this
operational deployment.\ [#]_ That service is now being deprecated in
operational deployment.\ [#]_ That service has now been deprecated in
favor of users bringing up their own Aether sites using :doc:`OnRamp
</onramp/overview>`.

Expand All @@ -52,23 +52,12 @@ favor of users bringing up their own Aether sites using :doc:`OnRamp
Aether Components
------------------------

Aether uses components from several ONF projects. Information about
these projects can be found at the following sites:
Aether builds on two main subsystems: SD-Core (a cloud native Mobile
Core) and SD-RAN (an O-RAN compliant, software-based RAN).
Additional documentation for each is available at:

* SD-Core

* `SD-Core Website <https://opennetworking.org/sd-core/>`_
* :doc:`SD-Core Documentation <sdcore:index>`

* SD-RAN

* `SD-RAN Website <https://opennetworking.org/open-ran/>`_
* :doc:`SD-RAN Documentation <sdran:index>`

* SD-Fabric

* `SD-Fabric Website <https://opennetworking.org/sd-fabric/>`_
* :doc:`SD-Fabric Documentation <sdfabric:index>`
* :doc:`SD-Core Documentation <sdcore:index>`
* :doc:`SD-RAN Documentation <sdran:index>`

More information about 5G and Aether's architecture can be found in
the :doc:`Private 5G: A Systems Approach <sysapproach5g:index>` book.
Expand Down
51 changes: 15 additions & 36 deletions testing/about_system_tests.rst
Original file line number Diff line number Diff line change
Expand Up @@ -5,44 +5,23 @@
About
=====

The goal and objective of Aether test automation is to build a framework that
provides highly scalable and low maintenance code which will help cover various
categories of tests. Framework includes libraries and tools that allows both
component level and integration level tests. Robot Framework will be used for
covering integration tests. Component level test coverage have been
accomplished by leveraging the existing test frameworks that were developed in
their respective projects. Component level tests include tests for SD-Fabric, PDP,
SD-CORE areas. For detailed information on component tests, please see their
respective documentation pages.
The Aether Project is transitioning to a new automated testing regime,
consistent with its transition from being a managed service to being
a platform anyone can deploy. Information about the previous framework
can be found in the `Version 2.1 Guide
<https://docs.aetherproject.org/aether-2.1/testing/about_system_tests.html>`__,

Test Frameworks
---------------
The major changes include:

The following diagram outlines each Aether core component, followed by an online
of the test frameworks used:
* Adopting gNBsim (in place of NG40) as the primary test engine for SD-Core.
* Developing new integration tests for a range of configuration options.
* Dropping support for SD-Fabric tests.

.. image:: images/aether-overview-diagram.png
:width: 600
:alt: Aether Overview Diagram
For detailed information on component-level tests, please see their
respective Guides:

.. list-table:: Test Frameworks
:widths: 5 3
:header-rows: 1
* :doc:`SD-Core Documentation <sdcore:index>`
* :doc:`SD-RAN Documentation <sdran:index>`

* - Aether Core Component
- Test Framework
* - SD-Core
- `Robot Framework <https://robotframework.org/>`_, `NG40/NG4T <https://www.ng4t.com/>`_
* - SD-Fabric
- `TestON <https://github.com/opennetworkinglab/OnosSystemTest/tree/master/TestON>`_
* - ROC
- `Robot Framework <https://robotframework.org/>`_, `Selenium <https://selenium-python.readthedocs.io/>`_
* - SD-RAN
- `Robot Framework <https://robotframework.org/>`_

Test Automation
---------------

`Jenkins <https://www.jenkins.io/>`_ is the primary automation server that is
used to help trigger our automated tests. All Aether Jenkins jobs are
created and run on the Aether Jenkins instance.
More information about interface testing is include in the :doc:`API
Tests Section </testing/aether-roc-tests>` of this Guide.
Loading

0 comments on commit 14ff6b3

Please sign in to comment.