Skip to content

Latest commit

 

History

History
48 lines (34 loc) · 2.19 KB

hil_tests.md

File metadata and controls

48 lines (34 loc) · 2.19 KB
Raw
id title hide_title
HIL_AGW_tests
Hardware In Loop Testing
true

Hardware In Loop Tests

Current testing workflow for HIL testing is using Spirent test center to emulate eNodeB, UE and Network host to run scale and performance tests. HIL is focusing on Magma AGW. HIL tests can be run with virtual or physical gateway. However, for now the automated runs are using physical SUT-HW box.

HIL AGW Last Pass

Dashboard

All test results are available to compare on dashboard. Please use username:magma and password:magma. We can retrieve log and Grafana metrics for each run by clicking on test run result table.

Lab Setup

Spirent test emulation hardware is hosted in FB lab emulating eNODEB, UE and traffic host elements. Magma AGW is also hosted in same lab. All tests are executed in worker node in FB lab. Reports and logs are pushed out to AWS S3 for debug and analysis.

Run tests

To setup HIL worker follow instruction Current Test categories supported are:

  1. Sanity (every new build, run time - 30 minutes) updates badge with latest result on magma main README
  2. Performance (nightly, run time - 12hrs)
  3. Feature tests at scale - (nightly, run time - 6hrs)
  4. Availability - Every day, for 12hrs

HIL SANITY TEST CASES

  1. Verify 12 eNodeBs can connect to a Magma Access Gateway
  2. Verify 200 UEs at 5 UE/sec can connect to a Magma Access Gateway
  3. Verify 400 UEs at 5 UE/sec can connect to a Magma Access Gateway
  4. Verify 600 UEs at 5 UE/sec can connect to a Magma Access Gateway
  5. Verify 200 UEs across 12 eNodeBs with 2M data per UE
  6. Verify 400 UEs across 12 eNodeBs with 500k data per UE
  7. Verify 600 UEs across 12 eNodeBs with 500k data per UE
  8. Verify 30 UEs across 12 eNodeBs with 500K data changing state from active-idle-active-idle

Notification

All test suites run send notification to slack channel which is used as alerting mechanism. please join slack channel for regular update