WebRTC stress test

A tool for running concurrent WebRTC sessions using chromium web browser in headless mode.

Components used:

NodeJS application.
Puppeteer library for controlling chromium instances.
A patched version of chromium (see ./chromium directory): setting the USE_NULL_VIDEO_DECODER environment variable disables the video decoding, lowering the CPU requirements when running multiple browser sessions.
RTC stats logging with ObserveRTC.

Configuration options

See the config documentation.

The DEBUG_LEVEL environment is used for enabled debug messages; see debug-level for syntax.

Statistics

Example output:

-- Mon, 08 Mar 2021 11:41:48 GMT -------------------------------------------------------------------
                          name    count      sum     mean   stddev      25p      min      max
                           cpu        1    67.66    67.66     0.00    67.66    67.66    67.66 %
                        memory        1   801.13   801.13     0.00   801.13   801.13   801.13 MB
                          tabs        1        1        1        0        1        1        1
-- Inbound audio -----------------------------------------------------------------------------------
                      received        1     0.02     0.02     0.00     0.02     0.02     0.02 MB
                          rate        1     0.53     0.53     0.00     0.53     0.53     0.53 Kbps
                          lost        1              0.00     0.00     0.00     0.00     0.00 %
                        jitter        1              0.00     0.00     0.00     0.00     0.00 s
          avgJitterBufferDelay        1             85.27     0.00    85.27    85.27    85.27 ms
-- Inbound video -----------------------------------------------------------------------------------
                      received        2    26.62    13.31    13.22    13.31     0.09    26.53 MB
                          rate        2   838.72   419.36   411.30   419.36     8.06   830.66 Kbps
                          lost        1              0.00     0.00     0.00     0.00     0.00 %
                        jitter        1              1.88     0.37     1.77     0.98     2.65 s
          avgJitterBufferDelay        1             90.86     0.00    90.86    90.86    90.86 ms
                         width        1              1280        0     1280     1280     1280 px
                        height        1               720        0      720      720      720 px
-- Outbound audio ----------------------------------------------------------------------------------
                          sent        1     0.50     0.50     0.00     0.50     0.50     0.50 MB
                 retransmitted        1     0.00     0.00     0.00     0.00     0.00     0.00 MB
                          rate        1     0.00     0.00     0.00     0.00     0.00     0.00 Kbps
-- Outbound video ----------------------------------------------------------------------------------
                          sent        3    43.62    14.54     7.70    10.06     4.68    23.49 MB
                 retransmitted        3     0.00     0.00     0.00     0.00     0.00     0.00 MB
                          rate        3     0.00     0.00     0.00     0.00     0.00     0.00 Kbps
 qualityLimitResolutionChanges        3        0        0        0        0        0        0
                         width        1              1280        0     1280     1280     1280 px
                        height        1               720        0      720      720      720 px
                           fps        1                25        0       25       25       25 fps

Statistics values:

Name	Count	Desscription
cpu	Total sessions	The browser process cpu usage.
memory	Total sessions	The browser process memory usage.
tabs	Total sessions	The browser current opened tabs.
received	Total inbound streams	The `bytesReceived` value for each stream.
sent	Total outbound streams	The `bytesSent` value for each stream.
retransmitted	Total outbound streams	The `retransmittedBytesSent` value for each stream.
rate	Total streams	The stream bitrate.
lost	Total streams	The stream lost packets %.
jitter	Total streams	The stream jitter in seconds.
avgJitterBufferDelay	Total decoded tracks	The inbound average jitter buffer delay.
qualityLimitResolutionChanges	Total outbound video streams	The `qualityLimitationResolutionChanges` value for each outbound video stream.
width	Total sent or received videos	The sent or received video width.
height	Total sent or received videos	The sent or received video height.
fps	Total sent	The sent video frames per second.

Prometheus / Grafana

See the prometheus stack.

Examples

Mediasoup demo

Starts one send-receive participant:

docker pull vpalmisano/webrtc-stress-test:latest
docker run -it --rm --name=webrtc-stress-test-publisher \
    -v /dev/shm:/dev/shm \
    -v /tmp/webrtc-stress-test:/tmp/webrtc-stress-test \
    vpalmisano/webrtc-stress-test:latest \
    --video-path=/app/video.mp4 \
    --url=$MEDIASOUP_DEMO_URL \
    --url-query='roomId=test&displayName=Publisher($s-$t)' \
    --sessions=1 \
    --tabs-per-session=1

Using Vaapi GPU acceleration (experimental):

docker run -it --rm --name=webrtc-stress-test-publisher \
    --privileged \
    -v /dev/dri:/dev/dri \
    -v /dev/shm:/dev/shm \
    -v /tmp/webrtc-stress-test:/tmp/webrtc-stress-test \
    vpalmisano/webrtc-stress-test:latest \
    --video-path=/app/video.mp4 \
    --url=$MEDIASOUP_DEMO_URL \
    --url-query='roomId=test&displayName=Publisher($s-$t)' \
    --sessions=1 \
    --tabs-per-session=1 \
    --enable-gpu=true

Starts 10 receive-only participants:

docker pull vpalmisano/webrtc-stress-test:latest
docker run -it --rm --name=webrtc-stress-test-viewer \
    -v /dev/shm:/dev/shm \
    vpalmisano/webrtc-stress-test:latest \
    --url=$MEDIASOUP_DEMO_URL \
    --url-query='roomId=test&displayName=Viewer($s-$t)&produce=false' \
    --sessions=1 \
    --tabs-per-session=10

Edumeet

Starts one send-receive participant, with a random audio activation pattern:

docker pull vpalmisano/webrtc-stress-test:latest
docker run -it --rm --name=webrtc-stress-test-publisher \
    -v /dev/shm:/dev/shm \
    -v /tmp/webrtc-stress-test:/tmp/webrtc-stress-test \
    vpalmisano/webrtc-stress-test:latest \
    --video-path=/app/video.mp4 \
    --url=$EDUMEET_URL \
    --url-query='displayName=Publisher($s-$t)' \
    --script-path=/app/scripts/edumeet-sendrecv.js \
    --sessions=1 \
    --tabs-per-session=1

Starts 10 receive-only participants:

docker pull vpalmisano/webrtc-stress-test:latest
docker run -it --rm --name=webrtc-stress-test-viewer \
    -v /dev/shm:/dev/shm \
    vpalmisano/webrtc-stress-test:latest \
    --url=$EDUMEET_URL \
    --url-query='displayName=Viewer($s-$t)' \
    --script-path=/app/scripts/edumeet-recv.js \
    --sessions=1 \
    --tabs-per-session=10

Jitsi

Starts one send-receive participant:

docker pull vpalmisano/webrtc-stress-test:latest
docker run -it --rm --name=webrtc-stress-test-publisher \
    -v /dev/shm:/dev/shm \
    -v /tmp/webrtc-stress-test:/tmp/webrtc-stress-test \
    vpalmisano/webrtc-stress-test:latest \
    --video-path=/app/video.mp4 \
    --url=$JITSI_ROOM_URL \
    --url-query='#config.prejoinPageEnabled=false&userInfo.displayName=Participant($s-$t)' \
    --sessions=1 \
    --tabs-per-session=1

Starts 10 receive-only participants:

docker pull vpalmisano/webrtc-stress-test:latest
docker run -it --rm --name=webrtc-stress-test-viewer \
    -v /dev/shm:/dev/shm \
    vpalmisano/webrtc-stress-test:latest \
    --url=$ROOM_URL \
    --url-query='#config.prejoinPageEnabled=false&userInfo.displayName=Participant($s-$t)' \
    --sessions=1 \
    --tabs-per-session=10

Jamm

Starts one send-receive participant:

docker pull vpalmisano/webrtc-stress-test:latest
docker run -it --rm --name=webrtc-stress-test-publisher \
    -v /dev/shm:/dev/shm \
    -v /tmp/webrtc-stress-test:/tmp/webrtc-stress-test \
    vpalmisano/webrtc-stress-test:latest \
    --video-path=/app/video.mp4 \
    --script-path=/app/scripts/jamm-sendrecv.js \
    --url=$ROOM_URL \
    --sessions=1 \
    --tabs-per-session=1

Running from source code

git clone https://github.com/vpalmisano/webrtc-stress-test.git

cd webrtc-stress-test

# build the chromium customized version
# cd chromium
# ./build.sh setup
# ./build.sh apply_patch
# ./build.sh build
# install the package (on Ubuntu/Debian)
# dpkg -i ./chromium-browser-unstable_<version>-1_amd64.deb
# cd ..

# sendrecv test
DEBUG_LEVEL=DEBUG:* yarn start:dev \
    --url=https://127.0.0.1:3443/test \
    --url-query='displayName=SendRecv($s/$S-$t/$T)' \
    --video-path=./video.mp4 \
    --script-path=./scripts/edumeet-sendrecv.js \
    --sessions=1 \
    --tabs-per-session=1 \
    --enable-page-log=true

# recv only
DEBUG_LEVEL=DEBUG:* yarn start:dev \
    --url=https://127.0.0.1:3443/test \
    --url-query='displayName=Recv($s/$S-$t/$T)' \
    --script-path=./scripts/edumeet-recv.js \
    --sessions=1 \
    --tabs-per-session=10 \
    --enable-page-log=true \
    --use-null-video-decoder=true

Name		Name	Last commit message	Last commit date
Latest commit History 150 Commits
chromium		chromium
prometheus-stack		prometheus-stack
scripts		scripts
src		src
.dockerignore		.dockerignore
.eslintignore		.eslintignore
.eslintrc.js		.eslintrc.js
.gitignore		.gitignore
CONFIG.md		CONFIG.md
Dockerfile		Dockerfile
LICENSE		LICENSE
README.md		README.md
entrypoint.sh		entrypoint.sh
generate-config-docs.js		generate-config-docs.js
index.js		index.js
observertc.js		observertc.js
package-lock.json		package-lock.json
package.json		package.json
webpack.config.js		webpack.config.js

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Repository files navigation

WebRTC stress test

Configuration options

Statistics

Prometheus / Grafana

Examples

Mediasoup demo

Edumeet

Jitsi

Jamm

Running from source code

About

Releases

Packages

Languages

License

modulo-srl/webrtc-stress-test

Folders and files

Latest commit

History

Repository files navigation

WebRTC stress test

Configuration options

Statistics

Prometheus / Grafana

Examples

Mediasoup demo

Edumeet

Jitsi

Jamm

Running from source code

About

Resources

License

Stars

Watchers

Forks

Releases

Packages 0

Languages

Packages