[HW Accel Support]: Sizing GPU

[temuccio]

Describe the problem you are having

Hi all,
I am writing to request your assistance regarding the appropriate GPU sizing to use with Frigate. I am currently using Frigate with great satisfaction to monitor and next time I would like to use a system with approximately 100 cameras. My goal is to optimize performance, particularly with regard to detection and recording.

At the moment, I am running Frigate on a server with the following specifications:

Operating System: Debian 12
Hardware: Intel Xeon E3-1226 processor with 16 GB of RAM

I would like to know which GPU you would recommend to optimally handle the workload, considering the number of cameras (around 100) and the importance of achieving good efficiency for both real-time detection and continuous recording.

Thank you in advance for your availability and support. I look forward to your response with any suggestions on GPU models or ideal configurations for this type of application.

Version

0.14.1-f4f3cfa

In which browser(s) are you experiencing the issue with?

No response

Frigate config file

mqtt:
  enabled: false

detectors:
  ov:
    type: openvino
    device: CPU

model:
  width: 300
  height: 300
  input_tensor: nhwc
  input_pixel_format: bgr
  path: /openvino-model/ssdlite_mobilenet_v2.xml
  labelmap_path: /openvino-model/coco_91cl_bkgr.txt

record:
  enabled: true
  retain:
    days: 7
    mode: motion
  events:
    retain:
      default: 7
      mode: active_objects

cameras:
  Camera1: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://<username>:<password>@192.168.1.52/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://<username>:<password>@192.168.1.52/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera2: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://<username>:<password>@192.168.1.41/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://<username>:<password>@192.168.1.41/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera3: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://<username>:<password>@192.168.1.126/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://<username>:<password>@192.168.1.126/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera4: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.191/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.191/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera5: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.190/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.190/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera6: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.183/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.183/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera7: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.189/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.189/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera8: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.134/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.134/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera9: # <------ Name the camera
    enabled: false
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.133/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.133/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera10: # <------ Name the camera
    enabled: false
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.237/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.237/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera11: # <------ Name the camera
    enabled: false
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.236/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.236/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera12: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.232/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.232/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera13: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.222/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.222/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera14: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.234/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.234/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera15: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.231/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.231/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera16: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.224/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.224/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera17: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.130/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.130/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera18: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.131/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.131/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: true # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720
  Camera19: # <------ Name the camera
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://admin:<password>@192.168.1.239/Streaming/channels/2 # <----- The stream you want to use for detection
          roles:
            - detect
        - path: rtsp://admin:<password>@192.168.1.239/Streaming/channels/1 # <----- The stream you want to use for record
          roles:
            - record
    detect:
      enabled: false # <---- disable detection until you have a working camera feed
      width: 1280
      height: 720

docker-compose file or Docker CLI command

services:
  frigate:
    container_name: frigate
    restart: unless-stopped
    image: ghcr.io/blakeblackshear/frigate:stable
    shm_size: "1024mb"
    devices:
      - /dev/dri/renderD128:/dev/dri/renderD128
    volumes:
      - /etc/localtime:/etc/localtime:ro
      - ./config:/config
      - ./storage:/media/frigate
      - type: tmpfs
        target: /tmp/cache
        tmpfs:
          size: 10000000000
    ports:
      - "8971:8971"
      - "8554:8554"
      - "5000:5000"

Relevant Frigate log output

2024-09-09 14:51:06.430191668  [2024-09-09 14:51:06] watchdog.Camera4       ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-09 14:51:06.430193593  [2024-09-09 14:51:06] ffmpeg.Camera4.detect  ERROR   : [tcp @ 0x5640198912c0] Connection to tcp://192.168.1.191:554?timeout=5000000 failed: No route to host
2024-09-09 14:51:06.430195153  [2024-09-09 14:51:06] ffmpeg.Camera4.detect  ERROR   : rtsp://*:*@192.168.1.191/Streaming/channels/2: No route to host
2024-09-09 14:51:06.447329274  [2024-09-09 14:51:06] watchdog.Camera4       ERROR   : No new recording segments were created for Camera4 in the last 120s. restarting the ffmpeg record process...
2024-09-09 14:51:06.447351091  [2024-09-09 14:51:06] watchdog.Camera4       INFO    : Terminating the existing ffmpeg process...
2024-09-09 14:51:06.448290027  [2024-09-09 14:51:06] watchdog.Camera4       INFO    : Waiting for ffmpeg to exit gracefully...
2024-09-09 14:51:06.852103234  [2024-09-09 14:51:06] watchdog.Camera16        ERROR   : Ffmpeg process crashed unexpectedly for Camera16.
2024-09-09 14:51:06.852173119  [2024-09-09 14:51:06] watchdog.Camera16        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-09 14:51:06.852224226  [2024-09-09 14:51:06] ffmpeg.Camera16.detect   ERROR   : [tcp @ 0x55eced3e12c0] Connection to tcp://192.168.1.224:554?timeout=5000000 failed: No route to host
2024-09-09 14:51:06.852381722  [2024-09-09 14:51:06] ffmpeg.Camera16.detect   ERROR   : rtsp://*:*@192.168.1.224/Streaming/channels/2: No route to host
2024-09-09 14:51:06.877977177  [2024-09-09 14:51:06] watchdog.Camera16        ERROR   : No new recording segments were created for Camera16 in the last 120s. restarting the ffmpeg record process...
2024-09-09 14:51:06.877982416  [2024-09-09 14:51:06] watchdog.Camera16        INFO    : Terminating the existing ffmpeg process...
2024-09-09 14:51:06.877983981  [2024-09-09 14:51:06] watchdog.Camera16        INFO    : Waiting for ffmpeg to exit gracefully...
2024-09-09 14:51:09.036169423  [2024-09-09 14:51:09] frigate.video                  ERROR   : Camera5: Unable to read frames from ffmpeg process.
2024-09-09 14:51:09.036239415  [2024-09-09 14:51:09] frigate.video                  ERROR   : Camera5: ffmpeg process is not running. exiting capture thread...
2024-09-09 14:51:09.516373965  [2024-09-09 14:51:09] frigate.video                  ERROR   : Camera4: Unable to read frames from ffmpeg process.
2024-09-09 14:51:09.516633260  [2024-09-09 14:51:09] frigate.video                  ERROR   : Camera4: ffmpeg process is not running. exiting capture thread...
2024-09-09 14:51:09.931970138  [2024-09-09 14:51:09] frigate.video                  ERROR   : Camera16: Unable to read frames from ffmpeg process.
2024-09-09 14:51:09.932953204  [2024-09-09 14:51:09] frigate.video                  ERROR   : Camera16: ffmpeg process is not running. exiting capture thread...
2024-09-09 14:51:15.990583358  [2024-09-09 14:51:15] watchdog.Camera5          ERROR   : Ffmpeg process crashed unexpectedly for Camera5.
2024-09-09 14:51:15.990660211  [2024-09-09 14:51:15] watchdog.Camera5          ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-09 14:51:15.990716823  [2024-09-09 14:51:15] ffmpeg.Camera5.detect     ERROR   : [tcp @ 0x557a8e9122c0] Connection to tcp://192.168.1.190:554?timeout=5000000 failed: No route to host
2024-09-09 14:51:15.990762625  [2024-09-09 14:51:15] ffmpeg.Camera5.detect     ERROR   : rtsp://*:*@192.168.1.190/Streaming/channels/2: No route to host
2024-09-09 14:51:16.010921901  [2024-09-09 14:51:16] watchdog.Camera5          ERROR   : No new recording segments were created for Camera5 in the last 120s. restarting the ffmpeg record process...
2024-09-09 14:51:16.010926232  [2024-09-09 14:51:16] watchdog.Camera5          INFO    : Terminating the existing ffmpeg process...
2024-09-09 14:51:16.010927726  [2024-09-09 14:51:16] watchdog.Camera5          INFO    : Waiting for ffmpeg to exit gracefully...
2024-09-09 14:51:16.474354352  [2024-09-09 14:51:16] watchdog.Camera4       ERROR   : Ffmpeg process crashed unexpectedly for Camera4.
2024-09-09 14:51:16.474566763  [2024-09-09 14:51:16] watchdog.Camera4       ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-09 14:51:16.474605425  [2024-09-09 14:51:16] ffmpeg.Camera4.detect  ERROR   : [tcp @ 0x55c0cb3852c0] Connection to tcp://192.168.1.191:554?timeout=5000000 failed: No route to host
2024-09-09 14:51:16.474651780  [2024-09-09 14:51:16] ffmpeg.Camera4.detect  ERROR   : rtsp://*:*@192.168.1.191/Streaming/channels/2: No route to host
2024-09-09 14:51:16.482531461  [2024-09-09 14:51:16] watchdog.Camera4       ERROR   : No new recording segments were created for Camera4 in the last 120s. restarting the ffmpeg record process...
2024-09-09 14:51:16.482653184  [2024-09-09 14:51:16] watchdog.Camera4       INFO    : Terminating the existing ffmpeg process...
2024-09-09 14:51:16.482655330  [2024-09-09 14:51:16] watchdog.Camera4       INFO    : Waiting for ffmpeg to exit gracefully...
2024-09-09 14:51:16.896813952  [2024-09-09 14:51:16] watchdog.Camera16        ERROR   : Ffmpeg process crashed unexpectedly for Camera16.
2024-09-09 14:51:16.896818283  [2024-09-09 14:51:16] watchdog.Camera16        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-09-09 14:51:16.896820125  [2024-09-09 14:51:16] ffmpeg.Camera16.detect   ERROR   : [tcp @ 0x55c6e9bfa2c0] Connection to tcp://192.168.1.224:554?timeout=5000000 failed: No route to host
2024-09-09 14:51:16.896821586  [2024-09-09 14:51:16] ffmpeg.Camera16.detect   ERROR   : rtsp://*:*@192.168.1.224/Streaming/channels/2: No route to host
2024-09-09 14:51:16.913765334  [2024-09-09 14:51:16] watchdog.Camera16        ERROR   : No new recording segments were created for Camera16 in the last 120s. restarting the ffmpeg record process...
2024-09-09 14:51:16.913769769  [2024-09-09 14:51:16] watchdog.Camera16        INFO    : Terminating the existing ffmpeg process...
2024-09-09 14:51:16.913771496  [2024-09-09 14:51:16] watchdog.Camera16        INFO    : Waiting for ffmpeg to exit gracefully...
2024-09-09 14:51:19.087760680  [2024-09-09 14:51:19] frigate.video                  ERROR   : Camera5: Unable to read frames from ffmpeg process.
2024-09-09 14:51:19.087839804  [2024-09-09 14:51:19] frigate.video                  ERROR   : Camera5: ffmpeg process is not running. exiting capture thread...
2024-09-09 14:51:19.563792392  [2024-09-09 14:51:19] frigate.video                  ERROR   : Camera4: Unable to read frames from ffmpeg process.
2024-09-09 14:51:19.563864510  [2024-09-09 14:51:19] frigate.video                  ERROR   : Camera4: ffmpeg process is not running. exiting capture thread...
2024-09-09 14:51:19.983803277  [2024-09-09 14:51:19] frigate.video                  ERROR   : Camera16: Unable to read frames from ffmpeg process.
2024-09-09 14:51:19.983980680  [2024-09-09 14:51:19] frigate.video                  ERROR   : Camera16: ffmpeg process is not running. exiting capture thread...

Relevant go2rtc log output

no error

FFprobe output from your camera

I don't have PPprobe command

Operating system

Debian

Install method

Docker Compose

Network connection

Wired

Camera make and model

Dahua, Hikvision, Axis

Screenshots of the Frigate UI's System metrics pages

Any other information that may be helpful

No response

[NickM-27]

you'll need to look at GPU specs and see if any single GPU can handle that many decoding sessions at the same time, depending on the resolution used for detect I am not sure which ones would be, at least not consumer grade GPU

[temuccio]

Hi @NickM-27,

Thank you for your response.

For an analytics analysis, I found this table:
Hardware Transcoding Performance.

The parameter I'm referring to is h.264 DEC Streams, which is calculated based on 1080p@20MBPS YUV 4:2:0 8-bit.
In this scenario, assuming a GeForce GTX 1050 (2GB), it seems that approximately 22 cameras at 1080p or 44 cameras at 720p could be supported.

Could you confirm if this assumption seems accurate?

[NickM-27]

yes, looks like it

[temuccio]

Perfect, thanks.