Multiple cameras stop working roughly twice a week #13442

ItsMeRitch · 2024-08-30T15:00:15Z

ItsMeRitch
Aug 30, 2024

Hi All,

I have some cameras which randomly stop working about twice a week.

So, today for example, I wanted to review footage this morning but Frigate stopped recording two of the cameras at exactly 7am. I can view the previews and watch recordings for the cameras right up to 06:59:59 but after that, it just says "No Preview Found" when reviewing footage and for live view, it says "no frames have been received, check error log".

The two cameras are two separate brands, one Honeywell and the other Reolink. The Reolink cameras is being rebroadcasted through Scrypted cause I know Reolink can be a PITA sometimes. The other camera which stopped working is fed directly into Frigate. The cameras which stopped working are Outdoor Cam and Eves Cam

Config is as follows:

cameras:
  Outdoor_camera: # <--- this will be changed to your actual camera later
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://192.168.2.9:46737/bf0fcc11b4bc6823
          roles:
            - record
  Front_camera: # <--- this will be changed to your actual camera later
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://192.168.2.9:37912/03f6db5fbcf43f1b
          roles:
            - record
  LivingRoom_camera: # <--- this will be changed to your actual camera later
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://192.168.2.9:33057/203d8d23023dc70c
          roles:
            - record
  Porch_camera: # <--- this will be changed to your actual camera later
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://192.168.2.9:34389/0ee3118e6eaa9d18
          roles:
            - record

  Deck_camera: # <--- this will be changed to your actual camera later
    enabled: true
    ffmpeg:
      inputs:
        - path: 
            rtsp://REDACTED:[email protected]:554/cam/realmonitor?channel=1&subtype=0&unicast=true&proto=Onvif
          roles:
            - record
  Eves_camera: # <--- this will be changed to your actual camera later
    enabled: true
    ffmpeg:
      inputs:
        - path: rtsp://REDACTED:[email protected]:554/h264
          roles:
            - record

Logs are as follows:


2024-08-28 21:47:35.355171123  [2024-08-28 21:47:35] frigate.video                  ERROR   : Outdoor_camera: Unable to read frames from ffmpeg process.
2024-08-28 21:47:35.355579731  [2024-08-28 21:47:35] frigate.video                  ERROR   : Outdoor_camera: ffmpeg process is not running. exiting capture thread...
2024-08-28 21:47:36.832837635  [2024-08-28 21:47:36] watchdog.Outdoor_camera        ERROR   : Ffmpeg process crashed unexpectedly for Outdoor_camera.
2024-08-28 21:47:36.833410513  [2024-08-28 21:47:36] watchdog.Outdoor_camera        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-08-28 21:47:36.834760913  [2024-08-28 21:47:36] ffmpeg.Outdoor_camera.detect   ERROR   : [segment @ 0x615a6fa56680] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-08-28 21:47:36.834927713  [2024-08-28 21:47:36] ffmpeg.Outdoor_camera.detect   ERROR   : [segment @ 0x615a6fa56680] Non-monotonous DTS in output stream 0:0; previous: 11384, current: 11384; changing to 11385. This may result in incorrect timestamps in the output file.
2024-08-28 21:47:36.835078841  [2024-08-28 21:47:36] ffmpeg.Outdoor_camera.detect   ERROR   : [segment @ 0x615a6fa56680] Non-monotonous DTS in output stream 0:0; previous: 13144, current: 13144; changing to 13145. This may result in incorrect timestamps in the output file.
2024-08-28 21:47:36.835130444  [2024-08-28 21:47:36] ffmpeg.Outdoor_camera.detect   ERROR   : [segment @ 0x615a6fa56680] Non-monotonous DTS in output stream 0:0; previous: 13778, current: 13778; changing to 13779. This may result in incorrect timestamps in the output file.
2024-08-28 21:47:36.835182520  [2024-08-28 21:47:36] ffmpeg.Outdoor_camera.detect   ERROR   : [h264 @ 0x615a6fa63d00] left block unavailable for requested intra4x4 mode -1
2024-08-28 21:47:36.835259525  [2024-08-28 21:47:36] ffmpeg.Outdoor_camera.detect   ERROR   : [h264 @ 0x615a6fa63d00] error while decoding MB 0 105, bytestream 926
2024-08-28 21:47:36.835358609  [2024-08-28 21:47:36] ffmpeg.Outdoor_camera.detect   ERROR   : rtsp://192.168.2.9:46737/bf0fcc11b4bc6823: corrupt decoded frame in stream 0
2024-08-28 21:48:40.491052696  [2024-08-28 21:48:40] frigate.video                  ERROR   : Outdoor_camera: Unable to read frames from ffmpeg process.
2024-08-28 21:48:40.491433502  [2024-08-28 21:48:40] frigate.video                  ERROR   : Outdoor_camera: ffmpeg process is not running. exiting capture thread...
2024-08-28 21:48:43.820134974  [h264 @ 0x7041200e7c80] cabac decode of qscale diff failed at 59 59
2024-08-28 21:48:43.820308892  [h264 @ 0x7041200e7c80] error while decoding MB 59 59, bytestream 703
2024-08-28 21:48:46.871933542  [2024-08-28 21:48:46] watchdog.Outdoor_camera        ERROR   : Ffmpeg process crashed unexpectedly for Outdoor_camera.
2024-08-28 21:48:46.872311585  [2024-08-28 21:48:46] watchdog.Outdoor_camera        ERROR   : The following ffmpeg logs include the last 100 lines prior to exit.
2024-08-28 21:48:46.872577295  [2024-08-28 21:48:46] ffmpeg.Outdoor_camera.detect   ERROR   : [segment @ 0x5c17aaa3d680] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-08-28 21:48:46.872768360  [2024-08-28 21:48:46] ffmpeg.Outdoor_camera.detect   ERROR   : [h264 @ 0x5c17aaa473c0] cabac decode of qscale diff failed at 59 59
2024-08-28 21:48:46.872969223  [2024-08-28 21:48:46] ffmpeg.Outdoor_camera.detect   ERROR   : [h264 @ 0x5c17aaa473c0] error while decoding MB 59 59, bytestream 703
2024-08-28 21:48:46.873136538  [2024-08-28 21:48:46] ffmpeg.Outdoor_camera.detect   ERROR   : rtsp://192.168.2.9:46737/bf0fcc11b4bc6823: corrupt decoded frame in stream 0
2024-08-30 06:00:02.050809835  Fatal Python error: Bus error
2024-08-30 14:46:38.824701  2024-08-30 06:00:02.051908076
2024-08-30 06:00:02.051910680  Thread 0x000070411fe006c0 (most recent call first):
2024-08-30 06:00:02.051912330    File "/usr/lib/python3.9/threading.py"Fatal Python error: Bus error
2024-08-30 14:46:38.824715  2024-08-30 06:00:02.051913460
2024-08-30 06:00:02.051914828  Current thread 0x000070411f4006c0 (most recent call first):
2024-08-30 06:00:02.051916213    File "/opt/frigate/frigate/video.py", line 119 in capture_frames
2024-08-30 06:00:02.051917303  , line 312 in wait
2024-08-30 06:00:02.052949222    File   File "/opt/frigate/frigate/video.py", line 346 in run
2024-08-30 06:00:02.052951050  "/usr/lib/python3.9/multiprocessing/queues.py", line 233 in _feed
2024-08-30 06:00:02.052952067    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-08-30 06:00:02.052953048    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:02.052953920    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:38.824728  2024-08-30 06:00:02.052954703
2024-08-30 06:00:02.052955599  Current thread 0x000070411f4006c0 (most recent call first):
2024-08-30 06:00:02.052956504    File "/opt/frigate/frigate/video.py", line 119 in capture_frames
2024-08-30 06:00:02.052957454    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:02.052958371    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:38.824733  2024-08-30 06:00:02.052959043
2024-08-30 06:00:02.052959915  Thread 0x0000704128c006c0 (most recent call first):
2024-08-30 06:00:02.055138306    File "/usr/lib/python3.9/threading.py"  File "/opt/frigate/frigate/video.py", line 346 in run
2024-08-30 06:00:02.055142758    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:02.055144523    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:38.824736  2024-08-30 06:00:02.055145720
2024-08-30 06:00:02.055147162  Thread 0x000070411ea006c0 (most recent call first):
2024-08-30 06:00:02.055148864    File "/usr/lib/python3.9/multiprocessing/synchronize.py", line 261 in wait
2024-08-30 06:00:02.055150584    File "/usr/lib/python3.9/multiprocessing/synchronize.py", line 349 in wait
2024-08-30 06:00:02.055152200    File "/opt/frigate/frigate/video.py", line 195 in run
2024-08-30 06:00:04.056838728  , line 312 in wait
2024-08-30 06:00:04.056842551    File "/usr/lib/python3.9/multiprocessing/queues.py", line 233 in _feed
2024-08-30 06:00:04.056844066    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-08-30 06:00:04.056845514    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:04.056846656    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:36.843217  2024-08-30 06:00:04.056847548
2024-08-30 06:00:04.056849031  Thread 0x000070411fe006c0 (most recent call first):
2024-08-30 06:00:04.056850431    File "/usr/lib/python3.9/threading.py", line 312 in wait
2024-08-30 06:00:04.056851943    File "/usr/lib/python3.9/multiprocessing/queues.py", line 233 in _feed
2024-08-30 06:00:04.056853454    File "/usr/lib/python3.9/threading.py", line 892 in run
2024-08-30 06:00:04.056855101    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:04.056856695    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:36.843220  2024-08-30 06:00:04.056857829
2024-08-30 06:00:04.056859384  Thread 0x000070411ea006c0 (most recent call first):
2024-08-30 06:00:04.056860733    File "/usr/lib/python3.9/multiprocessing/synchronize.py", line 261 in wait
2024-08-30 06:00:04.056861941    File "/usr/lib/python3.9/multiprocessing/synchronize.py", line 349 in wait
2024-08-30 06:00:04.056863388    File "/opt/frigate/frigate/video.py", line 195 in run
2024-08-30 06:00:04.056865123    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:04.056866280    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:36.843223  2024-08-30 06:00:04.056867143
2024-08-30 06:00:04.056868184  Thread 0x000070411d8006c0 (most recent call first):
2024-08-30 06:00:04.056869689    File "/opt/frigate/frigate/log.py"  File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:04.056870837    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:36.843226  2024-08-30 06:00:04.056871721
2024-08-30 06:00:04.056872668  Thread 0x, line 95 in run
2024-08-30 06:00:04.056873762    File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:04.056874782  000070411d8006c0 (most recent call first):
2024-08-30 06:00:04.056875902    File "/opt/frigate/frigate/log.py", line 95 in run
2024-08-30 06:00:04.056877031    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:36.843229  2024-08-30 06:00:04.056877883
2024-08-30 06:00:04.056878991  Thread 0x000070415e633740 (most recent call first):
2024-08-30 06:00:04.056880190    File "/usr/lib/python3.9/threading.py", line 1049 in _wait_for_tstate_lock
2024-08-30 06:00:04.056881370    File "/usr/lib/python3.9/threading.py", line 1033 in join
2024-08-30 06:00:04.056882691    File "/opt/frigate/frigate/video.py"  File "/usr/lib/python3.9/threading.py", line 954 in _bootstrap_inner
2024-08-30 06:00:04.056883673  , line 383 in capture_camera
2024-08-30 06:00:04.056884795    File "/usr/lib/python3.9/threading.py", line 912 in _bootstrap
2024-08-30 14:46:36.843232  2024-08-30 06:00:04.056885600
2024-08-30 06:00:04.056886687  Thread 0x000070415e633740 (most recent call first):
2024-08-30 06:00:04.056887915    File "/usr/lib/python3.9/threading.py", line 1049 in _wait_for_tstate_lock
2024-08-30 06:00:04.056888928    File "/usr/lib/python3.9/threading.py", line 1033 in join
2024-08-30 06:00:04.056889994    File "/opt/frigate/frigate/video.py", line 383 in capture_camera
2024-08-30 06:00:04.056891163    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-08-30 06:00:04.056892373    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-08-30 06:00:04.056893529    File "/usr/lib/python3.9/multiprocessing/process.py", line 108 in run
2024-08-30 06:00:04.056894646    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-08-30 06:00:04.056895811    File "/usr/lib/python3.9/multiprocessing/process.py", line 315 in _bootstrap
2024-08-30 06:00:04.057591230    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-08-30 06:00:04.057593994    File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 71 in _launch
2024-08-30 06:00:04.057596291    File "/usr/lib/python3.9/multiprocessing/context.py"  File "/usr/lib/python3.9/multiprocessing/popen_fork.py", line 19 in __init__
2024-08-30 06:00:04.057597533  , line 277 in _Popen
2024-08-30 06:00:04.057598819    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-08-30 06:00:04.057600158    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-08-30 06:00:04.057601866    File "/usr/lib/python3.9/multiprocessing/context.py"  File "/opt/frigate/frigate/app.py", line 520 in start_camera_capture_processes
2024-08-30 06:00:04.057603714  , line 277 in _Popen
2024-08-30 06:00:04.057605094    File "/opt/frigate/frigate/app.py", line 696 in start
2024-08-30 06:00:04.057606454    File "/usr/lib/python3.9/multiprocessing/context.py", line 224 in _Popen
2024-08-30 06:00:04.057608030    File "/usr/lib/python3.9/multiprocessing/process.py", line 121 in start
2024-08-30 06:00:04.057609616    File   File "/opt/frigate/frigate/__main__.py", line 17 in <module>
2024-08-30 06:00:04.057611234  "/opt/frigate/frigate/app.py", line 520 in start_camera_capture_processes
2024-08-30 06:00:04.057612762    File "/opt/frigate/frigate/app.py", line 696 in start
2024-08-30 06:00:04.057614374    File "/usr/lib/python3.9/runpy.py"  File "/opt/frigate/frigate/__main__.py", line 17 in <module>
2024-08-30 06:00:04.057615852    File "/usr/lib/python3.9/runpy.py", line 87 in _run_code
2024-08-30 06:00:04.057617578  , line 87 in _run_code
2024-08-30 06:00:04.057619330    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-08-30 06:00:04.057620924    File "/usr/lib/python3.9/runpy.py", line 197 in _run_module_as_main
2024-08-30 14:42:50.548221158  [2024-08-30 14:42:50] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:42:50.603638256  [2024-08-30 14:42:50] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:42:51.712923173  [2024-08-30 14:42:51] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:42:56.137541131  [2024-08-30 14:42:56] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:42:56.408715929  [2024-08-30 14:42:56] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:42:57.462064326  [2024-08-30 14:42:57] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:42:59.237808339  [2024-08-30 14:42:59] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:42:59.919002281  [2024-08-30 14:42:59] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:43:00.974147300  [2024-08-30 14:43:00] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:43:01.816866058  [2024-08-30 14:43:01] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:43:02.018960087  [2024-08-30 14:43:02] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:43:02.283851568  [2024-08-30 14:43:02] frigate.api.media              ERROR   : No recordings found for Outdoor_camera during the requested time range
2024-08-30 14:43:04.660681320  [2024-08-30 14:43:04] frigate.api.media              WARNING : Recording clip is missing or empty: /media/frigate/recordings/2024-08-30/05/Outdoor_camera/00.00.mp4

Any advice appreciated

N.B. A quick reboot fixes the issue temporarily

NickM-27 · 2024-08-30T15:01:26Z

NickM-27
Aug 30, 2024
Collaborator Sponsor

2024-08-30 06:00:02.050809835 Fatal Python error: Bus error

https://docs.frigate.video/troubleshooting/faqs#fatal-python-error-bus-error

4 replies

ItsMeRitch Aug 30, 2024
Author

@NickM-27 You're a star. Would it be crazy for me to set this to something large so i can set it and forget it? eg, settings it to 512MB or 1GB? (6 cameras, 2 of which record in 4k)

NickM-27 Aug 30, 2024
Collaborator Sponsor

no, the space is not used unless it is needed

ItsMeRitch Aug 30, 2024
Author

Great thank you. And one last thing, I take it the reason the SHM usage is so low atm is because it stopped two of the cameras?

NickM-27 Aug 30, 2024
Collaborator Sponsor

no, the SHM will be low most of the time, but it can peak at certain times

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Multiple cameras stop working roughly twice a week #13442

{{title}}

Replies: 1 comment 4 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Multiple cameras stop working roughly twice a week #13442

ItsMeRitch Aug 30, 2024

Replies: 1 comment · 4 replies

NickM-27 Aug 30, 2024 Collaborator Sponsor

ItsMeRitch Aug 30, 2024 Author

NickM-27 Aug 30, 2024 Collaborator Sponsor

ItsMeRitch Aug 30, 2024 Author

NickM-27 Aug 30, 2024 Collaborator Sponsor

ItsMeRitch
Aug 30, 2024

Replies: 1 comment 4 replies

NickM-27
Aug 30, 2024
Collaborator Sponsor

ItsMeRitch Aug 30, 2024
Author

NickM-27 Aug 30, 2024
Collaborator Sponsor

ItsMeRitch Aug 30, 2024
Author

NickM-27 Aug 30, 2024
Collaborator Sponsor