Unexpected zone minder crash on Ubuntu at random time.

[vianez]

Hello, I'm new at zone minder and I'm tring to set it up for domestic use. I have got 8 cameras dlink dcs 932 and 942 all set up as remote ffmpeg device capturing images.

All is working fine and all cameras record correctly to disk but after random time zone minder crash. It happens after minutes or after hours.

I got this on logs but I can't understand to what is related the issue.

It seems that zone minder checks if all the MySQL tables are correct and the sanity check failed. So it kills all the processes.

Can you please give me a hint?

Thank you.

Jul 24 00:34:27 zone zmc_m5[4827]: ERR [Select error: Interrupted system call]
Jul 24 00:34:27 zone zmc_m5[4827]: ERR [Unable to read content]
Jul 24 00:34:27 zone zmc_m5[4827]: ERR [Unable to get response, disconnecting]
Jul 24 00:34:27 zone zmdc[2478]: INF ['zmc -m 5' exited normally]
Jul 24 00:34:30 zone zma_m1[2834]: INF [PRVB-I: 233000 - Analysing at 15.15 fps]
Jul 24 00:34:37 zone zmwatch[2826]: INF [Restarting capture daemon for SFDP-S, shared data not valid]
Jul 24 00:34:37 zone zmdc[2478]: INF ['zmc -m 5' starting at 16/07/24 00:34:37, pid = 4845]
Jul 24 00:34:37 zone zmdc[4845]: INF ['zmc -m 5' started at 16/07/24 00:34:37]
Jul 24 00:34:37 zone undef[4845]: INF [No Server ID or Name specified in config. Not using Multi-Server Mode.]
Jul 24 00:34:37 zone zmc_m5[4845]: INF [Starting Capture version 1.29.0]
Jul 24 00:34:47 zone zmwatch[2826]: INF [Restarting capture daemon for SFDP-E, time since last capture 7 seconds (1469313287-1469313280)]
Jul 24 00:34:47 zone zmdc[2478]: INF ['zmc -m 4' sending stop to pid 4801 at 16/07/24 00:34:47]
Jul 24 00:34:48 zone zmc_m4[4801]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:34:48 zone zmc_m4[4801]: ERR [Select error: Interrupted system call]
Jul 24 00:34:48 zone zmc_m4[4801]: ERR [Unable to read content]
Jul 24 00:34:48 zone zmc_m4[4801]: ERR [Unable to get response, disconnecting]
Jul 24 00:34:48 zone zmdc[2478]: INF ['zmc -m 4' exited normally]
Jul 24 00:34:58 zone zmwatch[2826]: INF [Restarting capture daemon for SFDP-I, time since last capture 6 seconds (1469313298-1469313292)]
Jul 24 00:34:58 zone zmdc[2478]: INF ['zmc -m 2' sending stop to pid 4835 at 16/07/24 00:34:58]
Jul 24 00:34:58 zone zmc_m2[4835]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:02 zone zmc_m1[2760]: INF [PRVB-I: 235000 - Capturing at 14.93 fps]
Jul 24 00:35:04 zone zmdc[2478]: WAR ['zmc -m 2' has not stopped at 16/07/24 00:35:04. Sending KILL to pid 4835]
Jul 24 00:35:04 zone zmdc[2478]: INF ['zmc -m 2' exited normally]
Jul 24 00:35:05 zone zmwatch[2826]: INF [Restarting capture daemon for SFDP-E, shared data not valid]
Jul 24 00:35:06 zone systemd[1]: zoneminder.service: Main process exited, code=exited, status=4/NOPERMISSION
Jul 24 00:35:06 zone zmwatch[2826]: ERR [Unable to run "/usr/bin/zmdc.pl restart zmc -m 4", output is "Unable to connect to server"]
Jul 24 00:35:06 zone zmpkg[4852]: INF [Sanity checking States table...]
Jul 24 00:35:06 zone zmpkg[4852]: INF [Command: stop]
Jul 24 00:35:08 zone systemd[1]: zoneminder.service: Control process exited, code=exited status=1
Jul 24 00:35:08 zone zma_m2[4703]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m5[3093]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m1[2834]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zmc_m3[4840]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m4[3653]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zmc_m5[4845]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m3[2762]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m6[2774]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m7[2792]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m8[2805]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zmc_m8[2804]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zmc_m7[2791]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zmc_m1[2760]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m2[4703]: INF [SFDP-I: 302 - Closing event 815, shutting down]
Jul 24 00:35:09 zone zmc_m6[2771]: INF [Got signal 15 (Terminated), exiting]
Jul 24 00:35:09 zone zma_m6[2774]: INF [SFDP-C: 40643 - Closing event 811, shutting down]
Jul 24 00:35:09 zone zma_m1[2834]: INF [PRVB-I: 233562 - Closing event 808, shutting down]
Jul 24 00:35:09 zone zma_m4[3653]: INF [SFDP-E: 12806 - Closing event 814, shutting down]
Jul 24 00:35:09 zone zmc_m3[4840]: ERR [Select error: Interrupted system call]
Jul 24 00:35:09 zone zma_m5[3093]: INF [SFDP-S: 6681 - Closing event 813, shutting down]
Jul 24 00:35:09 zone zma_m3[2762]: INF [SFDP-G: 10836 - Closing event 812, shutting down]
Jul 24 00:35:09 zone zma_m7[2792]: INF [SFDP-D: 54468 - Closing event 810, shutting down]
Jul 24 00:35:09 zone zma_m8[2805]: INF [SHHQ-I: 155443 - Closing event 809, shutting down]
Jul 24 00:35:09 zone zmc_m3[4840]: ERR [Unable to read content]
Jul 24 00:35:09 zone zmc_m3[4840]: ERR [Unable to get response, disconnecting]
Jul 24 00:35:14 zone systemd[1]: zoneminder.service: Unit entered failed state.
Jul 24 00:35:14 zone systemd[1]: zoneminder.service: Failed with result 'exit-code'.

[mikb]

I don't know the answer, but this is at least the third time I've seen this kind of behaviour reported -- it's not just you. Or it's a big co-incidence!

viewtopic.php?f=34&t=24974&p=95404&hili ... %22#p95404

viewtopic.php?f=34&t=25037&p=95403&hili ... %22#p95403

viewtopic.php?f=32&t=23486&p=95255&hili ... %22#p95255

Zoneminder stumbles, falls, and stays down with the ZM service marked as failed

[vianez]

I have read on the thread you suggest me that one of the users was using Ubuntu 16 and i have got the same problem over that distro.

Can it be something system related? should be interesting to debut this problem. Are the developers warned about?

[knight-of-ni]

This thread has been moved to the 1.29.0 forum since your logs indicate that is the version you are running.

ZoneMinder starting fine but crashing or stopping at random later times is always a result of overdriving your system. This is not a bug. You need to figure out what resource you are exhausting: memory, cpu, disk i/o, network, etc. Mysql can bottleneck and cause the same symptoms as well.

Currently, there is not enough information given to know where the problem is occuring. The OP must closely monitor system resources and determine what is being overtaxed.

[vianez]

Ok thank you.

I have setup mrtg to monitoring RAM/CPU load so maybe it can help to understand what is goin on. Btw have you got any suggestion to upgrade to 1.30 on ubuntu? There is a updated package?

[vianez]

Nothing new, there is no correlation between load and zone minder crash.

What can i say is that my CPU is overloaded, the average load is 78% so maybe is not enough.

I attacch MRTG report:



The ZM crash are clear: around 9 and around 2pm