Memory consumption always at the limit

Discussions related to the 1.36.x series of ZoneMinder
Post Reply
frankz66
Posts: 46
Joined: Tue Dec 21, 2021 2:17 pm

Memory consumption always at the limit

Post by frankz66 »

Hello everyone, I'll go back to writing the same post about the problem of ZM and memory. I tried everything, but Zm always consumes a lot of memory !! My ZM has been virtualized for some time, so if someone in the proxmox environment can give me suggestions I am welcome.

I attach real situation :
Attachments
zm.png
zm.png (100.61 KiB) Viewed 3949 times
User avatar
zSprawl
Posts: 17
Joined: Tue Aug 09, 2022 2:53 am

Re: Memory consumption always at the limit

Post by zSprawl »

How is it performing? I've seen a lot of runaway memory posts recently but overall things are still working.

-S
frankz66
Posts: 46
Joined: Tue Dec 21, 2021 2:17 pm

Re: Memory consumption always at the limit

Post by frankz66 »

Hi, Zm despite excessive memory consumption (4 6 or 8 GB consumes the same), it continues to work. Sometimes I see in logs, kernel oops or rather error stacks. I restart everything and keep working.


[154427.020601] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[154427.020602] 29834 total pagecache pages
[154427.020603] 1032 pages in swap cache
[154427.020604] Swap cache stats: add 2539916, delete 2538872, find 2088928/2277668
[154427.020604] Free swap = 0kB
[154427.020604] Total swap = 2097148kB
[154427.020604] 1572728 pages RAM
[154427.020605] 0 pages HighMem/MovableOnly
[154427.020605] 28490 pages reserved
[154427.020605] 0 pages cma reserved
[154427.020606] 0 pages hwpoisoned
[154427.020606] Tasks state (memory values in pages):
[154427.020606] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[154427.020609] [ 358] 0 358 21256 707 176128 213 -250 systemd-journal
[154427.020612] [ 388] 0 388 5584 456 69632 450 -1000 systemd-udevd
[154427.020613] [ 523] 0 523 53677 4514 90112 0 -1000 multipathd
[154427.020614] [ 557] 102 557 22718 491 81920 215 0 systemd-timesyn
[154427.020615] [ 565] 100 565 6845 735 81920 228 0 systemd-network
[154427.020616] [ 567] 101 567 6132 634 86016 1017 0 systemd-resolve
[154427.020617] [ 577] 0 577 59888 435 98304 355 0 accounts-daemon
[154427.020618] [ 579] 103 579 1920 680 49152 221 -900 dbus-daemon
[154427.020619] [ 582] 0 582 20521 736 204800 16330 0 glpi-agent: wai
[154427.020620] [ 587] 0 587 20456 654 57344 66 0 irqbalance
[154427.020620] [ 592] 0 592 7418 760 94208 2009 0 networkd-dispat
[154427.020622] [ 608] 0 608 1703 491 53248 72 0 cron
[154427.020623] [ 611] 0 611 59538 741 94208 579 0 polkitd
[154427.020623] [ 615] 0 615 1629 542 49152 57 0 qemu-ga
[154427.020624] [ 622] 104 622 56079 430 81920 472 0 rsyslogd
[154427.020625] [ 628] 0 628 4376 683 73728 230 0 systemd-logind
[154427.020626] [ 632] 0 632 98937 671 139264 582 0 udisksd
[154427.020627] [ 633] 114 633 5480 531 81920 300 0 zabbix_agentd
[154427.020628] [ 641] 0 641 948 447 49152 41 0 atd
[154427.020629] [ 647] 0 647 3043 669 57344 231 -1000 sshd
[154427.020630] [ 674] 0 674 79703 628 118784 511 0 ModemManager
[154427.020630] [ 682] 0 682 60224 549 155648 1397 0 apache2
[154427.020631] [ 689] 114 689 5486 495 77824 278 0 zabbix_agentd
[154427.020632] [ 690] 114 690 5486 466 77824 324 0 zabbix_agentd
[154427.020633] [ 691] 114 691 5486 403 77824 325 0 zabbix_agentd
[154427.020639] [ 692] 114 692 5486 425 77824 320 0 zabbix_agentd
[154427.020640] [ 693] 114 693 5480 348 73728 293 0 zabbix_agentd
[154427.020640] [ 702] 0 702 26982 746 110592 1938 0 unattended-upgr
[154427.020641] [ 718] 0 718 1457 326 53248 34 0 agetty
[154427.020642] [ 735] 113 735 456507 992 1691648 153475 0 mysqld
[154427.020643] [ 1281] 0 1281 9518 470 73728 107 0 master
[154427.020644] [ 1284] 115 1284 9598 381 73728 150 0 qmgr
[154427.020645] [ 1311] 33 1311 9357 379 110592 2961 0 zmdc.pl
[154427.020645] [ 1358] 33 1358 14520 394 147456 8368 0 /usr/bin/zmcont
[154427.020646] [ 1436] 33 1436 9222 986 110592 2697 0 zmwatch.pl
[154427.020647] [ 1453] 33 1453 9121 201 114688 2863 0 zmstats.pl
[154427.020648] [ 26109] 0 26109 62353 553 106496 315 0 upowerd
[154427.020649] [ 26158] 0 26158 622 127 40960 23 0 none
[154427.020650] [ 40269] 33 40269 13518 380 151552 7211 0 zmupdate.pl
[154427.020651] [ 56673] 33 56673 60555 651 192512 1820 0 apache2
[154427.020651] [ 56674] 33 56674 60565 670 196608 1822 0 apache2
[154427.020652] [ 56714] 33 56714 10413 529 122880 4308 0 zmtelemetry.pl
[154427.020653] [ 56715] 33 56715 17001 1134 167936 9889 0 zmfilter.pl
[154427.020654] [ 56717] 33 56717 15923 1558 172032 8621 0 zmfilter.pl
[154427.020655] [ 56718] 33 56718 15927 1502 163840 8707 0 zmfilter.pl
[154427.020655] [ 56721] 33 56721 15774 1714 163840 8223 0 zmfilter.pl
[154427.020656] [ 56722] 33 56722 15096 1259 163840 8096 0 zmfilter.pl
[154427.020657] [ 56737] 33 56737 15773 1732 163840 8265 0 zmfilter.pl
[154427.020658] [ 56739] 33 56739 15769 1896 159744 8103 0 zmfilter.pl
[154427.020658] [ 76584] 33 76584 60507 581 196608 1907 0 apache2
[154427.020659] [ 76588] 33 76588 60589 524 192512 1963 0 apache2
[154427.020660] [ 82349] 33 82349 108332 19244 483328 5361 0 zmc
[154427.020660] [ 82366] 33 82366 108767 18860 475136 4846 0 zmc
[154427.020661] [ 82396] 33 82396 158580 40465 868352 22514 0 zmc
[154427.020662] [ 82671] 33 82671 60601 604 196608 1827 0 apache2
[154427.020663] [ 82775] 33 82775 60610 668 196608 1826 0 apache2
[154427.020663] [ 82777] 33 82777 60519 564 196608 1817 0 apache2
[154427.020664] [ 82778] 33 82778 60504 594 196608 1745 0 apache2
[154427.020665] [ 83897] 33 83897 60588 590 192512 1944 0 apache2
[154427.020666] [ 83939] 33 83939 60451 613 188416 1678 0 apache2
[154427.020667] [ 84233] 115 84233 9585 428 73728 127 0 pickup
[154427.020667] [ 84498] 33 84498 145426 46042 905216 24151 0 zmc
[154427.020668] [ 85470] 33 85470 1717266 1324016 12828672 190380 0 zmc
[154427.020669] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/zoneminder.service,task=zmc,pid=85470,uid=33
[154427.020687] Out of memory: Killed process 85470 (zmc) total-vm:6869064kB, anon-rss:5277036kB, file-rss:796kB, shmem-rss:18232kB, UID:33 pgtables:12528kB oom_score_adj:0
root@zone:~#
Magic919
Posts: 1381
Joined: Wed Sep 18, 2013 6:56 am

Re: Memory consumption always at the limit

Post by Magic919 »

What tuning have you done?
-
frankz66
Posts: 46
Joined: Tue Dec 21, 2021 2:17 pm

Re: Memory consumption always at the limit

Post by frankz66 »

Excuse me, I also posted sync with Zabbix and Glpi Agent clients. Anyway, can you see out of memory?
frankz66
Posts: 46
Joined: Tue Dec 21, 2021 2:17 pm

Re: Memory consumption always at the limit

Post by frankz66 »

Guys, I think it's a nightmare when it comes to memory!

Has anyone in a virtualized environment set anything in particular?


Hello everyone, I wanted to add and write it with caution, that I solved the problem of the amount of memory in a virtualized environment.

I changed the machine type (q35) and reconfigured the network.

At the moment the cluster does not report a memory consumption of 2.5GB out of 4 GB total, on the other hand I still see insufficient memory error messages from zoneminder shell (anon-rss) Kernel messages.
Attachments
new err.png
new err.png (174.31 KiB) Viewed 3786 times
err.png
err.png (134.65 KiB) Viewed 3816 times
Post Reply