Page 3 of 3

Re: zmevennotification object detection on edge tpu

Posted: Sun Jan 10, 2021 3:13 am
by asker
Sure. See ml_sequence here https://github.com/pliablepixels/mlapi/ ... config.ini
whether you use mlapi or not the structure is the same.

Also I’ve added more clarifications here https://zmeventnotification.readthedocs ... s-versions on how this works.

Re: zmevennotification object detection on edge tpu

Posted: Sun Jan 10, 2021 8:44 pm
by VicThor
works great with the sequence but now makes me wonder if its worth having tpu at all, how much is it run on cpu.
I saw this in the config show_models=no, changed it to yes but it does not tag the models in zm.
Is there something extra I need to do?

Re: zmevennotification object detection on edge tpu

Posted: Sun Jan 10, 2021 9:17 pm
by asker
You can inspect the logs for now - that will tell you if Yolo got invoked. In my case, Yolo isn't called much, but your case can be different.

show_models worked for me last night - however my server crashed and I can't test till end of Jan (new server will take time to arrive).
I don't recall if I made a pyzm release with the fixed code, but you should make sure you are on the latest pyzm on pip. If it doesn't work, use pyzm master.

Re: zmevennotification object detection on edge tpu

Posted: Sun Jan 10, 2021 9:22 pm
by VicThor
cheers

Re: zmevennotification object detection on edge tpu

Posted: Sun Jan 10, 2021 10:37 pm
by VicThor
Updating just pyzm did not do the trick but then I updated all pip3 packages and it works, sweet.

Re: zmevennotification object detection on edge tpu

Posted: Sun Jan 10, 2021 11:08 pm
by asker
Okay. Feel free to post samples.
I have to live life vicariously till I get a new computing environment.

Re: zmevennotification object detection on edge tpu

Posted: Mon Jan 11, 2021 8:32 pm
by VicThor
For me it's mostly yolo, coral seems to need a clearer picture with whole objects. I don`t mind it at all and I think the sequence works great.
Awesome work asker.

I was thinking about the sequence as it moves to the next step only if the first failed, what if you can run multiple models or weights regardless if it fails or not? For example 1st run object weights then run birds and so on.

Re: zmevennotification object detection on edge tpu

Posted: Tue Jan 12, 2021 2:44 am
by asker
You can do that too. Take a look at the docs I linked to above. You can change patterns per model type as well as use most as same model sequence strategy.

Re: zmevennotification object detection on edge tpu

Posted: Wed Jan 13, 2021 12:43 am
by VicThor
That's super cool, i guess there is no way to keep both detections on the image?

Doing more testing i increased no of processes for cpu and tpu both to 6 (as I got 6 cameras, 3 on mocord) and decreases tpu detection from 0.6 to 0.55 and now it's running mostly coral model, at least during the day.

However I noticed some errors in the logs as coral stopped working after a day:

/zm_detect.py[17684]: ERR [zmesdetect_m5] [Error running model: Failed to load delegate from libedgetpu.so.1#012]

It's still working but last night the logs were filled with this and coral detection stopped working all together. Restarting zm fixed the issue, for now, error still in the logs now and then.

Re: zmevennotification object detection on edge tpu

Posted: Wed Jan 13, 2021 1:07 pm
by asker
VicThor wrote:
Wed Jan 13, 2021 12:43 am
Doing more testing i increased no of processes for cpu and tpu both to 6 (as I got 6 cameras, 3 on mocord) and decreases tpu detection from 0.6 to 0.55 and now it's running mostly coral model, at least during the day.

However I noticed some errors in the logs as coral stopped working after a day:

/zm_detect.py[17684]: ERR [zmesdetect_m5] [Error running model: Failed to load delegate from libedgetpu.so.1#012]

What I noticed is doing simultaneous invocations may cause this issue. In my case, I noticed similar errors the moment I increased simultaneous invocations to 3 or more and occasionally on 2. However, I did not test it thoroughly. This is why I keep TPU to 1 as it is pretty fast and I don't mind other invocations hanging around to grab a lock while detections process one at a time.

Re: zmevennotification object detection on edge tpu

Posted: Thu Jan 14, 2021 3:28 am
by VicThor
Yea, I thought so, does not seem to be able to handle concurrency well, in fact the stick goes in a flashing light mode until re-inserted.