Raspberry pi Object Detection with Intel Neural Compute Stick and OpenVINO

This project showcases Object Detection on edge device.

We use Raspberry pi 4B board with Intel NCS ( Neural Compute Stick ) and OpenVINO Library and Source code from Intel AI.

Hardware

· Raspberry Pi Board (4B )
· Intel Neural Compute Stick 2
· SD Card 32GB
· 5V DC. 2A Power Supply

Software

· OS Raspbien 10 ( Buster )
· Python 3.7.3
· OpenVINO Toolkit 2019.R3
· OpenCV 4.0.0

Machine Learning Object Detection Model : Mobilenet SSD V2

Run Python Code ( Async Mode )

Async API usage can improve overall frame-rate of the application, because rather than wait for inference to complete, the app can continue doing things on the host, while accelerator is busy.

This and other performance implications and tips for the Async API are covered in the Optimization Guide.

Other demo objectives are:

Video as input support via OpenCV*
Visualization of the resulting bounding boxes and text labels (from the .labels file) or class number (if no file is provided)

Video Test : 960x540 pixels

Total frame : 301 frames

Total Inference time : 12.44 sec

Average performance : 24.20 fps

Run Python Code ( Sync Mode )

Video Test : 960x540 pixels

Total frame : 301 frames

Total Inference time : 24.96 sec

Average performance : 12.06 fps

OpenVINO Toolkit

Now We try to use OpenVINO 2020.3 compare with OpenVINO 2019 R3.

OpenVINO 2020.3 frame rate is a little bit lower than OpenVINO 2019 R3.

Comparison

Async vs Sync Mode

This is my experiment may something was wrong.

YouTube Video

Raspberry pi Object Detection with Intel Neural Compute Stick and OpenVINO ( 2020.3 )

https://youtu.be/1vabCtxp298

Compare Raspberry pi Object Detection Intel NCS ( Async vs. Sync mode )

https://youtu.be/qhmE80dR-dQ

Raspberry pi Object Detection with Intel Neural Compute Stick ( Sync mode )

https://youtu.be/Sd4r9YmxSPs

Raspberry pi Object Detection with Intel Neural Compute Stick ( Async mode )

https://youtu.be/kHG156Ga_Xc

Compare Raspberry pi Object Detection ( TensorFlow vs. TensorFlow-lite )

https://youtu.be/qCYngmeAkqQ

Raspberry pi Object Detection with TensorFlow-lite ( INT8 )

https://youtu.be/7TLjkfXVwoI

Raspberry pi Object Detection with TensorFlow ( FP32 )

https://youtu.be/m3ffxON6qlo

Reference

Raspberry pi OpenVINO with Intel Movidius ( Neural Compute Stick )

http://raspberrypi4u.blogspot.com/2019/04/raspberry-pi-openvino-intel-movidius.html

Install OpenVINO™ toolkit for Raspbian* OS

https://docs.openvino.ai/latest/openvino_docs_install_guides_installing_openvino_raspbian.html

Object Detection Python* Demo

https://docs.openvino.ai/latest/omz_demos_object_detection_demo_python.html

Model ( SSD MobileNet )

https://docs.openvino.ai/latest/omz_models_model_ssd_mobilenet_v1_coco.html

https://docs.openvino.ai/latest/omz_models_model_ssdlite_mobilenet_v2.html

OpenVINO Optimization

https://docs.openvino.ai/latest/openvino_docs_optimization_guide_dldt_optimization_guide.html

 
 Adun Nantakaew อดุลย์ นันทะแก้ว 081-6452400 
 LINE : adunnan
 FaceBook : https://www.facebook.com/adun.nantakaew/
 Youtube    : https://www.youtube.com/channel/UCw3VVy4wOsb8a0a1YYqJAPg
 Web Blog  : http://raspberrypi4u.blogspot.com/
 Website   : https://softpower.tech