Benchmarking edge computing devices for grape bunches and trunks detection using accelerated object detection single shot multibox deep learning models

Benchmarking edge computing devices for grape bunches and trunks detection using accelerated object detection single shot multibox deep learning models. Magalhães, S., C., dos Santos, F., N., Machado, P., Moreira, A., P., & Dias, J. Engineering Applications of Artificial Intelligence, 117:105604, Pergamon, 1, 2023.

Paper doi abstract bibtex

Purpose: Visual perception enables robots to perceive the environment. Visual data is processed using computer vision algorithms that are usually time-expensive and require powerful devices to process the visual data in real-time, which is unfeasible for open-field robots with limited energy. This work benchmarks the performance of different heterogeneous platforms for object detection in real-time. This research benchmarks three architectures: embedded GPU—Graphical Processing Units (such as NVIDIA Jetson Nano 2GB and 4GB, and NVIDIA Jetson TX2), TPU—Tensor Processing Unit (such as Coral Dev Board TPU), and DPU—Deep Learning Processor Unit (such as in AMD/Xilinx ZCU104 Development Board, and AMD/Xilinx Kria KV260 Starter Kit). Methods: The authors used the RetinaNet ResNet-50 fine-tuned using the natural VineSet dataset. After the trained model was converted and compiled for target-specific hardware formats to improve the execution efficiency. Conclusions and Results: The platforms were assessed in terms of performance of the evaluation metrics and efficiency (time of inference). Graphical Processing Units (GPUs) were the slowest devices, running at 3FPS to 5FPS, and Field Programmable Gate Arrays (FPGAs) were the fastest devices, running at 14FPS to 25FPS. The efficiency of the Tensor Processing Unit (TPU) is irrelevant and similar to NVIDIA Jetson TX2. TPU and GPU are the most power-efficient, consuming about 5W. The performance differences, in the evaluation metrics, across devices are irrelevant and have an F1 of about 70% and mean Average Precision (mAP) of about 60%.

@article{
 title = {Benchmarking edge computing devices for grape bunches and trunks detection using accelerated object detection single shot multibox deep learning models},
 type = {article},
 year = {2023},
 keywords = {Embedded systems,Heterogeneous platforms,Object detection,RetinaNet resNet,SSD resNet},
 pages = {105604},
 volume = {117},
 month = {1},
 publisher = {Pergamon},
 day = {1},
 id = {7439a1c4-a827-3a2c-b671-870ad812b6b1},
 created = {2023-10-27T07:49:54.635Z},
 accessed = {2023-10-27},
 file_attached = {true},
 profile_id = {f1f70cad-e32d-3de2-a3c0-be1736cb88be},
 group_id = {5ec9cc91-a5d6-3de5-82f3-3ef3d98a89c1},
 last_modified = {2023-11-06T09:35:28.084Z},
 read = {false},
 starred = {false},
 authored = {false},
 confirmed = {false},
 hidden = {false},
 private_publication = {false},
 abstract = {Purpose: Visual perception enables robots to perceive the environment. Visual data is processed using computer vision algorithms that are usually time-expensive and require powerful devices to process the visual data in real-time, which is unfeasible for open-field robots with limited energy. This work benchmarks the performance of different heterogeneous platforms for object detection in real-time. This research benchmarks three architectures: embedded GPU—Graphical Processing Units (such as NVIDIA Jetson Nano 2GB and 4GB, and NVIDIA Jetson TX2), TPU—Tensor Processing Unit (such as Coral Dev Board TPU), and DPU—Deep Learning Processor Unit (such as in AMD/Xilinx ZCU104 Development Board, and AMD/Xilinx Kria KV260 Starter Kit). Methods: The authors used the RetinaNet ResNet-50 fine-tuned using the natural VineSet dataset. After the trained model was converted and compiled for target-specific hardware formats to improve the execution efficiency. Conclusions and Results: The platforms were assessed in terms of performance of the evaluation metrics and efficiency (time of inference). Graphical Processing Units (GPUs) were the slowest devices, running at 3FPS to 5FPS, and Field Programmable Gate Arrays (FPGAs) were the fastest devices, running at 14FPS to 25FPS. The efficiency of the Tensor Processing Unit (TPU) is irrelevant and similar to NVIDIA Jetson TX2. TPU and GPU are the most power-efficient, consuming about 5W. The performance differences, in the evaluation metrics, across devices are irrelevant and have an F1 of about 70% and mean Average Precision (mAP) of about 60%.},
 bibtype = {article},
 author = {Magalhães, Sandro Costa and dos Santos, Filipe Neves and Machado, Pedro and Moreira, António Paulo and Dias, Jorge},
 doi = {10.1016/J.ENGAPPAI.2022.105604},
 journal = {Engineering Applications of Artificial Intelligence}
}

Downloads: 0

{"_id":"NNwYpEpuGEE3jaTQv","bibbaseid":"magalhes-dossantos-machado-moreira-dias-benchmarkingedgecomputingdevicesforgrapebunchesandtrunksdetectionusingacceleratedobjectdetectionsingleshotmultiboxdeeplearningmodels-2023","author_short":["Magalhães, S., C.","dos Santos, F., N.","Machado, P.","Moreira, A., P.","Dias, J."],"bibdata":{"title":"Benchmarking edge computing devices for grape bunches and trunks detection using accelerated object detection single shot multibox deep learning models","type":"article","year":"2023","keywords":"Embedded systems,Heterogeneous platforms,Object detection,RetinaNet resNet,SSD resNet","pages":"105604","volume":"117","month":"1","publisher":"Pergamon","day":"1","id":"7439a1c4-a827-3a2c-b671-870ad812b6b1","created":"2023-10-27T07:49:54.635Z","accessed":"2023-10-27","file_attached":"true","profile_id":"f1f70cad-e32d-3de2-a3c0-be1736cb88be","group_id":"5ec9cc91-a5d6-3de5-82f3-3ef3d98a89c1","last_modified":"2023-11-06T09:35:28.084Z","read":false,"starred":false,"authored":false,"confirmed":false,"hidden":false,"private_publication":false,"abstract":"Purpose: Visual perception enables robots to perceive the environment. Visual data is processed using computer vision algorithms that are usually time-expensive and require powerful devices to process the visual data in real-time, which is unfeasible for open-field robots with limited energy. This work benchmarks the performance of different heterogeneous platforms for object detection in real-time. This research benchmarks three architectures: embedded GPU—Graphical Processing Units (such as NVIDIA Jetson Nano 2GB and 4GB, and NVIDIA Jetson TX2), TPU—Tensor Processing Unit (such as Coral Dev Board TPU), and DPU—Deep Learning Processor Unit (such as in AMD/Xilinx ZCU104 Development Board, and AMD/Xilinx Kria KV260 Starter Kit). Methods: The authors used the RetinaNet ResNet-50 fine-tuned using the natural VineSet dataset. After the trained model was converted and compiled for target-specific hardware formats to improve the execution efficiency. Conclusions and Results: The platforms were assessed in terms of performance of the evaluation metrics and efficiency (time of inference). Graphical Processing Units (GPUs) were the slowest devices, running at 3FPS to 5FPS, and Field Programmable Gate Arrays (FPGAs) were the fastest devices, running at 14FPS to 25FPS. The efficiency of the Tensor Processing Unit (TPU) is irrelevant and similar to NVIDIA Jetson TX2. TPU and GPU are the most power-efficient, consuming about 5W. The performance differences, in the evaluation metrics, across devices are irrelevant and have an F1 of about 70% and mean Average Precision (mAP) of about 60%.","bibtype":"article","author":"Magalhães, Sandro Costa and dos Santos, Filipe Neves and Machado, Pedro and Moreira, António Paulo and Dias, Jorge","doi":"10.1016/J.ENGAPPAI.2022.105604","journal":"Engineering Applications of Artificial Intelligence","bibtex":"@article{\n title = {Benchmarking edge computing devices for grape bunches and trunks detection using accelerated object detection single shot multibox deep learning models},\n type = {article},\n year = {2023},\n keywords = {Embedded systems,Heterogeneous platforms,Object detection,RetinaNet resNet,SSD resNet},\n pages = {105604},\n volume = {117},\n month = {1},\n publisher = {Pergamon},\n day = {1},\n id = {7439a1c4-a827-3a2c-b671-870ad812b6b1},\n created = {2023-10-27T07:49:54.635Z},\n accessed = {2023-10-27},\n file_attached = {true},\n profile_id = {f1f70cad-e32d-3de2-a3c0-be1736cb88be},\n group_id = {5ec9cc91-a5d6-3de5-82f3-3ef3d98a89c1},\n last_modified = {2023-11-06T09:35:28.084Z},\n read = {false},\n starred = {false},\n authored = {false},\n confirmed = {false},\n hidden = {false},\n private_publication = {false},\n abstract = {Purpose: Visual perception enables robots to perceive the environment. Visual data is processed using computer vision algorithms that are usually time-expensive and require powerful devices to process the visual data in real-time, which is unfeasible for open-field robots with limited energy. This work benchmarks the performance of different heterogeneous platforms for object detection in real-time. This research benchmarks three architectures: embedded GPU—Graphical Processing Units (such as NVIDIA Jetson Nano 2GB and 4GB, and NVIDIA Jetson TX2), TPU—Tensor Processing Unit (such as Coral Dev Board TPU), and DPU—Deep Learning Processor Unit (such as in AMD/Xilinx ZCU104 Development Board, and AMD/Xilinx Kria KV260 Starter Kit). Methods: The authors used the RetinaNet ResNet-50 fine-tuned using the natural VineSet dataset. After the trained model was converted and compiled for target-specific hardware formats to improve the execution efficiency. Conclusions and Results: The platforms were assessed in terms of performance of the evaluation metrics and efficiency (time of inference). Graphical Processing Units (GPUs) were the slowest devices, running at 3FPS to 5FPS, and Field Programmable Gate Arrays (FPGAs) were the fastest devices, running at 14FPS to 25FPS. The efficiency of the Tensor Processing Unit (TPU) is irrelevant and similar to NVIDIA Jetson TX2. TPU and GPU are the most power-efficient, consuming about 5W. The performance differences, in the evaluation metrics, across devices are irrelevant and have an F1 of about 70% and mean Average Precision (mAP) of about 60%.},\n bibtype = {article},\n author = {Magalhães, Sandro Costa and dos Santos, Filipe Neves and Machado, Pedro and Moreira, António Paulo and Dias, Jorge},\n doi = {10.1016/J.ENGAPPAI.2022.105604},\n journal = {Engineering Applications of Artificial Intelligence}\n}","author_short":["Magalhães, S., C.","dos Santos, F., N.","Machado, P.","Moreira, A., P.","Dias, J."],"urls":{"Paper":"https://bibbase.org/service/mendeley/bfbbf840-4c42-3914-a463-19024f50b30c/file/5726582d-7e9a-8d8f-6378-cd39d651ce8a/full_text.pdf.pdf"},"biburl":"https://bibbase.org/service/mendeley/bfbbf840-4c42-3914-a463-19024f50b30c","bibbaseid":"magalhes-dossantos-machado-moreira-dias-benchmarkingedgecomputingdevicesforgrapebunchesandtrunksdetectionusingacceleratedobjectdetectionsingleshotmultiboxdeeplearningmodels-2023","role":"author","keyword":["Embedded systems","Heterogeneous platforms","Object detection","RetinaNet resNet","SSD resNet"],"metadata":{"authorlinks":{}},"downloads":0},"bibtype":"article","biburl":"https://bibbase.org/service/mendeley/bfbbf840-4c42-3914-a463-19024f50b30c","dataSources":["2252seNhipfTmjEBQ"],"keywords":["embedded systems","heterogeneous platforms","object detection","retinanet resnet","ssd resnet"],"search_terms":["benchmarking","edge","computing","devices","grape","bunches","trunks","detection","using","accelerated","object","detection","single","shot","multibox","deep","learning","models","magalhães","dos santos","machado","moreira","dias"],"title":"Benchmarking edge computing devices for grape bunches and trunks detection using accelerated object detection single shot multibox deep learning models","year":2023}