TY - JOUR
T1 - Optimising robotic operation speed with edge computing via 5G network
T2 - Insights from selective harvesting robots
AU - Zahidi, Usman A.
AU - Khan, Arshad
AU - Zhivkov, Tsvetan
AU - Dichtl, Johann
AU - Li, Dom
AU - Parsa, Soran
AU - Hanheide, Marc
AU - Cielniak, Grzegorz
AU - Sklar, Elizabeth I.
AU - Pearson, Simon
AU - Ghalamzan-E., Amir
N1 - Funding Information:
The authors are grateful to the United Kingdom Research and Innovation (UKRI) for supporting this research through several grants. These grants are provided under UKRI Research England Lincoln Agri Robotics program, UKRI Research England CERES Agri-tech AI Unleashed program, and Robofruit, URKI Innovate UK Fastpick grant no. 99863, and UKRI EPSRC AgriForwards CDT. We are also thankful to the staff at the University of Lincoln, particularly Joni Appleton for the project management and Swati Megha, Luke Mahoney, and Jonathan Trotter for facilitation during field tests.
Funding Information:
The authors are grateful to the United Kingdom Research and Innovation (UKRI) for supporting this research through several grants. These grants are provided under UKRI Research England Lincoln Agri Robotics program, UKRI Research England CERES Agri\u2010tech AI Unleashed program, and Robofruit, URKI Innovate UK Fastpick grant no. 99863, and UKRI EPSRC AgriForwards CDT. We are also thankful to the staff at the University of Lincoln, particularly Joni Appleton for the project management and Swati Megha, Luke Mahoney, and Jonathan Trotter for facilitation during field tests.
Publisher Copyright:
© 2024 The Author(s). Journal of Field Robotics published by Wiley Periodicals LLC.
PY - 2024/12/1
Y1 - 2024/12/1
N2 - Selective harvesting by autonomous robots will be a critical enabling technology for future farming. Increases in inflation and shortages of skilled labor are driving factors that can help encourage user acceptability of robotic harvesting. For example, robotic strawberry harvesting requires real-time high-precision fruit localization, three-dimensional (3D) mapping, and path planning for 3D cluster manipulation. Whilst industry and academia have developed multiple strawberry harvesting robots, none have yet achieved human–cost parity. Achieving this goal requires increased picking speed (perception, control, and movement), accuracy, and the development of low-cost robotic system designs. We propose the edge-server over 5G for Selective Harvesting (E5SH) system, which is an integration of high bandwidth and low latency Fifth-Generation (5G) mobile network into a crop harvesting robotic platform, which we view as an enabler for future robotic harvesting systems. We also consider processing scale and speed in conjunction with system environmental and energy costs. A system architecture is presented and evaluated with support from quantitative results from a series of experiments that compare the performance of the system in response to different architecture choices, including image segmentation models, network infrastructure (5G vs. Wireless Fidelity), and messaging protocols, such as Message Queuing Telemetry Transport and Transport Control Protocol Robot Operating System. Our results demonstrate that the E5SH system delivers step-change peak processing performance speedup of above 18-fold than a standalone embedded computing Nvidia Jetson Xavier NX system.
AB - Selective harvesting by autonomous robots will be a critical enabling technology for future farming. Increases in inflation and shortages of skilled labor are driving factors that can help encourage user acceptability of robotic harvesting. For example, robotic strawberry harvesting requires real-time high-precision fruit localization, three-dimensional (3D) mapping, and path planning for 3D cluster manipulation. Whilst industry and academia have developed multiple strawberry harvesting robots, none have yet achieved human–cost parity. Achieving this goal requires increased picking speed (perception, control, and movement), accuracy, and the development of low-cost robotic system designs. We propose the edge-server over 5G for Selective Harvesting (E5SH) system, which is an integration of high bandwidth and low latency Fifth-Generation (5G) mobile network into a crop harvesting robotic platform, which we view as an enabler for future robotic harvesting systems. We also consider processing scale and speed in conjunction with system environmental and energy costs. A system architecture is presented and evaluated with support from quantitative results from a series of experiments that compare the performance of the system in response to different architecture choices, including image segmentation models, network infrastructure (5G vs. Wireless Fidelity), and messaging protocols, such as Message Queuing Telemetry Transport and Transport Control Protocol Robot Operating System. Our results demonstrate that the E5SH system delivers step-change peak processing performance speedup of above 18-fold than a standalone embedded computing Nvidia Jetson Xavier NX system.
KW - agricultural robotics
KW - path planning
KW - point cloud plane segmentation
UR - http://www.scopus.com/inward/record.url?scp=85197505401&partnerID=8YFLogxK
U2 - 10.1002/rob.22384
DO - 10.1002/rob.22384
M3 - Article
AN - SCOPUS:85197505401
VL - 41
SP - 2771
EP - 2789
JO - Journal of Field Robotics
JF - Journal of Field Robotics
SN - 1556-4959
IS - 8
ER -