Professor of School of Engineering, Design and Built Environment, Western Sydney University, Australia. His research interests cover Industry 4.0, Additive Manufacturing, Advanced Engineering Materials and Structures (Metals and Composites), Multi-scale Modelling of Materials and Structures, Metal Forming and Metal Surface Treatment.
2024-02-24
2024-01-04
2023-11-02
Abstract—Towards the actualization of autonomous switch operation method for the disaster response robot, it is necessary to estimate the position and orientation of the switch in the site. This paper proposes a method for estimating switch orientation information based on the RGB-D sensor information attached to the disaster response robot. The flow of the proposed method in this paper consists of the following three stages. (1) Acquisition of RGB-D information of the switch area using the detection result of YOLOv3. (2) Position estimation of switch operation part by CNN from RGB-D information of switch area. (3) Estimation of switch orientation information using switch operation part position information and information on wall plane on which the switch exists. In the experiment, the proposed method was applied to three types of switch boxes, and the calculation results of the orientation information were evaluated. It was found from the experimental results that the calculation with sufficient accuracy is possible.
