Home > Published Issues > 2022 > Volume 11, No. 11, November 2022 >
IJMERR 2022 Vol.11(11): 807-819

Unmanned Terrestrial Deep Stereo ConvNet Gofer Embedded with CNN Architecture

Sunil Karamchandani1, Aayush S. Parikh 2, Arman A. Lalani 1, Dhruv M. Bhavsar 1, and Gaurang R. Kamat 1
1. Electronics and Telecommunication Department, DJSCOE, Vile-Parle (W), Mumbai –400056, Maharashtra, India
2. Department of Mechanical and Manufacturing Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal – 576104, India

Abstract—The proposed project brings to life a robotic gofer with automatic speech recognition and obstacle avoidance mechanism using Deep Stereo ConvNet architecture. It is a cross between a chatbot and an unmanned driverless automobile. The physics, gesticulation, and motion of the designed gofer depends on the depth estimation, path planning, obstacle avoidance and navigation. The gofer chassis is designed using vehicle kinematics for the desired load. The bottom-up approach calculates the motor ratings, and develops the rotary encoder, wheel dimension and battery selection. The course of the gofer is deliberated using an orthogonally controlled differential drive. The microcontroller STM32F446 reads data from various sensors, communicates with ROS running on Raspberry Pi, and controls the two motors. The virtual environment for gofer is imported into a Gazebo world. A particle filtering algorithm is used for optimum tracking, CNN-based identification and control of the gofer. In the virtual environment, the gofer is tested on the realm of the school campus floor with Monte Carlo simulations and upgraded with neural network architecture using stereo images for object detection. The developed mobile application adds to the ease of gofer operation and control. The gofer contributes to the designed system as Merlin at the command of King Arthur.

Index Terms—ROS, SLAM, Raspberry Pi, Optical Encoders, Gazebo, Blender, Flutter, CNN

Cite: Aayush S. Parikh, Sunil Karamchandani, Arman A. Lalani, Dhruv M. Bhavsar, and Gaurang R. Kamat, "Unmanned Terrestrial Deep Stereo ConvNet Gofer Embedded with CNN Architecture," International Journal of Mechanical Engineering and Robotics Research, Vol. 11, No. 11, pp. 807-819, November 2022. DOI: 10.18178/ijmerr.11.11.807-819

Copyright © 2022 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.