Abstract—The proposed project brings to life a robotic gofer with automatic speech recognition and obstacle avoidance mechanism using Deep Stereo ConvNet architecture. It is a cross between a chatbot and an unmanned driverless automobile. The physics, gesticulation, and motion of the designed gofer depends on the depth estimation, path planning, obstacle avoidance and navigation. The gofer chassis is designed using vehicle kinematics for the desired load. The bottom-up approach calculates the motor ratings, and develops the rotary encoder, wheel dimension and battery selection. The course of the gofer is deliberated using an orthogonally controlled differential drive. The microcontroller STM32F446 reads data from various sensors, communicates with ROS running on Raspberry Pi, and controls the two motors. The virtual environment for gofer is imported into a Gazebo world. A particle filtering algorithm is used for optimum tracking, CNN-based identification and control of the gofer. In the virtual environment, the gofer is tested on the realm of the school campus floor with Monte Carlo simulations and upgraded with neural network architecture using stereo images for object detection. The developed mobile application adds to the ease of gofer operation and control. The gofer contributes to the designed system as Merlin at the command of King Arthur.