Home > Published Issues > 2024 > Volume 13, No. 2, 2024 >
IJMERR 2024 Vol.13(2): 190-195
doi: 10.18178/ijmerr.13.2.190-195

Curve Fitting-Based Deformation Tracking for Vision-Based Robotic Applications

Abhaya Pal Singh 1,*, Dmytro Romanov 1, Ekrem Misimi 2, and Alex Mason 1
1. Faculty of Science and Technology, Norwegian University of Life Sciences (NMBU), Ås, Norway
2. Robotics and Intelligent Automation, SINTEF Ocean AS, Trondheim, Norway
Email: abhaya.aps@gmail.com (A.P.S.); dmytro.romanov@nmbu.no (D.R.); ekrem.misimi@sintef.no (E.M.); alex.mason@nmbu.no (A.M.)
*Corresponding author

Manuscript received June 23, 2023; revised August 14, 2023; accepted August 28, 2023; published March 8, 2024.

Abstract—Application of robotics on production lines often involves handling flexible objects (such as items of natural origin or plastic bags containing liquid/bulk substances), which makes it crucial to consider the shape of an item before and after it has been affected by robotic manipulation. Most of the time deformable items are challenging for the robot in such operations as grasping, cutting, or packaging. The objective of this paper is to track object deformations and perform a task based on this information. The paper addresses issues in tracking object deformation and proposes a solution for deformation tracking to form preliminary knowledge and scene awareness on the robot side. A curve-fitting-based method was implemented to define a region of interest using images from a RealSense D415 camera. The developed approach identifies the maximum number of aligned points and uses it to determine where the deformation occurred. The results of this research show that the deformations are efficiently tracked. Utilising the algorithm proposed in this paper, an efficient method capable of making the robot aware of the deformation present in the scene is demonstrated. This approach is applicable in domains such as food processing, healthcare, and other fields where gentle and precise manipulations are required. The method is useful in industrial applications in which deformation cannot be completely avoided but still needs to be tracked.

Keywords—camera, curve fitting, deformation, manipulation, robot, tracking, vision, control

Cite: Abhaya Pal Singh, Dmytro Romanov, Ekrem Misimi, and Alex Mason, "Curve Fitting-Based Deformation Tracking for Vision-Based Robotic Applications," International Journal of Mechanical Engineering and Robotics Research, Vol. 13, No. 2, pp. 190-195, 2024.

Copyright © 2024 by the authors. This is an open access article distributed under the Creative Commons Attribution License (CC BY-NC-ND 4.0), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.