Graph Neural Network-Based Real-Time 3D Tracking for Micro-Agent Control - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Graph Neural Network-Based Real-Time 3D Tracking for Micro-Agent Control

Résumé

Micro-surgical robotic systems are gaining prominence in minimally invasive surgery within the medical field. However, accurately tracking the position of the moving agents at the micro-scale remains a significant challenge, particularly for multi-agent systems operating in cluttered and unknown environments. Traditional image analysis methods can falter when confronted with issues such as mutual and obstacle occlusion, especially in dynamic and unstructured scenarios. In order to address this issue, this study introduces a graph-based multi-agent 3D tracking algorithm for a micro-agent control system. This algorithm integrates image information with the control inputs used to navigate the micro agents. We combine the power of Convolutional Neural Networks and Graph Neural Networks to effectively extract features from image sources, and combine them with historical data and control inputs. The primary novelty of this algorithm is its ability to make predictions when the target is occluded in the 2D detection results. The proposed system achieved a tracking error of 0.15 mm, outperforming standard model-based tracking techniques.
Fichier principal
Vignette du fichier
MARSS_GNN_Object_Tracking_final_compressed.pdf (608.92 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04587941 , version 1 (25-05-2024)

Licence

Identifiants

  • HAL Id : hal-04587941 , version 1

Citer

Yuxin Jin, Franco Piñan Basualdo, Antonio Marino, Yongfeng Mei, Paolo Robuffo Giordano, et al.. Graph Neural Network-Based Real-Time 3D Tracking for Micro-Agent Control. MARSS 2024 - International Conference on Manipulation, Automation and Robotics at Small Scales, Jul 2024, Delft, Netherlands. pp.1-6. ⟨hal-04587941⟩
26 Consultations
92 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More