Improving Hand Motion Recognition in Robot-assisted Endovascular Surgery with Resolution-based Dynamic Time Warping
No Thumbnail Available
Date
2024-11-25
Authors
Olatunji M.O.
Toluwanimi O.A.
Wenke, D.
Wenjing, D.
Lei Wang
Journal Title
Journal ISSN
Volume Title
Publisher
MIRG
Abstract
Hand motion recognition is pivotal for enhancing skill learning in endovascular surgery. However, catheterization procedures typically involve multimodal sources that introduce data dissimilarities, leading to unstable and poor performance in learning-based methods used for recognizing surgical tasks. This study proposes a resolution-based dynamic time warping (rDTW) method for aligning multimodal signals to improve hand motion recognition in endovascular surgery. The rDTW model is designed to align multimodal signals from wearable sensors, referencing the resolution of a unique source. The reference signal traces the events, creating a consistent progression that can localize a surgeon’s hand motions across all signals. Other signals are stretched or folded to match the reference timeline, facilitating event localization relative to the reference signal. By preprocessing multimodal signals from 33 catheterization trials, we show that the proposed rDTW method enhances hand motion recognition performance in two neural network models. When the data was used directly for the motion recognition task without signal warping, a performance decrease of 2.59% was observed. Also, the rDTW method exhibits higher data similarity index and lower warping time compared to three existing DTW techniques, showing its effectiveness in aligning multimodal signals for surgeons’ hand motion recognition.
Description
Scholarly article
Keywords
Citation
Olatunji M. O., Toluwanimi O. A., Wenke Duan, Wenjing D., & Lei W. (2024). “Improving Hand Motion Recognition in Robot-assisted Endovascular Surgery with Resolution-based Dynamic Time Warping". In Proceedings of the International Conference on Artificial Intelligence and Robotics (MIRG-ICAIR 2024), pp. 131-139, MIRG