Hiring in life sciences? Share your open positions with our professional community. Read more Close

Advertisement

An Adaptive IMU-Visual Multimodal Fusion System for Real-Time Exercise Recognition and Movement Quality Assessment.

Created on 01 Oct 2026

Authors

Zhaoyang Gu, Ruopeng Yang, Yongqi Shi, Dongxu Dai, Chaoyang Li, Bo Huang, Kaige Jiao, Yu Tao, Yongqi Wen, Yihao Zhong, Chen He

Published in

Sensors (Basel, Switzerland). Volume 26. Issue 18. Sep 15, 2026. Epub Sep 15, 2026.

Abstract

Exercise recognition and movement quality assessment remain challenging in supervised exercise training, particularly under viewpoint changes and self-occlusion. Vision-based methods provide spatial posture information but are susceptible to keypoint loss, whereas inertial sensing is less affected by occlusion but provides limited information about global posture geometry. This study presents a dual-stream prototype that combines a nine-axis inertial measurement unit (IMU) with vision-based pose estimation. A 1DCNN-LSTM branch models inertial dynamics, a custom keypoint temporal branch models normalized pose sequences, and a confidence-gated rule adjusts their contributions according to visual keypoint reliability. Owing to the absence of a public synchronized multi-view IMU-vision exercise dataset with the required protocol, we constructed IMV-Exercise, comprising 10 participants, three exercises, and 900 repetition-level samples with side-, front-, and posterior-view recordings. The system achieved 96.0% exercise recognition accuracy under leave-one-subject-out cross-validation. In a separate viewpoint-specific evaluation, the fused output achieved 91.2% action-window accuracy under posterior viewing. Across 50 online trials, the reported recognition accuracy was 96.0%, the mean end-to-end latency was 195 ms, and the recorded maximum was below 210 ms. These results establish feasibility within the studied cohort and exercises; broader generalization and feedback effectiveness require larger, independently controlled evaluations.

PMID:
42817415
Bibliographic data and abstract were imported from PubMed on 01 Oct 2026.

Read full publication at:
Please sign in to see all details.

Advertisement

Stats

  • Community rating n/a 0 votes
  • Reviewers' rating n/a 0 votes
  • Your rating

1-terrible, 9-excellent. How would you rate this publication? Sign in in to submit your rating.

  • Recommendations n/a n/a positive of 0 vote(s)
  • Views 13
  • Comments 0

Recommended by

  • No recommendations yet.

Post a comment

You need to be signed in to post comments. You can sign in here.

Comments

There are no comments yet.

Advertisement