ABSTRACT
In this paper an approach for 3D arm pose estimation from a monocular video is presented. Our proposal has been designed to provide real-time and realistic reconstruction of the user motion, as required by advanced Human Computer Interaction (HCI) applications. Both a 2D arm tracking and a 3D arm pose estimation algorithm are introduced and discussed. Tracking exploits fast and robust segmentation of the arm silhouette together with detection and tracking of skin colored regions. 3D pose estimation relies on a stick-figure arm model and the Analysis-by-Synthesis approach, but achieves real-time performance using geometrical constraints on tracking results to reduce the search space cardinality. Experiments on the animation of 3D avatars using off-the-shelf hardware demonstrate the effectiveness and real-time performance of our proposal.
- S. Askar, Y. Kondratyuk, K. Elazouzi, P. Kauff, and O. Schreer. Vision-based skin-colour segmentation of moving hands for real-time applications. Proc. of the CVMP pages 79--85, 15-16 March 2004.Google Scholar
- Y. Azoz, L. Devi, and R. Sharma. Reliable tracking of human arm dynamics by multiple cue integration and constraint fusion. Proc. of the CVPR page 905, 1998. Google ScholarDigital Library
- D. Bullock and J. Zelek. Towards real-time 3-d monocular visual tracking of human limbs in unconstrained environments. Real-Time Imaging 11(4):323--353, 2005. Google ScholarDigital Library
- L. Goncalves, E. D. Bernardo, E. Ursella, and P. Perona. Monocular tracking of the human arm in 3d. In Proc. of the ICCV page 764, 1995. Google ScholarDigital Library
- A. S. Micilotta, E.-J. Ong, and R. Bowden. Real-time upper body detection and 3d pose estimation in monoscopic images. In Proc. of the ECCV volume3, pages 139--150, 2006. Google ScholarDigital Library
- K. Mikolajczyk, C. Schmid, and A. Zisserman. Human detection based on a probabilistic assembly of robust part detectors. In Proc. of the ECCV volume I, pages 69--81, 2004.Google ScholarCross Ref
- T. B. Moeslund and E. Granum. Modelling and estimating the pose of a human arm. Mach. Vision Appl. 14(4):237--247, 2003. Google ScholarDigital Library
- T. B. Moeslund, A. Hilton, and V. Krüger. A survey of advances in vision-based human motion capture and analysis. Comput. Vis. ImageUnderst. 104(2):90--126, 2006. Google ScholarDigital Library
- J. Rehg, D. D. Morris, and T. Kanade. Ambiguities in visual tracking of articulated objects using two-and three-dimensional models. International Journal of Robotics Research 22(6):393--418, June 2003.Google ScholarCross Ref
- O. Schreer, P. Eisert, P. Kauff, R. Tanger, and R. Englert. Towards robust intuitive vision-based user interfaces. Proc. of the ICME pages 69--72, 2006.Google ScholarCross Ref
- O. Schreer, R. Tanger, P. Eisert, P. Kauff, B. Kaspar, and R. Englert. Real-time avatar animation steered by live body motion. In ICIAP volume 1, pages 147--154, 2005. Google ScholarDigital Library
- M. Siddiqui and G. Medioni. Robust real-time upper body limb detection and tracking. In Proc. of the VSSN pages 53--60, New York, NY, USA, 2006. ACM. Google ScholarDigital Library
- L. Sigal, S. Bhatia, S. Roth, M. J. Black, and M. Isard. Tracking loose-limbed people. In CVPR (1) pages 421--428, 2004.Google Scholar
- C. Sminchisescu and B. Triggs. Estimating articulated human motion with covariance scaled sampling. International Journal of Robotics Research 22(6):371--391, June 2003. Special issue on Visual Analysis of Human Movement.Google ScholarCross Ref
- P. Viola and M. Jones. Rapid object detection using a boosted cascade of simple features. Proc. of CVPR 1:511--518, 2001.Google Scholar
Index Terms
- Real-time 3d arm pose estimation from monocular video for enhanced HCI
Recommendations
Silhouette lookup for monocular 3D pose tracking
Computers should be able to detect and track the articulated 3D pose of a human being moving through a video sequence. Incremental tracking methods often prove slow and unreliable, and many must be initialized by a human operator before they can track a ...
Real-time camera pose estimation via line tracking
Real-time camera calibration has been intensively studied in augmented reality. However, for texture-less and texture-repeated scenes as well as poorly illuminated scenes, obtaining a stable calibration is still an open problem. In the paper, we propose ...
Multi-view 3D Human Pose Estimation in Complex Environment
We introduce a framework for unconstrained 3D human upper body pose estimation from multiple camera views in complex environment. Its main novelty lies in the integration of three components: single-frame pose recovery, temporal integration and model ...
Comments