Content based access for a massive database of human observation video

ABSTRACT

We present in this paper a CBIR system for use in a psychological study of the relationship between human movement and Dyslexia. The system allows access to up to 500 hours of video and is an example of a scientific user context. This user context requires 100% accurate indexing and retrieval for a set of specific queries. This paper presents a novel use of interactive visual and audio cues for attaining this level of indexing performance. Furthermore, the issue of motion estimation accuracy in the presence of compression artifacts is explored as part of the data integrity storage problem. In addition, content based motion analysis techniques accurate enough to parse sequences on the basis of motion and objectively evaluate that motion are investigated. The tool allows Psychologists to undertake a study that would previously be impractical and the paper presents a number of lessons gained from the ongoing work

REFERENCES

• 1: A. Albiol, L. Torres, and E. Delp. Optimum color spaces for skin detection. Image Processing, 2001. Proceedings. 2001 International Conference on, 1:122--124, October 2001.
• 2: Michael Julian Black, Robust incremental optical flow, Yale University, New Haven, CT, 1992
• 3: D. Chai and K. Ngan. Face segmentation using skin-color map in videophone applications. Circuits and Systems for Video Technology, IEEE Transactions on, 9(4):551--564, June 1999.
• 4: H. Denman , N. Rea , A. Kokaram, Content-based analysis for video from snooker broadcasts, Computer Vision and Image Understanding, v.92 n.2-3, p.176-195, November/December 2003 [doi>10.1016/j.cviu.2003.06.005]
• 5: M. Felder, J. Mason, and B. Evans. Efficient dual-tone multifrequency detection using the nonuniform discrete fourier transform. Signal Processing Letters, IEEE, 5(7):160--163, July 1998.
• 6: S. Goddard. A Teachers Window into a Child's Mind, A non-invasive approach to solving learning and behaviour problems. Fern Ridge Press, Oregon, 1996.
• 7: G. Gomez and E. Morales. Automatic feature construction and a simple rule induction algorithm for skin detection. Proc. of the ICML Workshop on Machine Learning in Computer Vision, pages 31--38, 2002.
• 8: K. Holt. Child Development: Diagnosis and Assessment. Butterworth-Heineman Ltd, 1991.
• 9: R. Illingworth. The development of the infant and young child: Normal and abnormal. Churchill Livingstone, 8th Edition, London, 1983.
• 10: A. Kokaram. Motion Picture Restoration. Springer Verlag, 1998.
• 11: M. McPhillips, P. Hepper, and G. Mulhern. Effects of replicating primary-reflex movements on specific reading difficulties in children; a randomised double-blind, controlled trial. Lancet, (355):537--41, 2000.
• 12: C. Sminchisescu. Three-Dimensional Human Modeling and Motion. Reconstruction in Monocular Video Sequences. PhD thesis, INRIA, 2004.

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.1 Content Analysis and Indexing

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval

General Terms:
Algorithms, Human Factors, Measurement

Keywords:
content retrieval, dyslexia, human body motion, tracking, video retrieval