Generating pictorial-based representation of mental images for video monitoring

ABSTRACT

Multi-camera systems have been widely used in many video surveillance applications. When an event happens and is monitored across multiple cameras, it is easy for an expert to generate the corresponding spatial representation to comprehend the series of event. However, it is not trivial for users new to the environment. With support from psychological evidences, we propose an approach to mimic generating pictorial-based representation of mental images when a target is moving across the views of cameras. First we conduct a ball-rolling experiment to compare this approach with others. The empirical results demonstrate that the performance of users with this approach is significantly better than others. We suggest that it is because this approach is better for users to preserve spatial representation of the environment while transiting views between cameras. Then we propose a framework to realize this approach. The demonstrations in different situations indicate the validity of such framework.

References

1. Debevec, P. and Malik, J., Modeling and Rendering Architecture from Photographs: A Hybrid Geometry-and Image- Based Approach. In Proc. of SIGGRAPH (1996), 11--20.
2. D'Esposito, M., Detre, J. A., Aguirre, G. K., Stallcup, M., Alsop, D. C., Tippet, L. J., and Farah, M. J., A Functional MRI Study of Mental Image Generation. Neuropsychologia, 35 (1997), 725--730.
3. Girgensohn, A., Shipman, F., Turner, T., and Wilcox, L., Effects of Presenting Geographic Context on Tracking Activity between Cameras. In Proc. of CHI (2007), 1167--1176.
4. Hall, D., Nascimento, J., Ribeiro, P., Andrade, E., Moreno, P., Pesnel, S., List, T., Emonet, R., Fisher, R., Santos Victor, J., and Crowley, J. L., Comparison of Target Detection Algorithms Using Adaptive Background Models. In International Workshop on Performance Evaluation of Tracking and Surveillance (2005).
5. Hartley, R. I. and Zisserman, A., Multiple View Geometry, 2 nd ed, Cambridge University Press (2004).
6. Kosslyn, S. M., Ball, T. M., and Reiser, B. J., Visual Images Preserve Metric Spatial Information: Evidence from Studies of Image Scanning. Trends in Neurosciences, 4 (1978), 47--60.
7. Medin, D., Ross, B., Markman, A., Cognitive Psychology, 3 rd ed. (2000), Harcourt College Publishers.
8. Palmer, S. Vision Science: Photons to Phenomenology, MIT Press (1999).
9. (Prati, A., Mikic, I., Trivedi, M. M., and Cucchiara, R., Detecting Moving Shadows: Algorithms and Evaluation. IEEE Transactions on PAMI, 25 (2003), 918--923.
10. Reeves, W. T., Particle systems -- A Technique for Modeling a Class of Fuzzy Objects. ACM Transactions on Graphics, 2 (1983), 91--108.
11. Seitz, S. M. and Dyer, C. R., View Morphing. In Proc. of SIGGRAPH (1996), 21--30.
12. Shepard, R. N. and Metzler, J., Mental Rotation of Three-Dimensional Objects. Science, 171 (1971), 701--703.
13. Slotnick, S. D., Thompson, W. L., and Kosslyn, S. M., Visual Mental Imagery induces Retinotopically Organized Activation of Early Visual Areas. Cerebral Cortex, 15 (2005), 1570--1583.
14. Thomas, N. J., Mental Imagery. In Zalta, E. N., ed. The Stanford Encyclopedia of Philosophy (Fall 2007). http://plato.stanford.edu/archives/fall2007/entries/mental-imagery
15. Zhang, Z., A Flexible New Technique for Camera Calibration. IEEE Transactions on PAMI, 22 (2000), 1330--1334.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)