A sensory grammar for inferring behaviors in sensor networks

ABSTRACT

The ability of a sensor network to parse out observable activities into a set of distinguishable actions is a powerful feature that can potentially enable many applications of sensor networks to everyday life situations. In this paper we introduce a framework that uses a hierarchy of Probabilistic Context Free Grammars (PCFGs) to perform such parsing. The power of the framework comes from the hierarchical organization of grammars that allows the use of simple local sensor measurements for reasoning about more macroscopic behaviors. Our presentation describes how to use a set of phonemes to construct grammars and how to achieve distributed operation using a messaging model. The proposed framework is flexible. It can be mapped to a network hierarchy or can be applied sequentially and across the network to infer behaviors as they unfold in space and time. We demonstrate this functionality by inferring simple motion patterns using a sequence of simple direction vectors obtained from our camera sensor network testbed.

REFERENCES

• 1: J. K. Aggarwal , Sangho Park, Human Motion: Modeling and Recognition of Actions and Interactions, Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium on (3DPVT'04), p.640-647, September 06-09, 2004 [doi>10.1109/3DPVT.2004.75]
• 2: H. Bunke and T. Caelli. Hidden Markov Models: Applications in Computer Vision. World-Scientific, 2001.
• 3: G. D. Forney. The viterbi algorithm. In Proc. IEEE, vol. 61, pp. 268--178, March 1973.
• 4: W. Hu, T. Tan, L. Wang, and S. Maybank. A survey on visual surveillance of object motion and behaviors. IEEE Transactions on Systems, Man and Cybernetics Part C, 34(3):334--352, August 2004.
• 5: L. Liao, D. Fox, and H. Kautz. Learning and inferring transportation routines. In Proc. of the Nineteenth National Conference on Artificial Intelligence, 2004.
• 6: L. Liao, D. J. Patterson, D. Fox, and H. Kautz. Behavior Recognition in Assisted Cognition. In Proceedings The AAAI-04 Workshop on Supervisory Control of Learning and Adaptive Systems, 2004.
• 7: D. Lymberopoulos, A. Barton-Sweeney, and A. Savvides. Sensor localization and camera calibration using low resolution cameras. Technical Report ENALAB 080501, Yale University, 2005.
• 8: Dimitrios Lymberopoulos , Andreas Savvides, XYZ: a motion-enabled, power aware sensor node platform for distributed sensor network applications, Proceedings of the 4th international symposium on Information processing in sensor networks, April 24-27, 2005, Los Angeles, California
• 9: A. Ogale, A. Karapurkar, and Y. Aloimonos. View-invariant modeling and recognition of human actions using grammars. Workshop on Dynamical Vision at ICCV'05, October 2005.
• 10: Mark Paskin , Carlos Guestrin , Jim McFadden, A robust architecture for distributed inference in sensor networks, Proceedings of the 4th international symposium on Information processing in sensor networks, April 24-27, 2005, Los Angeles, California
• 11: D. J. Patterson, L. Liao, D. Fox, and H. Kautz. Inferring High-Level Behavior from Low-Level Sensors. In A. Dey, A. Schmidt, and J. F. McCarthy, editors, Proceedings of UBICOMP 2003: The Fifth International Conference on Ubiquitous Computing, volume LNCS 2864, pages 73--89. Springer-Verlag, 2003.
• 12: L. R. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. In Proc. IEEE, Vol.77, No. 2, pp. 257--286, February 1989.
• 13: M. Valera and S. Velastin. Intelligent distributed surveillance systems: a review. IEE Proceedings on Vision, Image and Signal Processing, 152(2):192--204, April 2005.
• 14: L. Wang, W. Hu, and T. Tan. Recent developments in human motion analysis. Pattern recognition, 36:585--601, 2003.
• 15: C. S. Wetherell, Probabilistic Languages: A Review and Some Open Questions, ACM Computing Surveys (CSUR), v.12 n.4, p.361-379, Dec. 1980 [doi>10.1145/356827.356829]

INDEX TERMS

Primary Classification:
  C. Computer Systems Organization
  C.3 SPECIAL-PURPOSE AND APPLICATION-BASED SYSTEMS
      Subjects: Real-time and embedded systems

General Terms:
Algorithms, Human Factors

Keywords:
PCFG, behavior identification, human activity, sensor grammars, sensor networks