Mining and monitoring patterns of daily routines for assisted living in real world settings

ABSTRACT

In this paper we demonstrate a fully automated approach for discovering and monitoring patterns of daily activities. Discovering patterns of daily activities and tracking them can provide unprecedented opportunities for health monitoring and assisted living applications, especially for elderly and people with memory deficits. In contrast to most previous systems that rely on either pre-selected activities or labeled data for tracking and monitoring, we use an automated approach for activity discovery and recognition. We present a mining method that is able to find natural activity patterns in real life data, as well as variations of such patterns. We will also show how the discovered patterns can be recognized and monitored by our recognition component. In addition, we provide a visualization component to help the care-givers to better understand the activity patterns and their variations. To validate our algorithms, we use the data collected in two smart apartments.

References

1. G. Abowd and E. Mynatt. Smart Environments: Technology, Protocols, and Applications, chapter Designing for the human experience in smart environments., pages 153--174. Wiley, 2004.
2. O. Brdiczka, J. Maisonnasse, and P. Reignier. Automatic detection of interaction groups. In Proceedings of the 7th international conference on Multimodal interfaces, pages 32--36, 2005.
3. M. Chan, D. Estµeve, C. Escriba, and E. Campo. A review of smart homes-present state and future challenges. Comput. Methods Prog. Biomed., 91(1):55--81, 2008.
4. D. Cook and S. Das. Smart Environments: Technology, Protocols and Applications. Wiley Series on Parallel and Distributed Computing. Wiley-Interscience, 2004.
5. D. Cook, M. Youngblood, I. Heierman, E.O., K. Gopalratnam, S. Rao, A. Litvin, and F. Khawaja. Mavhome: an agent-based smart home. In Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, pages 521--524, March 2003.
6. F. Doctor, H. Hagras, and V. Callaghan. A fuzzy embedded agent-based approach for realizing ambient intelligence in intelligent inhabited environments.IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 35(1):55--65, Jan. 2005.
7. Y. Ephraim and N. Merhav. Hidden markov processes. IEEE Trans. Inform. Theory, 48:1518--1569, 2002.
8. T. Gu, Z. Wu, X. Tao, H. Pung,, and J. Lu. epsicar: An emerging patterns based approach to sequential, interleaved and concurrent activity recognition. In Proceedings of the IEEE International Conference on Pervasive Computing and Communication, 2009.
9. I. Guyon and A. Elissee®. An introduction to variable and feature selection. Machine Learning Research,3:1157--1182, 2003.
10. T. L. Hayes, M. Pavel, N. Larimer, I. A. Tsay, J. Nutt, and A. G. Adami. Distributed healthcare: Simultaneous assessment of multiple individuals. IEEE Pervasive Computing, 6(1):36--43, 2007.
11. S. Helal, W. Mann, H. El-Zabadani, J. King, Y. Kaddoura, and E. Jansen. The gator tech smart house: A programmable pervasive space. Computer, 38(3):50--60, 2005.
12. T. Inomata, F. Naya, N. Kuwahara, F. Hattori, and K. Kogure. Activity recognition from interactions with objects using dynamic bayesian network. In Casemans '09: Proceedings of the 3rd ACM International Workshop on Context-Awareness for Self-Managing Systems, pages 39--42, 2009.
13. L. Liao, D. Fox, and H. Kautz. Location-based activity recognition using relational markov networks. In Proceedings of the International Joint Conference on Artificial Intelligence, pages 773--778, 2005.
14. U. Maurer, A. Smailagic, D. P. Siewiorek, and M. Deisher. Activity recognition and monitoring using multiple sensors on different body positions. In BSN '06: Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks, pages 113--116, 2006.
15. I. McDowell and C. Newell. Measuring Health: A Guide to Rating Scales and Questionnaires. Oxford University Press, New York, 2nd edition, 1996.
16. J. Pei, J. Han, and W. Wang. Constraint-based sequential pattern mining: the pattern-growth methods. Journal of Intelligent Information Systems,28(2):133--160, 2007.
17. M. Philipose, K. Fishkin, M. Perkowitz, D. Patterson, D. Fox, H. Kautz, and D. Hahnel. Inferring activities from interactions with objects. IEEE Pervasive Computing, 3(4):50--57, Oct.-Dec. 2004.
18. D. Pyle. Do Smart Adaptive Systems Exist?, chapter Data Preparation and Preprocessing, pages 27--53. Springer, 2005.
19. P. Rashidi and D. J. Cook. the resident in the loop: Adapting the smart home to the user. IEEE Transactions on Systems, Man, and Cybernetics journal, Part A, 39(5):949--959, September 2009.
20. P. Rashidi, D. J. Cook, L. Holder, and M. Schmitter-Edgecombe. Discovering activities to recognize and track in a smart environment. IEEE Transaction on Knowledge and Data Engineering, in press, 2010.
21. B. Reisberg, S. Finkel, J. Overall, N. Schmidt-Gollas, S.Kanowski, H. Lehfeld, F. Hulla, S. G. Sclan, H.-U. Wilms, K. Heininger, I. Hindmarch, M. Stemmler, L. Poon, A. Kluger, C. Cooler, M. Bergener, L. Hugonot-Diener, P. H. Robert, and H. Erzigkeit. The Alzheimer's disease activities of daily living international scale (adl-is). International Psychogeriatrics, 13(02):163--181, 2001.
22. V. Rialle, C. Ollivet, C. Guigui, and C. Hervé. What do family caregivers of alzheimer's disease patients desire in smart home technologies? contrasted results of a wide survey. Methods of Information in Medicine, 47:63--9, 2008.
23. J. Rissanen. Modeling by shortest data description. Automatica, 14:465--471, 1978.
24. P.-N. Tan, M. Steinbach, and V. Kumar. Introduction to Data Mining. Adison Wesley, 2005.
25. E. M. Tapia, S. S. Intille, and K. Larson. Activity recognition in the home using simple and ubiquitous sensors. In In Pervasive, pages 158--175, 2004.
26. D. L. Vail, M. M. Veloso, and J. D. Lafferty. Conditional random fields for activity recognition. In AAMAS '07: Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems, pages 1--8, New York, NY, USA, 2007. ACM.
27. T. van Kasteren, G. Englebienne, and B. Krose. Recognizing activities in multiple contexts using transfer learning. In AAAI AI in Eldercare Symposium, 2008.
28. W. VG, O. O, C. M, and R.-M. LA. Mild cognitive impairment and everyday function: Evidence of reduced speed in performing instrumental activities of daily living. American Journal of Geriatric Psychiatry, 16(5):416--424, May 2008.
29. A. Viterbi. Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Transactions on Information Theory, 13(2):260--269, Apr 1967.
30. R. Wray and J. Laird. Variability in human modeling of military simulations. In Proceedings of the Behaviour Representation in Modeling and Simulation Conference, pages 160--169, 2003.
31. C. Wren and E. Munguia-Tapia. Toward scalable activity recognition for sensor networks. In Proceedings of the Workshop on Location and Context-Awareness, pages 218--235, 2006.

Index Terms

• Computing methodologies

  • Machine learning

    • Learning settings

• Information systems

  • Information systems applications

    • Data mining