SmartSen: smart sensing for enhancing real-time activity recognition in phone-based interactive CPS

ABSTRACT

Using mobile devices to enhance users interaction with CPS has many potential benefits for healthcare applications. Recent research has looked at how to recognize human activities using smartphones, to indicate health status. But little attention has been paid to automatically identify the activity habits of individuals in real-time. Of course, the energy constraint in smartphones must be considered during the design of such cyber-physical recognition systems. In this paper, we propose a prediction-based smart sensing strategy that is energy efficient and works in real-time. By making use of the temporal correlation property of real-world phenomena, an adaptive k-order Markov chain based prediction algorithm is proposed to avoid continuous sensing so that significant energy savings can be achieved. The prediction results are analyzed online in real-time, to ensure that the system can track an individual's behavior pattern and provide timely response to changes in behavior. Real-world experiments using our prototype show that such recognition oriented CPS systems can not only achieve energy savings, but also converge to steady state with high individual recognition accuracy, in a real-time manner.

References

1. A. Anjum and M. U. Ilyas. Activity recognition using smartphone sensors. In IEEE Consumer Communications and Networking Conference (CCNC 2013), pages 914--919, 2013.
2. L. Bao and S. S. Intille. Activity recognition from user-annotated acceleration data. In Pervasive computing, pages 1--17. Springer, 2004.
3. T. Brezmes, J. L. Gorricho, and J. Cotrina. Activity Recognition from Accelerometer Data on a Mobile Phone. Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living, 2009.
4. A. Campbell and T. Choudhury. From smart to cognitive phones. IEEE Pervasive Computing, 11(3):7--11, 2012.
5. L. Dai and P. Basu. Energy and delivery capacity of wireless sensor networks with random duty-cycles. In Proceedings of the 2006 IEEE International Conference on Communications, volume 8, pages 3503--3510, 2006.
6. M. C. Gonzalez, C. A. Hidalgo, and A.-L. Barabasi. Understanding individual human mobility patterns. Nature, 453(7196):779--782, 2008.
7. Y. W. Jong, P. C. Hsiu, S. W. Cheng, and T. W. Kuo. A semantics-aware design for mounting remote sensors on mobile systems. In Proceedings of the 53rd IEEE/ACM Annual Design Automation Conference (DAC), June 2016.
8. A. M. Khan, Y.-K. Lee, S. Lee, and T.-S. Kim. Human activity recognition via an accelerometer-enabled-smartphone using kernel discriminant analysis. In Proceedings of IEEE 5th International Conference on Future Information Technology (FutureTech), pages 1--6, 2010.
9. A. M. Khan, Y. K. Lee, S. Y. Lee, and T. S. Kim. A triaxial accelerometer-based physical-activity recognition via augmented-signal features and a hierarchical recognizer. IEEE Transactions on Information Technology in Biomedicine, 14(5):1166 -- 1172, 2010.
10. A. Krause, M. Ihmig, E. Rankin, D. Leong, S. Gupta, D. Siewiorek, A. Smailagic, M. Deisher, and U. Sengupta. Trading off prediction accuracy and power consumption for context-aware wearable computing. In Proceedings of ISWC, pages 20--26, 2005.
11. N. C. Krishnan, D. Colbry, C. Juillard, and S. Panchanathan. Real time human activity recognition using tri-axial accelerometers. In Sensors, signals and information processing workshop, 2008.
12. J. R. Kwapisz, G. M. Weiss, and S. A. Moore. Activity recognition using cell phone accelerometers. ACM SIGKDD Explorations Newsletter, 12(2):74--82, 2011.
13. J. R. Kwapisz, G. M. Weiss, and S. A. Moore. Activity recognition using cell phone accelerometers. Proceeding of ACM SIGKDD Conference of Knowledge Discovery and, Data Mining, 12(2):74--82, 2011.
14. J. W. Lockhart and G. M. Weiss. Limitations with activity recognition methodology & data sets. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication, volume 8, pages 747--756, 2014.
15. E. Miluzzo, N. D. Lane, K. Fodor, f, R. Peterson, H. Lu, M. Musolesi, S. B. Eisenman, X. Zheng, and A. T. Campbell. Sensing meets mobile social networks: The design, implementation and evaluation of the cenceme application. In Proceedings of the International Conference on Embedded Networked Sensor Systems (SenSys), pages 337--350, 2008.
16. S.-M. Qin, H. Verkasalo, M. Mohtaschemi, T. Hartonen, and M. Alava. Patterns, entropy, and predictability of human mobility and life. PloS one, 7(12):e51353, 2012.
17. N. Ravi, N. Dandekar, P. Mysore, and M. L. Littman. Activity recognition from accelerometer data. In Proceedings of the Seventeenth Conference on Innovative Applications of Artificial Intelligence(IAAI), pages 1541--1546, 2005.
18. C. Shannon. Prediction and entropy of printed english. Bell System Technical Journal, 30(1):50 -- 64, 1951.
19. M. Shoaib, H. Scholten, and P. J. Havinga. Towards physical activity recognition using smartphone sensors. In Proceedings of the 2013 IEEE 10th International Conference on Ubiquitous Intelligence and Computing and 10th International Conference on Autonomic and Trusted, Computing (UIC/ATC), pages 80--87, 2013.
20. C. Song, Z. Qu, N. Blumm, and A.-L. Barabási. Limits of predictability in human mobility. Science, 327(5968):1018--1021, 2010.
21. V. Srinivasan and T. Phan. An accurate two-tier classifier for efficient duty-cycling of smartphone activity recognition systems. In Proceedings of the 2012 ACM Third International Workshop on Sensing Applications on Mobile Phones, 2012.
22. V. Q. Viet, H. M. Thang, and D. Choi. Adaptive energy-saving strategy for activity recognition on mobile phone. In Proceedings of the 2012 IEEE Symposium on Signal Processing and Information Technology (ISSPIT), pages 95--100, 2012.
23. W. Wu, S. Dasgupta, E. E. Ramirez, C. Peterson, and G. J. Norman. Classification accuracies of physical activities using smartphone motion sensors. Journal of medical Internet research, 14(5):e130, 2012.
24. Z. Yan, V. Subbaraju, D. Chakraborty, A. Misra, and K. Aberer. Energy-efficient continuous activity recognition on mobile phones: An activity-adaptive approach. In Proceedings of the 2012 16th Annual International Symposium on Wearable Computers (ISWC), pages 17--24, 2012.
25. J. Yang. Toward physical activity diary: motion recognition using simple acceleration features with mobile phones. In First International Workshop on Interactive Multimedia for Consumer Electronics at ACM Multimedia, pages 1--10, 2009.
26. O. Yurur, C. H. Liu, X. Liu, and W. Moreno. Adaptive sampling and duty cycling for smartphone accelerometer. In Proceedings of the 2013 IEEE 10th International Conference on Mobile Ad-Hoc and Sensor Systems (MASS), pages 511--518, 2013.
27. O. Yurur, C.-H. Liu, and W. Moreno. Unsupervised posture detection by smartphone accelerometer. Electronics Letters, 49(8):562--564, 2013.
28. P. Zappi, C. Lombriser, T. Stiefmeier, E. Farella, D. Roggen, L. Benini, and G. Tröster. Activity recognition from on-body sensors: accuracy-power trade-off by dynamic sensor selection. In Wireless sensor networks, pages 17--33. Springer, 2008.
29. Y.-L. Zheng, X.-R. Ding, C. C. Y. Poon, B. P. L. Lo, H. Zhang, X.-L. Zhou, G.-Z. Yang, N. Zhao, and Y.-T. Zhang. Unobtrusive sensing and wearable devices for health informatics. IEEE Transactions On Biomedical Engineering, 61:1538--1554, May 2014.

Index Terms

• Computer systems organization

  • Embedded and cyber-physical systems

    • Embedded systems