Connecting personal-scale sensing and networked community behavior to infer human activities

ABSTRACT

Advances in mobile and wearable devices are making it feasible to deploy sensing systems at a large-scale. However, slower progress is being made in activity recognition which remains often unreliable in everyday environments. In this paper, we investigate how to leverage the increasing capacity to gather data at a population-scale towards improving existing models of human behavior. Specifically, we consider the various social phenomena and environmental factors that cause people to develop correlated behavioral patterns, especially within communities connected by strong social ties. Reasons underpinning correlated behavior include shared externalities (e.g., work schedules, weather, traffic conditions), that shape options and decisions; and cases of adopted behavior, as people learn from each other or assume group norms due to social pressure. Most existing approaches to modeling human behavior ignore all of these phenomena and recognize activities solely on the basis of sensor data captured from a single individual. We propose the Networked Community Behavior (NCB) framework for activity recognition, specifically designed to exploit community-scale behavioral patterns. Under NCB, patterns of community behavior are mined to identify social ties that can signal correlated behavior, this information is used to augment sensor-based inferences available from the actions of individuals. Our evaluation of NCB shows it is able to outperform existing approaches to behavior modeling across four mobile sensing datasets that collectively require a diverse set of activities to be recognized.

References

1. Sun, J., and Tang, J. A Survey of Models and Algorithms for Social Influence Analysis. Social Network Data Analytics, (2011) 177--214.
2. FourSquare Search API. http://developer.foursquare.com/.
3. Bell, G., and Gemmell, J. A Digital Life. Scientific American, 296:3, (2007), 58--65.
4. Bishop, C. M. Pattern Recognition and Machine Learning (Information Science and Statistics). Springer, August 2006.
5. Choudhury, T. K. Sensing and Modeling Human Networks. PhD thesis, Massachusetts Institute of Technology, 2003.
6. Christakis, N. A., and Fowler, J. H. The Spread of Obesity in a Large Social Network over 32 years. New England Journal of Medicine, 357:4, (2007), 370--379.
7. Christakis, N. A., and Fowler, J. H. The Collective Dynamics of Smoking in a Large Social Network. New England Journal of Medicine, 358:21 (2008), 2249--2258.
8. Consolvo, S., McDonald, D. W., Toscos, T., Chen, M. Y., Froehlich, J., Harrison, B., Klasnja, P., LaMarca, A., LeGrand, L., Libby, R., Smith, I., and Landay, J. A. Activity Sensing in the Wild: A Field Trial of UbiFit Garden. In Proceeding of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems, CHI '08 (2008), 1797--1806.
9. Cranshaw, J., Toch, E., Hong, J., Kittur, A., and Sadeh, N. Bridging the Gap between Physical Location and Online Social Networks. In Proceedings of the 12th ACM international conference on Ubiquitous computing, Ubicomp '10 (2010), 119--128.
10. daF. Costa, L., Rodrigues, F. A., Travieso, G., and Boas, P. R. V. Characterization of Complex Networks: A Survey of Measurements. Advances in Physics, (56):1 (2005), 167--242.
11. Getoor, L., and Taskar, B. Introduction to Statistical Relational Learning. The MIT Press, 2007.
12. Girvan, M., and Newman, M. E. J. Community Structure in Social and Biological Networks. Proceedings of the National Academy of Sciences, (99):12 (2002), 7821--7826.
13. Gordon, D., Hanne, J.-H., Berchtold, M., Shirehjini, A. A. N., and Beigl, M. Towards Collaborative Group Activity Recognition using Mobile Devices. Journal of Mobile Networks and Applications, (18):3 (2013), 326--340.
14. Gu, T., Wang, L., Chen, H., Tao, X., and Lu, J. Recognizing Multiuser Activities using Wireless Body Sensor Networks. IEEE Transactions on Mobile Computing, (10):11 (2011), 1618--1631.
15. Hummel, R., and Zucker, S. On the Foundations of Relaxation Labeling Processes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 3 (1983), 267--287.
16. Kelman, H. Compliance, Identification, and Internalization: Three Processes of Attitude Change. Journal of Conflict Resolution 2 (1958), 51--60.
17. Kempe, D., Kleinberg, J. M., and Tardos, É. Influential Nodes in a Diffusion Model for Social Networks. In Proceedings of the 32nd International Conference on Automata, Languages and Programming, ICALP '05 (2005), 1127--1138.
18. Lane, N. D., Xu, Y., Lu, H., Eisenman, S., Choudhury, T., and Campbell, A. Cooperative Communities (CoCo): Exploiting Social Networks for Large-scale Modeling of Human Behavior. IEEE Pervasive Computing. 10(4):(2011), 45--53.
19. Lane, N. D., Mohammod, M., Lin, M., Yang, X., Lu, H., Ali, S., Doryab, A., Berke, E., Choudhury, T., and Campbell, A. BeWell: A Smartphone Application to Monitor, Model and Promote Wellbeing. In Proceedings of ICST Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth '11 (2011).
20. Lane, N. D., Xu, Y., Lu, H., Hu, S., Choudhury, T., Campbell, A. T., and Zhao, F. Enabling Large-scale Human Activity Inference on Smartphones using Community Similarity Networks (CSN). In Proceedings of the 13th International Conference on Ubiquitous Computing, UbiComp '11 (2011), 355--364.
21. LiKamWa, R., Liu, Y., Lane, N. D., and Zhong, L. Can Your Smartphone Infer Your Mood? In Proceedings of the 2nd International Workshop on Sensing Applications on Mobile Phones, PhoneSense '11 (2011).
22. Longstaff, B., Reddy, S., and Estrin, D. Improving Activity Classification for Health Applications on Mobile Devices using Active and Semi-Supervised Learning. In Proceedings of ICST Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth '10 (2010).
23. Madan, A., Farrahi, K., Gatica-Perez, D., and Pentland, A. Pervasive Sensing to Model Political Opinions in Face-to-Face Networks. In Proceedings of the 9th International Conference on Pervasive Computing, Pervasive'11 (2011), 214--231.
24. Mason, W., Conrey, F., and Smith, E. Situating Social Influence Processes: Dynamic, Multidirectional Flows of Influence Within Social Networks. Personality and Social Psychology Review, 11(3):(2007), 279.
25. McDowell, L., Gupta, K. M., and Aha, D. W. Cautious Collective Classification. Journal of Machine Learning Research 10:(2009), 2777--2836.
26. McPherson, M., Smith-Lovin, L., and Cook, J. M. Birds of a Feather: Homophily in Social Networks. Annual Review of Sociology, 27(1):(2001), 415--444.
27. Olguín, D. O., Waber, B. N., Kim, T., Mohan, A., Ara, K., and Pentland, A. Sensible Organizations: Technology and Methodology for Automatically Measuring Organizational Behavior. IEEE Transactions on Systems, Man and Cybernetics, Part B 39(1):(2009), 43--55.
28. Rosenfeld, A., Hummel, R., and Zucker, S. Scene Labeling by Relaxation Operations. IEEE Transactions on Systems, Man and Cybernetics, 6:(1976), 420--433.
29. Russell, J. A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6):(1980), 1161--1178.
30. Staiano, J., Lepri, B., Aharony, N., Pianesi, F., Sebe, N., and Pentland, A. Friends Don't Lie: Inferring Personality Traits from Social Network Structure. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing, UbiComp '12 (2012), 321--330.
31. Wang, D., Pedreschi, D., Song, C., Giannotti, F., and Barabasi, A.-L. Human Mobility, Social Ties, and Link Prediction. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '11 (2011), 1100--1108.
32. Wang, L., Gu, T., Tao, X., Chen, H., and Lu, J. Recognizing Multi-user Activities using Wearable Sensors in a Smart Home. Journal of Pervasive and Mobile Computing, 7(3):(2011), 287--298.
33. Lane, N. D. Community-aware Smartphone Sensing Systems. IEEE Internet Computing, 16(3):(2012), 60--64.
34. Zheng, Y., Zhang, L., Xie, X., and Ma, W.-Y. Mining Interesting Locations and Travel Sequences from GPS Trajectories. In Proceedings of the 18th International Conference on World Wide Web, WWW '09 (2009), 791--800.
35. Shi, X., Li, Y., and Yu, P. Collective Prediction with Latent Graphs In Proceedings of the 20th ACM International Conference on Information and Knowledge Management, CIKM '11 (2011), 1127--1136.
36. Henderson, K., Gallagher, B., Li, L., Akoglu, L., Eliassi-Rad, T., Tong, H., and Faloutsos, C. It's Who You Know: Graph Mining Using Recursive Structural Features. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '11 (2011), 663--671.

Index Terms

• Computing methodologies

  • Machine learning

• Human-centered computing

  • Human computer interaction (HCI)