An Active Sleep Monitoring Framework Using Wearables

Abstract

Sleep is the most important aspect of healthy and active living. The right amount of sleep at the right time helps an individual to protect his or her physical, mental, and cognitive health and maintain his or her quality of life. The most durative of the Activities of Daily Living (ADL), sleep has a major synergic influence on a person’s fuctional, behavioral, and cognitive health. A deep understanding of sleep behavior and its relationship with its physiological signals, and contexts (such as eye or body movements), is necessary to design and develop a robust intelligent sleep monitoring system. In this article, we propose an intelligent algorithm to detect the microscopic states of sleep that fundamentally constitute the components of good and bad sleeping behaviors and thus help shape the formative assessment of sleep quality. Our initial analysis includes the investigation of several classification techniques to identify and correlate the relationship of microscopic sleep states with overall sleep behavior. Subsequently, we also propose an online algorithm based on change point detection to process and classify the microscopic sleep states. We also develop a lightweight version of the proposed algorithm for real-time sleep monitoring, recognition, and assessment at scale. For a larger deployment of our proposed model across a community of individuals, we propose an active-learning-based methodology to reduce the effort of ground-truth data collection and labeling. Finally, we evaluate the performance of our proposed algorithms on real data traces and demonstrate the efficacy of our models for detecting and assessing the fine-grained sleep states beyond an individual.

References

1. Actigraph. 2004. ActiGraph. Retrieved from http://www.actigraphcorp.com.
2. Ryan Prescott Adams and David J. C. MacKay. 2007. Bayesian Online Changepoint Detection. Cambridge, UK.
3. Aeotec Multisensor. 2006. MultiSensor 6: Z-Wave motion, light, temperature sensor - Aeotec. Retrieved from http://aeotec.com/z-wave-sensor.
4. Hande Özgür Alemdar, Tim van Kasteren, and Cem Ersoy. 2011. Using active learning to allow activity recognition on a large scale. In Proceedings of the 2nd International Joint Conference on Ambient Intelligence (AmI’11). 105--114.
5. Android Wear. 2014. Wear OS by Google Smartwatches. Retrieved from http://www.android.com/intl/en_us/wear/.
6. Salikh Bagaveyev and Diane J. Cook. 2014. Designing and evaluating active learning methods for activity recognition. In Proceedings of the 2014 ACM Conference on Ubiquitous Computing (UbiComp’14). 469--478.
7. Yin Bai, Bin Xu, Yuanchao Ma, Guodong Sun, and Yu Zhao. 2012. Will you have a good sleep tonight?: Sleep quality prediction with mobile phone. In Proceedings of the 7th International Conference on Body Area Networks.
8. Basis Band B1. 2014. Intel Basis. Retrieved from http://www.mybasis.com/.
9. Beddit. 2015. Beddit Sleep Monitor. Retrieved from http://www.beddit.com/features/.
10. Alina Beygelzimer, Sanjoy Dasgupta, and John Langford. 2009. Importance weighted active learning. In Proceedings of the International Conference on Machine Learning (ICML’09). 49--56.
11. Marko Borazio, Eugen Berlin, Nagihan Kücükyildiz, Philipp M. Scholl, and Kristof Van Laerhoven. 2014. Towards benchmarked sleep detection with inertial wrist-worn sensing units. In Proceedings of the IEEE International Conference on Healthcare Informatics (ICHI’14).
12. D. Buysse, C. Reynolds, T. Monk, S. Berman, and D. Kupfer. 1989. The pittsburgh sleep quality index: A new instrument for psychiatric practice and research. In Psychiatry Research, Vol. 28. 193--213.
13. Yung-Ju Chang, Gaurav Paruthi, Hsin-Ying Wu, Hsin-Yu Lin, and Mark W. Newman. 2017. An investigation of using mobile and situated crowdsourcing to collect annotated travel activity data in real-world settings. Int. J. Hum.-Comput. Stud. 102 (2017), 81--102.
14. Zhenyu Chen, Mu Lin, Fanglin Chen, N. D. Lane, et al. 2013. Unobtrusive sleep monitoring using smartphones. In PervasiveHealth. 145--152.
15. Anand Inasu Chittilappilly, Lei Chen, and Sihem Amer-Yahia. 2016. A survey of general-purpose crowdsourcing techniques. IEEE Trans. Knowl. Data Eng. 28, 9 (2016), 2246--2266.
16. R. J. Cole, D. F. Kripke, W. Gruen, D. J. Mullaney, and J. C. Gillin. 1992. Automatic sleep/wake identification from wrist activity. Sleep 15, 5 (Oct. 1992), 461--469.
17. Florian Daiber and Felix Kosmalla. 2017. Tutorial on wearable computing in sports. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI’17). 65:1--65:4.
18. Andrew L. Chesson et al. 1997. Practice parameters for the indications for polysomnography and related procedures. Sleep 20, 6 (1997), 406--422.
19. B. Darkhovsky, J. Fell, A. Kaplan, and J. Röschke. 2001. Macrostructural EEG characterization based on nonparametric change point segmentation: Application to sleep analysis. J. Neurosci. Methods 106, 1 (2001), 81--90.
20. EZ430-Chronos. 2013. Chronos: Wireless development tool in a watch. Retrieved from http://www.ti.com/tool/ez430-chronos.
21. Muhammad Fahim, LeBa Vui, Iram Fatima, Sungyoung Lee, and Yongik Yoon. 2013. A sleep monitoring application for u-lifecare using accelerometer sensor of smartphone. In Ubiquitous Computing and Ambient Intelligence: Context-Awareness and Context-Driven Interaction. Vol. 8276. 151--158.
22. Fitbit. 2007. Fitbit Official Site for Activity Trackers and More. Retrieved from http://www.fitbit.com/.
23. N. Foubert, A. M. McKee, R. A. Goubran, and F. Knoefel. 2012. Lying and sitting posture recognition and transition detection using a pressure sensor array. In Proceedings of the Conference on Medical Measurements and Applications (MeMeA’12). 1--6.
24. Weixi Gu, Zheng Yang, Longfei Shangguan, Wei Sun, Kun Jin, and Yunhao Liu. 2014. Intelligent sleep stage mining service with smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’14). 649--660.
25. Tian Hao, Guoliang Xing, and Gang Zhou. 2013. iSleep: Unobtrusive sleep quality monitoring using smartphones. In SenSys. Article 4, 4:1--4:14 pages.
26. Hello Sense. 2014. Hello Sense. Retrieved from https://hello.is/.
27. Enamul Hoque and John A. Stankovic. 2010. Monitoring quantity and quality of sleeping using WISPs. In Proceedings of the Information Processing in Sensor Networks Conference (IPSN’10). 370--371.
28. Enamul Hoque and John A. Stankovic. 2012. AALO: Activity recognition in smart homes using active learning in the presence of overlapped activities. In Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare, PervasiveHealth 2012. 139--146.
29. H. M. Sajjad Hossain, Md Abdullah Al Hafiz Khan, and Nirmalya Roy. 2017. Active learning enabled activity recognition. Perv. Mobile Comput. 38 (2017), 312--330.
30. H. M. Sajjad Hossain, Nirmalya Roy, and Md Abdullah Al Hafiz Khan. 2015. Sleep well: A sound sleep monitoring framework for community scaling. In Proceedings of the 16th IEEE International Conference on Mobile Data Management (MDM’15). 44--53.
31. Kyuwoong Hwang and Soo-Young Lee. 2012. Environmental audio scene and activity recognition through mobile-based crowdsourcing. IEEE Trans. Consum. Electron. 58, 2 (2012), 700--705.
32. G. Jean-Louis, H. von Gizycki, F. Zizi, A. Spielman, P. Hauri, and H. Taub. 1997. The actigraph data analysis software: I. A novel approach to scoring and interpreting sleep-wake activity. Percept. Mot. Skills 85, 1 (Aug. 1997), 207--216.
33. George H. John, Ron Kohavi, and Karl Pfleger. 1994. Irrelevant features and the subset selection problem. In Proceedings of the 11th International Conference on Machine Learning. 121--129.
34. Murray W. Johns. 2000. Sensitivity and specificity of the multiple sleep latency test (MSLT), the maintenance of wakefulness test and the Epworth sleepiness scale: Failure of the MSLT as a gold standard. J. Sleep Res. 9, 1 (2000), 5--11.
35. Stephan Jonas, Andreas Hannig, Cord Spreckelsen, and Thomas M. Deserno. 2014. Wearable technology as a booster of clinical care. In Medical Imaging 2014: PACS and Imaging Informatics: Next Generation and Innovations, Vol. 9039. International Society for Optics and Photonics.
36. Nikos Karampatziakis and John Langford. 2011. Online importance weight aware updates. In Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI’2011). 392--399.
37. Matthew Kay, Eun K. Choe, and et al. 2012. Lullaby: A capture 8 access system for understanding the sleep environment. In Proceedings of the ACM Conference on Pervasive and Ubiquitous Computing (UbiComp’12).
38. E. B. Klerman, R. Barbieri, L. Citi, and M. T. Bianchi. 2011. Instantaneous monitoring of sleep fragmentation by point process heart rate variability and respiratory dynamics. In Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE. IEEE, 7735--7738.
39. Christopher Kline. 2013. Sleep Quality. Springer, New York, NY, 1811--1813.
40. Chih-En Kuo, Yi-Che Liu, Da-Wei Chang, Chung-Ping Young, Fu-Zen Shaw, and Sheng-Fu Liang. 2017. Development and evaluation of a wearable device for sleep quality assessment. IEEE Trans. Biomed. Eng. 64, 7 (2017), 1547--1557.
41. Nicholas D. Lane, Mashfiqui Mohammod, and et al. 2011. Bewell: A smartphone application to monitor, model and promote wellbeing. In Pervasive Computing Technologies for Healthcare.
42. Wen-Hung Liao and Chien-Ming Yang. 2008. Video-based activity and movement pattern analysis in overnight sleep studies. In Proceedings of the International Conference on Pattern Recognition (ICPR’08). 1--4.
43. Zhicheng Liao and Yangyong Zhu. 2014. When a classifier meets more data. Proc. Comput. Sci. 30 (2014), 50--59.
44. J. J. Liu, Wenyao Xu, and et al. 2013. A dense pressure sensitive bedsheet design for unobtrusive sleep posture monitoring. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom’13). 207--215.
45. Steven W. Lockley, Debra J. Skene, and Josephine Arendt. 1999. Comparison between subjective and actigraphic measurement of sleep and sleep rhythms. J. Sleep Res. 8, 3 (1999), 175--183.
46. Janna Mantua, Nickolas Gravel, and Rebecca Spencer. 2016. Reliability of sleep measures from four personal health monitoring devices compared to research-based actigraphy and polysomnography. Sensors 16, 5 (2016), 646.
47. Shun Matsui, Tsutomu Terada, and Masahiko Tsukamoto. 2017. Smart eye mask: Eye-mask shaped sleep monitoring device. In Adjunct Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers (UbiComp/ISWC’17). 265--268.
48. Mimo. 2016. Mimo Baby. Retrieved from http://mimobaby.com/.
49. K. Nakajima, Y. Matsumoto, and T. Tamura. 2000. A monitor for posture changes and respiration in bed using real time image sequence analysis. In Engineering in Medicine and Biology Society, Vol. 1.
50. Yunyoung Nam, Yeesock Kim, and Jinseok Lee. 2016a. Sleep monitoring based on a tri-axial accelerometer and a pressure sensor. Sensors 16, 5 (2016), 750.
51. Yunyoung Nam, Yeesock Kim, and Jinseok Lee. 2016b. Sleep monitoring based on a tri-axial accelerometer and a pressure sensor. Sensors 16, 5 (2016), 750.
52. Anh Nguyen, Raghda Alqurashi, Zohreh Raghebi, Farnoush Banaei-kashani, Ann C. Halbower, and Tam Vu. 2016. A lightweight and inexpensive in-ear sensing system for automatic whole-night sleep stage monitoring. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems. ACM, 230--244.
53. N. R. Oakley. 1997. Validation with polysomnography of the sleep-watch sleep/wake scoring algorithm used by the actiwatch activity monitoring system. In Technical Report to Mini Mitter Co., Inc.
54. Abdulakeem Odunmbaku, Amir-Mohammad Rahmani, Pasi Liljeberg, and Hannu Tenhunen. 2016. Elderly Monitoring System with Sleep and Fall Detector. Springer International Publishing, Cham, 473--480.
55. James M. Parish. 2009. Sleep-related problems in common medical conditions. CHEST J. 135, 2 (2009), 563--572.
56. Rachael Purta, Stephen Mattingly, Lixing Song, Omar Lizardo, David Hachen, Christian Poellabauer, and Aaron Striegel. 2016. Experiences measuring sleep and physical activity patterns across a large college cohort with fitbits. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC’16). 28--35.
57. Vikas C. Raykar, Shipeng Yu, Linda H. Zhao, Gerardo Hermosillo Valadez, Charles Florin, Luca Bogoni, and Linda Moy. 2010. Learning from crowds. J. Mach. Learn. Res. 11 (Aug. 2010), 1297--1322.
58. Yanzhi Ren, Chen Wang, Jie Yang, and Yingying Chen. 2015. Fine-grained sleep monitoring: Hearing your breathing with smartphones. In Proceedings of the 2015 IEEE Conference on Computer Communications (INFOCOM’15). 1194--1202.
59. Mahsan Rofouei, Mike Sinclair, Ray Bittner, Tom Blank, Nick Saw, Gerald DeJean, and Jeff Heffron. 2011. A non-invasive wearable neck-cuff system for real-time sleep monitoring. In Proceedings of the IEEE Conference on Body Sensor Networks (BSN’11). IEEE, 156--161.
60. A. Sadeh. 2011. The role and validity of actigraphy in sleep medicine: An update. Sleep Med. Rev. 15, 4 (Aug. 2011), 259--267.
61. A. Sadeh, K. M. Sharkey, and M. A. Carskadon. 1994. Activity-based sleep-wake identification: An empirical test of methodological issues. Sleep 17, 3 (Apr. 1994), 201--207.
62. Sohrab Saeb, Thaddeus R. Cybulski, Konrad P. Kording, and David C. Mohr. 2017. Scalable passive sleep monitoring using mobile phones: Opportunities and obstacles. J. Med. Internet Res. 19, 4 (2017), e118.
63. Alireza Sahami Shirazi, James Clawson, Yashar Hassanpour, Mohammad J. Tourian, Albrecht Schmidt, Ed H. Chi, Marko Borazio, and Kristof Van Laerhoven. 2013. Already up? Using mobile phones to track 8 share sleep behavior. Int. J. Hum.-Comput. Stud. 71, 9 (Sept. 2013), 878--888.
64. Aarti Sathyanarayana, Ferda Ofli, Luis Fernandes-Luque, Jaideep Srivastava, Ahmed K. Elmagarmid, Teresa Arora, and Shahrad Taheri. 2016. Robust automated human activity recognition and its application to sleep research. In IEEE International Conference on Data Mining Workshops, ICDM Workshops 2016. Barcelona, Spain, 495--502.
65. Aarti Sathyanarayana, Jaideep Srivastava, and Luis Fernández-Luque. 2017. The science of sweet dreams: Predicting sleep efficiency from wearable device data. IEEE Comput. 50, 3 (2017), 30--38.
66. Burr Settles. 2012. Active Learning. Morgan 8 Claypool Publishers.
67. Sleep As Android. 2010. Sleep As Android. Retrieved from https://play.google.com/store/apps/details?id=com.urbandroid.sleep8hl=en.
68. Sleep Bot. 2017. SleepBot - Smart Alarm - Movement Tracker - Sound Recorder. Retrieved from http://mysleepbot.com.
69. Sleep Time Smart Alarm Clock. 2015. Sleep Time : Sleep Cycle Smart Alarm Clock Tracker. Retrieved from https://play.google.com/store/apps/details?id=com.azumio.android.sleeptime.
70. Margarita Sordo and Qing Zeng. 2005. On sample size and classification accuracy: A performance comparison. In Proceedings of the 6th International Conference on Biological and Medical Data Analysis (ISBMDA’05). 193--201.
71. Allan Stisen, Henrik Blunck, Sourav Bhattacharya, Thor Siiger Prentow, Mikkel Baun Kjærgaard, Anind Dey, Tobias Sonne, and Mads Møller Jensen. 2015. Smart devices are different: Assessing and mitigatingmobile sensing heterogeneities for activity recognition. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (SenSys’15). 127--140.
72. Xiao Sun, Li Qiu, Yibo Wu, Yeming Tang, and Guohong Cao. 2017. SleepMonitor: Monitoring respiratory rate and body position during sleep using smartwatch. Interact. Mobile Wear. Ubiq. Technol. 1, 3 (2017), 104:1--104:22.
73. Kristof Van Laerhoven, Marko Borazio, David Kilian, and Bernt Schiele. 2008. Sustained logging and discrimination of sleep postures with low-level, wrist-worn sensors. In Proceedings of the 2008 12th IEEE International Symposium on Wearable Computers (ISWC’08). 69--76.
74. Oana Ramona Velicu, Natividad Martínez Madrid, and Ralf Seepold. 2016. Experimental sleep phases monitoring. In Proceedings of the 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI’16). IEEE, 625--628.
75. Vowpal Wabbit. 2016. Vowpal Wabbit (Fast Learning) - Machine Learning (Theory). Retrieved from http://hunch.net/ vw/.
76. J. B. Webster, D. F. Kripke, et al. 1982. An activity-based sleep monitor system for ambulatory use. In Sleep, Vol. 5. 389--399.
77. Hyeryeon Yi, Kyungrim Shin, and Chol Shin. 2006. Development of the sleep quality scale. J. Sleep Res. 15, 3 (2006), 309--316.
78. Zeo. 2003. Zeo, Inc. Retrieved from http://www.myzeo.com/sleep.
79. Jin Zhang, Qian Zhang, Yuanpeng Wang, and Chen Qiu. 2013. A real-time auto-adjustable smart pillow system for sleep apnea detection and treatment. In Proceedings of the 2013 ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN’13). 179--190.

Index Terms

• Computer systems organization

  • Embedded and cyber-physical systems

• Computing methodologies

  • Machine learning

    • Learning settings

      • Active learning settings

• Hardware

  • Communication hardware, interfaces and storage

    • Sensor applications and deployments

• Information systems

  • Information systems applications

    • Mobile information processing systems