Voice controlled cyber-physical system for smart home

ABSTRACT

Smart home equipped with sensors and electronic devices as a Cyber-Physical Systems (CPS) offers great research perspective to explore communication, computation and controlling of physical devices by using real-time processing and analytics. Since CPS like smart home involves the integration of several types of sensors and equipment, therefore reliability, maintainability, security, data storage and cost-effectiveness are some of the critical issues to be addressed. In addition, interactivity and dynamic feedback, context correlation with respect to streaming events and uncertainties in event composition are also identified as major challenging issues. In the present research, a model for CPS is proposed which is a voice-controlled smart home. Spoken Language Understanding (SLU) plays an important role in dialog system for identifying semantic components in user utterance. The research work includes stream processing, data collection, identification of actions from voice utterance and event-based real-time decision making. The study includes deployment of various sensors and actuators for performing various actions based on voice commands. Raspberry Pi [19] is used as a central node to which various sensors and equipment are connected. It receives voice command from android device and identifies the various intents and slots from the input utterance.

References

1. Soliman, Moataz & Abiodun, Tobi Hamouda, Tarek & Zhou, Jiehan & Lung, Chung-Horng. (2013). Smart Home: Integrating Internet of Things with Web Services and Cloud Computing. Proceedings of the International Conference on Cloud Computing Technology and Science, CloudCom. 2. 317--320.
2. Prasad, B. R., and Agarwal, S. "Handling big data stream analytics using SAMOA framework-a practical experience." Int. J. Database Theory and Applicat 7, no. 4 (2014): 197--208.
3. Seneff, Stephanie. (1992). TINA: A Natural Language System for Spoken Language Applications. Computational Linguistics. 18. 61--86.
4. Agarwal, S., & Prasad, B. R. (2015, December). High speed streaming data analysis of web generated log streams. In Industrial and Information Systems (ICIIS), 2015 IEEE 10th International Conference on (pp. 413--418). IEEE.
5. Cook, et.al.MavHome: an agent-based smart home. Proceedings of the IEEE International Conference on Pervasive Computing And Communications; 521--524; Pervasive computing and communications, IEEE ; 2003
6. Wang, Ye-Yi & EWR, FGFH Mahajan, Milind & Acero, Alex. (2017). Statistical Spoken Language Understanding: From Generative Model to Conditional Model
7. Roland Kuhn, et. al., The application of Semantic Classification Tree to Natural Language Processing.
8. Yu, Xinghuo, and Yusheng Xue. "Smart Grids: A Cyber-Physical Systems Perspective." Proceedings of the IEEE 104, no. 5 (2016): 1058--1070.
9. El-Tawab, Samy, Stephan Olariu, and Mohammad Almalag. "Friend: A cyber-physical system for traffic flow related information aggregation and dissemination." In World of Wireless, Mobile and Multimedia Networks (WoWMoM), 2012 IEEE International Symposium on a, pp 1--6 IEEE, 2012.
10. Puyang Xu, et. al., Exploiting Shared Information for multi-intent Natural Language Sentence Classification
11. A. Bhargava, et. al., Easy contextual intent prediction and slot detection
12. K. U. Schmidt, D. Anicic, and R. Stuhmer. Event-driven Reactivity: A Survey and Requirements Analysis. In 3rd International Workshop on Semantic Business Process Management, pages 72--86, 2008.
13. A. Widder, R. V. Ammon, P. Schaeffer, and C. Wolff. Identification of suspicious, unknown event patterns in an event cloud. In DEBS'07: Proceedings of the 2007 inaugural international conference on Distributed event-based systems, pages 164--170, New York, NY, USA, 2007. ACM.
14. M. Palmer. Seven Principles of Effective RFID Data Management. Progress Software's Real Time Division.
15. C. C. Aggarwal. On classification and segmentation of massive audio data streams. 2008.
16. Prasad, B. R., & Agarwal, S. (2016). Stream Data Mining: Platforms, Algorithms, Performance Evaluators and Research Trends. International Journal of Database Theory and Application, 9(9), 201--218.
17. J. Mihaeli and O. Etzion. Detecting event processing patterns in event databases. 2007.
18. Prasad, B.R. and Agarwal, S., 2017. Critical parameter analysis of Vertical Hoeffding Tree for optimized performance using SAMOA. International Journal of Machine Learning and Cybernetics, 8(4), pp.1389--1402.
19. RaspberryPi. Raspberry Pi Hardware Guide. https://www.raspberrypi.org/learning/hardware-guide/. (Accessed on 2017,Mar. 10)
20. Aosong. DHT11 Temperature and Humidity Module.https://akizukidenshi.com/download/ds/aosong/DHT11.pdf. (Accessed on 2017,Apr. 2)
21. RS Components. Light Dependent Resistors.http://www.bilimteknik.tubitak.gov.tr/sites/default/files/gelisim/elektronik/dosyalar/40/LDR_NSL19_M51.pdf. (Accessed on 2017, Apr. 15)
22. Pubnub.PubNub Security: https://www.pubnub.com/developers/tech/security/(Accessed on 2017, Mar. 28)