Youzhong Ma
ABSTRACT
The Internet of Things (IOT) has been widely applied in many fields, while the IOT data are always large volume, update frequently and inherently multi-dimensional, these characteristics bring big challenges to the traditional DBMSs. The traditional DBMSs have rich functionality and can deal with multi-attributes access efficiently, they can not scale good enough to deal with large volume data and can not support high insert throughput. The cloud-based database systems have good scalability, but they don't support multi-dimensional access natively.In order to deal with the large volume of IOT data, we propose an update and query efficient index framework (UQE-Index) based on key-value store that can support high insert throughput and provide efficient multi-dimensional query simultaneously. We implemented a prototype based on HBase and did comprehensive experiments to test our solution's scalability and efficiency.
- F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A distributed storage system for structured data. ACM Trans. Comput. Syst., 2008. Google Scholar
Digital Library
- L. Ding, B. Qiao, G. Wang, and C. Chen. An efficient quad-tree based index structure for cloud data management. In WAIM'11, pages 238--250, 2011. Google ScholarDigital Library
- Y. Kulbak and D. Washusen. Ihbase. http://github.com/ykulbak/ihbase, 2010.Google Scholar
- S. Nishimura, S. Das, D. Agrawal, and A. E. Abbadi. Md-hbase: A scalable multi-dimensional data infrastructure for location aware services. In Mobile Data Management (1)'11, pages 7--16, 2011. Google ScholarDigital Library
- S. Ratnasamy, P. Francis, M. Handley, R. M. Karp, and S. Shenker. A scalable content-addressable network. In SIGCOMM'01, pages 161--172, 2001. Google ScholarDigital Library
- J. Wang, S. Wu, H. Gao, J. Li, and B. C. Ooi. Indexing multi-dimensional data in a cloud system. In SIGMOD Conference'10, pages 591--602, 2010. Google ScholarDigital Library
- S. Wu and K.-L. Wu. An indexing framework for efficient retrieval on the cloud. IEEE Data Eng. Bull., pages 75--82, 2009.Google Scholar
- X. Zhang, J. Ai, Z. Wang, J. Lu, and X. Meng. An efficient multi-dimensional index for cloud data management. In CloudDB'09, pages 17--24, 2009. Google ScholarDigital Library
- Y. Zou, J. Liu, S. Wang, L. Zha, and Z. Xu. Ccindex: A complemental clustering index on distributed ordered tables for multi-dimensional range queries. In NPC'10, pages 247--261, 2010. Google ScholarDigital Library
Index Terms
- An efficient index for massive IOT data in cloud environment
Recommendations
External integrity verification for outsourced big data in cloud and IoT
As cloud computing is being widely adopted for big data processing, data security is becoming one of the major concerns of data owners. Data integrity is an important factor in almost any data and computation related context. It is not only one of the ...
Cloud Databases for Internet-of-Things Data
ITHINGS '14: Proceedings of the 2014 IEEE International Conference on Internet of Things(iThings), and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom)The Internet of Things (IoT) is posing new challenges and opportunities for data management and analysis techniques. One of the major problems is how to handle an increasing amount of data, with a variety of data types and data sources, in order to meet ...
A Storage Solution for Massive IoT Data Based on NoSQL
GREENCOM '12: Proceedings of the 2012 IEEE International Conference on Green Computing and CommunicationsStorage is an important research direction of the data management of the Internet of Things. Massive and heterogeneous data of the Internet of Things brings the storage huge challenges. Based on the analysis of the IoT data characteristics, this paper ...
Comments