Data quality inference

ABSTRACT

In the field of sensor networks, data integration and collaboration, and intelligence gathering efforts, information on the quality of data sources are important but are often not available. We describe a technique to rank data sources by observing and comparing their behavior (i.e., the data produced by data sources) to rank. Intuitively, our measure characterizes data sources that agree with accurate or high-quality data sources as likely accurate. Furthermore, our measure includes a temporal component that takes into account a data source's past accuracy in evaluating its current accuracy. Initial experimental results based on simulation data to support our hypothesis demonstrate high precision and recall on identifying the most accurate data sources.

REFERENCES

• 1: David Buttler , Matthew Coleman , Terence Critchlow , Renato Fileto , Wei Han , Calton Pu , Daniel Rocco , Li Xiong, Querying multiple bioinformatics information sources: can semantic web research help?, ACM SIGMOD Record, v.31 n.4, December 2002 [doi>10.1145/637411.637421]
• 2: Amit Rudra , Emilie Yeo, Issues in User Perceptions of Data Quality and Satisfaction in using a Data Warehouse ¾ An Australian Experience, Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 7, p.7013, January 04-07, 2000
• 3: InduShobha N. Chengalur-Smith , Donald P. Ballou , Harold L. Pazer, The Impact of Data Quality Information on Decision Making: An Exploratory Analysis, IEEE Transactions on Knowledge and Data Engineering, v.11 n.6, p.853-864, November 1999 [doi>10.1109/69.824597 ]
• 4: Robin A. Dillard, Using Data Quality Measures in Decision-Making Algorithms, IEEE Expert: Intelligent Systems and Their Applications, v.7 n.6, p.63-72, December 1992 [doi>10.1109/64.180410 ]
• 5: F. Naumann, "From databases to information systems - information quality makes the difference," presented at the International Conference on Information Quality (IQ 2001), Cambridge, MA, 2001.
• 6: Michael Gertz , M. Tamer Özsu , Gunter Saake , Kai-Uwe Sattler, Report on the Dagstuhl Seminar: "data quality on the Web", ACM SIGMOD Record, v.33 n.1, March 2004 [doi>10.1145/974121.974144]
• 7: T. Critchlow, L. Liu, D. Buttler, D. Rocco, and C. Pu, "Towards Automatic Discovery and Identification of Bioinformatics Web Interfaces," {Online} Available: http://sirius.cs.ucdavis.edu/Dagstuhl03/presentations/03362.CritchlowTerence.Slides.ppt, 2003.
• 8: Vijay Kumar, Sensor: the atomic computing particle, ACM SIGMOD Record, v.32 n.4, December 2003 [doi>10.1145/959060.959064]
• 9: F. Donovan, "Army to deploy hand-held devices to make every soldier into a sensor," {Online} Available: http://www.aviationnow.com/avnow/news/channel_netdefen se_story.jsp?id=news/arm04294.xml, 2004.
• 10: F. S. Collins, E. D. Green, A. E. Guttmacher, and M. S. Guyer, "A vision for the future of genomics research," Nature, vol. 422, pp. 835--847, 2003.
• 11: Massimo Mecella , Monica Scannapieco , Antonino Virgillito , Roberto Baldoni , Tiziana Catarci , Carlo Batini, Managing Data Quality in Cooperative Information Systems, On the Move to Meaningful Internet Systems, 2002 - DOA/CoopIS/ODBASE 2002 Confederated International Conferences DOA, CoopIS and ODBASE 2002, p.486-502, October 30-November 01, 2002
• 12: Monica Scannapieco , Antonino Virgillito , Carlo Marchetti , Massimo Mecella , Roberto Baldoni, The DaQuinCIS architecture: a platform for exchanging and improving data quality in cooperative information systems, Information Systems, v.29 n.7, p.551-582, October 2004 [doi>10.1016/j.is.2003.12.004]
• 13: L. D. Santis, M. Scannapieco, and T. Catarci, "Trusting data quality in cooperative information systems," presented at CoopIS 2003, 2003.
• 14: J. Widom, "Trio: a system for integrated management of data, accuracy, and lineage," presented at CIDR 2005, Pacific Grove, California, 2005.
• 15: G. A. Mihaila, L. Raschid, and M.-E. Vidal, "Using quality of data metadata for source selection and ranking," presented at Third International Workshop on the Web and Databases, WebDB'2000, Dallax, TX, 2000.
• 16: G. A. Mihaila, L. Raschid, and M.-E. Vidal, "Source selection and ranking in the websemantics architecture using quality of data metadata," Advances in Computers, vol. 55, pp. 87--118, 2002.
• 17: Michael Gertz, Managing Data Quality and Integrity in Federated Databases, Proceedings of the IFIP TC11 Working Group 11.5, Second Working Conference on Integrity and Internal Control in Information Systems: Bridging Business Requirements and Research Results, p.211-230, November 19-20, 1998
• 18: Felix Naumann , Johann-Christoph Freytag , Ulf Leser, Completeness of integrated information sources, Information Systems, v.29 n.7, p.583-615, October 2004 [doi>10.1016/j.is.2003.12.005]
• 19: Felix Naumann, Quality-driven query answering for integrated information systems, Springer-Verlag New York, Inc., New York, NY, 2002
• 20: A. Motro and I. Rakov, "Estimating the quality of databases," presented at 1996 Conference on Information Quality, Cambridge, MA, 1996.
• 21: M. Bobrowski, M. Marre, and D. Yankelevich, "A homogeneous framework to measure data quality," presented at IQ 1999, Cambridge, MA, 1999.
• 22: Barbara Pernici , Monica Scannapieco, Data Quality in Web Information Systems, Proceedings of the 21st International Conference on Conceptual Modeling, p.397-413, October 07-11, 2002
• 23: Yang W. Lee , Diane M. Strong , Beverly K. Kahn , Richard Y. Wang, AIMQ: a methodology for information quality assessment, Information and Management, v.40 n.2, p.133-146, December 2002 [doi>10.1016/S0378-7206(02)00043-5]
• 24: Sergey Brin , Lawrence Page, The anatomy of a large-scale hypertextual Web search engine, Proceedings of the seventh international conference on World Wide Web 7, p.107-117, April 1998, Brisbane, Australia
• 25: J. Hicklin, C. Moler, P. Webb, R. F. Boisvert, B. Miller, R. Pozo, and K. Remington, "JAMA: Java Matrix Package," {Online} Available: http://math.nist.gov/javanumerics/jama/, 2005.
• 26: J. Cho and A. Ntoulas, "Effective Change Detection using Sampling," presented at VLDB Conference, Hong Kong, China, 2002.
• 27: L. Cholvy and C. Garion, "Querying several conflicting databases," presented at ECSQARU-03 Workshop Uncertainity, Incompleteness, Imprecision, and Conflict in Multiple Data Sources, Aalborg, 2003.
• 28: Jung Framework Development Team, "JUNG: Java Universal Network/Graph Framework," {Online} Available: http://jung.sourceforge.net/index.html, 2005.
• 29: Steffen Staab , Pedro Domingos , Peter Mika , Jennifer Golbeck , Li Ding , Tim Finin , Anupam Joshi , Andrzej Nowak , Robin R. Vallacher, Social Networks Applied, IEEE Intelligent Systems, v.20 n.1, p.80-93, January 2005 [doi>10.1109/MIS.2005.16]