ACQUIRE: agent-based complex query and information retrieval engine

ABSTRACT

The heterogeneous, distributive and voluminous nature of many government and corporate data sources impose severe constraints on meeting the diverse requirements of users who analyze the data. Additionally, communication bandwidth limitations, time constraints, and multiplicity of data formats impose further restrictions on users of these distributed data sources. What is required is a reliable, robust, and efficient data retrieval technique that can access data from distributed data sources while maintaining the autonomy of individual sources. In this paper, we present an Agent-based Complex QUerying and Information Retrieval Engine (ACQUIRE) for large, heterogeneous, and distributed data sources. ACQUIRE acts as a softbot or interface agent by presenting users with the appearance of a single, unified, homogenous data source, against which users can pose high-level declarative queries. ACQUIRE translates each such user query into a set of sub-queries by employing a combination of planning and traditional database query optimization techniques. For each sub-query, ACQUIRE then spawns a corresponding mobile agent, which retrieves data from the appropriate data source. These mobile agents carry with them data-processing code that can be executed at the remote site, thus reducing the size of data returned by the agent. When all mobile agents have returned, ACQUIRE filters and merges the retrieved data and presents the results to the user. Validation experiments on simulated NASA Distributed Active Archive Centers (DAACs) have demonstrated that complex queries can be effectively decomposed and retrieved by this approach, resulting in the twin benefits of improved ease of use and significantly reduced query retrieval times.

REFERENCES

• 1: Rafi Ahmed , Philippe De Smedt , Weimin Du , William Kent , Mohammad A. Ketabchi , Witold A. Litwin , Abbas Rafii , Ming-Chien Shan, The Pegasus Heterogeneous Multidatabase System, Computer, v.24 n.12, p.19-27, December 1991 [doi>10.1109/2.116885 ]
• 2: Angelici, G. L., Skiles, J. W., Popovici, L.Z. (1992). Oregon Transect Ecosystem Research Project: Collected Data CD-ROM Version 1.0. NASA Ames Research Center
• 3: Yigal Arens , Craig A. Knoblock , Wei-Min Shen, Query reformulation for dynamic information integration, Journal of Intelligent Information Systems, v.6 n.2-3, p.99-130, June 1996 [doi>10.1007/BF00122124]
• 4: Brewington, B., Gray, R., Moizumi, K., Kotz, D., Cybenko, G., and Rus, D. (1999) "Mobile Agents in Distributed Information Retrieval", Intelligent Information Agents, Springer-Verlag, 1999
• 5: Chawathe, S., Garcia-Molina, H., Hammer, J., Ireland, K., Papakonstantinou, Y., Ullman, J., and Widom, J. (1994). The TSIMMIS project: Integration of heterogeneous information sources. Proceedings of IPSJ Conference
• 6: Oren Etzioni , Daniel Weld, A softbot-based interface to the Internet, Communications of the ACM, v.37 n.7, p.72-76, July 1994 [doi>10.1145/176789.176797]
• 7: Sebastian Fischmeister , Giovanni Vigna , Richard A. Kemmerer, Evaluating the Security of Three Java-Based Mobile Agent Systems, Proceedings of the 5th International Conference on Mobile Agents, p.31-41, December 02-04, 2001
• 8: Dag Johansen, Mobile Agent Applicability, Proceedings of the Second International Workshop on Mobile Agents, p.80-98, September 01, 1998
• 9: Won Kim , Jungyun Seo, Classifying Schematic and Data Heterogeneity in Multidatabase Systems, Computer, v.24 n.12, p.12-18, December 1991 [doi>10.1109/2.116884 ]
• 10: Joseph Kiniry , Daniel Zimmerman, A Hands-On Look at Java Mobile Agents, IEEE Internet Computing, v.1 n.4, p.21-30, July 1997 [doi>10.1109/4236.612210 ]
• 11: Knoblock, C. A. (1995). Planning, executing, sensing, and re-planning for information gathering. Proceedings of the 4th International Joint Conference on Artificial Intelligence
• 12: Kwok, C. T., and Weld, D. S. (1996). Planning to gather information. Technical Report UW-CSE-96-01-04. Department of Computer Science, University of Washington, Seattle, WA
• 13: Alon Y. Levy , Divesh Srivastava , Thomas Kirk, Data model and query evaluation in global information systems, Journal of Intelligent Information Systems, v.5 n.2, p.121-143, Sept. 1995 [doi>10.1007/BF00962627]
• 14: Scaling heterogeneous databases and the design of Disco, Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96), p.449, May 27-30, 1996
• 15: Jennifer Widom, Integrating heterogeneous databases: lazy or eager?, ACM Computing Surveys (CSUR), v.28 n.4es, Dec. 1996 [doi>10.1145/242224.242344]

INDEX TERMS

Primary Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Retrieval models

Additional Classification:
  H. Information Systems
  H.3 INFORMATION STORAGE AND RETRIEVAL
      H.3.3 Information Search and Retrieval
          Subjects: Selection process

General Terms:
Algorithms, Design, Experimentation, Performance, Verification

Keywords:
distributed data sources, information retrieval, interface agent, mobile agents, softbot