skip to main content
10.1145/2047403.2047408acmconferencesArticle/Chapter ViewAbstractPublication PageshtConference Proceedingsconference-collections
research-article

A proposal for the evaluation of adaptive content retrieval, modification and delivery

Published: 06 June 2011 Publication History

Abstract

A key advantage of Adaptive Hypermedia Systems (AHS) is their ability to re-sequence and reintegrate content to satisfy a particular user's need, context or requirements. However, this requires large volumes of content, with appropriate granularities and suitable meta-data descriptions, representing a major impediment to the mainstream adoption of Adaptive Hypermedia. Opencorpus content is now widely available on the web, however, traditional information retrieval (IR) approaches are an inadequate means of incorporating these external content resources within AHS. This is due to the "one size fits all" content delivery paradigm offered by traditional IR. Slicing technology addresses these limitations by providing adaptive retrieval of open corpus resources, tailored to suit AHS specific content requirements. This is achieved through the on demand provision of tailored content called slices. This paper introduces slicing systems and details the objectives and challenges involved in the evaluation of such systems. A framework for the evaluation of slicing systems is presented along with a proposed experimental implementation.

References

[1]
Aroyo, L., De Bra, P., Houben, G. J. "Embedding Information Retrieval in Adaptive Hypermedia: IR meets AHA!". In the Proceedings of the Workshop on Adaptive Hypermedia and Adaptive Web-Based Systems, at the Twelfth International World Wide Web Conference, WWW2003, pp. 63--76, Budapest, Hungary. May 20th, 2003.
[2]
Bra, P. M. E. D. Teaching Hypertext and Hypermedia through the Web. Journal of Universal Computer Science, 2, 12 (1996), 797--804.
[3]
Brooke, J. "SUS: a "quick and dirty" usability scale". Usability Evaluation in Industry., (1996).
[4]
Brusilovsky, P. and Pesin, L. Adaptive Navigation Support in Educational Hypermedia: An Evaluation of the ISIS-Tutor. Journal of Computing and Information Technology, (1998).
[5]
Brusilovsky, P., Chavan, G., Farzan, R. "Social Adaptive Navigation Support for Open Corpus Electronic Textbooks". In Proceedings of 3rd International Conference on Adaptive Hypermedia & Adaptive Web-Based Systems, AH 2004, P. DeBra, W. Nejdl (Eds.). LNCS, Vol. 3137. Berlin: Springer Verlag, pp. 24--33. 2004.
[6]
Carmona, C., Bueno, D., Guzmán, E., Conejo, R. "SIGUE: Making Web Courses Adaptive". In Proceedings of 2nd International Conference on Adaptive Hypermedia & Adaptive Web Based Systems, AH2002, Malaga, Spain, 29--31 May, 2002. LNCS, Vol. 2347. Berlin:Springer Verlag, pp. 376--379. 2002.
[7]
Debnath, S., Mitra, P., Pal, N., and Giles, C. L. Automatic Identification of Informative Sections of Web Pages. IEEE Transactions on Knowledge and Data Engineering 17, 9 (2005), 1233--1246.
[8]
Dieberger, A., Jose, S., and Guzdial, M. CoWeb - Experiences with Collaborative Web spaces. In From Usenet to CoWebs: Interacting with Social Information Spaces, (2002).
[9]
Farrell, R., Liburd, S. D., and Thomas, J. C. Dynamic Assembly of Learning Objects. Proceedings of the 13th World Wide Web Conference, (2004), 162--169.
[10]
Gena, C. Methods and techniques for the evaluation of user- adaptive systems, The knowledge engineering review, vol 20:1, pp. 1--37, United Kingdom: Cambridge University Press, 2005.
[11]
Henze, N. and Wolfgang, N. 1999_Henze_Adaptivity in the KBS Hyperbook. Workshop on Adaptive Systems and User Modelling on WWW, (1999).
[12]
Henze, N. and Nejdl, W. "Extendible Adaptive Hypermedia Courseware: Integrating Different Courses and Web Material". In the Proceedings of the International Conference on Adaptive Hypermedia & Adaptive Web-Based Systems, AH2000, pp. 109--120, Berlin: Springer-Verlag, Trento, Italy. August 28th-30th, 2000.
[13]
Herder, E. Utility-Based Evaluation of Adaptive Systems. In the proceedings of the Second Workshop on Empirical Evaluation of Adaptive Systems, at the 9th International Conference on User Modeling, UM2003, (2003), 25--30.
[14]
Höök, K. Evaluating the utility and usability of an adaptive hypermedia system. Proceedings of 1997 International Conference onIntelligent User Interfaces, (1997), 179--186.
[15]
IMS Global Learning, I. G. L. Standard for Learning Object Metadata LOM. 2006. http://www.imsglobal.org/metadata/mdvlp3/imsmd_bestvlp3.html
[16]
Kohlschütter, C. and Nejdl, W. A Densitometric Approach to Web Page Segmentation. CIKM, Proceeding of the 17th international conference on Information and knowledge management, (2008), 1173--1182.
[17]
Lawless, S., Connor, A. O., and Mulwa, C. A Proposal for the Evaluation of Adaptive Personalized Information Retrieval. CIRSE 2010 Workshop on Contextual Information Access, Seeking and Retrieval Evaluation, (2010), 1--4.
[18]
Lawless, S., Hederman, L., and Wade, V. OCCS: Enabling the Dynamic Discovery, Harvesting and Delivery of Educational Content from Open Corpus Sources. ICALT - IEEE International Conference on Advanced Learning Technologies, IEEE Computer Society (2008), 676--678.
[19]
Lawless, S. "Leveraging Content from Open Corpus Sources for Technology Enhanced Learning". Ph.D. Thesis, Submitted to the University of Dublin, Trinity College, 2009.
[20]
Levacher, K., Hynes, E., Lawless, S., O'Connor, A., and Wade, V. A Framework for Content Preparation to Support Open-Corpus Adaptive Hypermedia. Proceedings of 20th ACM Conference on Hypertext and Hypermedia, (2009).
[21]
Pennacchiotti, M. and Pantel, P. Entity extraction via ensemble semantics. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing Volume 1 - EMNLP '09, August (2009), 238
[22]
Wade, C. and Allan, J. Passage Retrieval and Evaluation. University of Massachusetts, Amherst, 2005

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
PMHR '11: Proceedings of the First Workshop on Personalised Multilingual Hypertext Retrieval
June 2011
61 pages
ISBN:9781450308977
DOI:10.1145/2047403
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2011

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Adaptive Hypermedia Systems
  2. content slicing
  3. evaluation

Qualifiers

  • Research-article

Funding Sources

Conference

HT '11
Sponsor:

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media