skip to main content
10.1145/1056808.1056905acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Methods for assessing web design through the internet

Published: 02 April 2005 Publication History

Abstract

Web design guidelines are often derived from best practices, conventional wisdom, or small-scale usability studies conducted in labs. We contend that if Web design guidelines are to inform the design of Web sites serving varied audiences with varied needs, the guidelines must be derived from empirical research that assesses users in their native environments as they interact with real Web sites. While we believe that the delivery of a remote Web-based experiment has many potential benefits, we acknowledge that it can be difficult to exercise experimental control so as to acquire reliable data, capture user behavior unobtrusively, extract meaningful information from server logs, and collect valid survey data. Therefore, we report on how we addressed some of the challenges of conducting remote empirical studies of the effect of navigational cues on Web browsing behavior.

References

[1]
Barrick, J., Maust, B., Spyridakis, J.H., Eliot, M., Wei, C., Evans, M. and Mobrand, K. A. Tool for Supporting Web-Based Empirical Research: Providing a Basis for Web Design Guidelines. Proceedings of the IEEE International Professional Communication Conference, (2004), 189--193.
[2]
Birnbaum, M.H. Human Research and Data Collection via the Internet. Annual Review of Psychology, 55 (2004), 803--832.
[3]
Evans, M.B., Wei, C., Eliot, M., Barrick, J., Maust, B., and Spyridakis, J.H. The Effect of Informative, Intriguing, and Generic Hyperlink Wording on Web Browsing Behavior. Proceedings of the International Technical Communication Conference, (2004), 313--317.
[4]
Hong, J.I., Heer, J., Waterson, S., and Landay, J.A. Web-Quilt: A Proxy-based Approach to Remote Web Usability Testing. ACM Transactions on Information Systems, 19, 3 (2001), 263--285.
[5]
Kraut, R., Olson, J., Banaji, M., Bruckman, A., Cohen, J., and Couper, M. Psychological Research Online: Report of Board of Scientific Affairs' Advisory Group on the Conduct of Research on the Internet. American Psychologist, 59, 2 (2004), 105--117.
[6]
Logging in W3C httpd. Available at: http://www.w3.org/Daemon/User/Config/Logging.html
[7]
McGraw, K.O., Tew, M. D., and Williams, J.E. The Integrity of Web-delivered Experiments: Can You Trust the Data?" Psychological Science, 11, 6 (2000), 502--506.
[8]
Mobrand, K.A., and Spyridakis, J.H. A Web-based Study of User Performance with Enhanced Local Navigational Cues. Proceedings of the IEEE International Professional Communication Conference, (2002), 500--508.
[9]
Reips, U.D., and Stieger, S. Scientific LogAnalyzer: A Web-based tool for analyses of server log files in psychological research. Behavior Research Methods, Instruments and Computers, 36, 2 (2004), 304--311.
[10]
Schultz, L., and Spyridakis, J.H. The Effect of Heading Frequency on Comprehension of Online Information: A Study of Two Populations. Technical Communication, 51, 4, (2004), 504--518.
[11]
Spyridakis, J.H., Wei, C., Barrick, J., Cuddihy, E., and Maust, B. Internet-based Research: Providing a Foundation for Web Design Guidelines, IEEE Transactions on Professional Communication, (In press).
[12]
Waterson, S.J., Hong, J.I., Sohn, T., Landay, J.A., Heer, J., and Matthews, T. What Did They Do? Understanding Clickstreams with the WebQuilt Visualization System, Proceedings of the ACM International Working Conference on Advanced Visual Interfaces, (2002),Trento, Italy. ACM Press, New York.
[13]
WebSift. Available at: http://www.cs.umn.edu/research/websift

Cited By

View all
  • (2017)Software Analytics for Web Usability: A Systematic MappingComputational Science and Its Applications – ICCSA 201710.1007/978-3-319-62407-5_17(246-261)Online publication date: 15-Jul-2017
  • (2012)From web designer to researcher: Using experiment patterns to research web design decisions2012 IEEE International Professional Communication Conference10.1109/IPCC.2012.6408636(1-10)Online publication date: Oct-2012
  • (2012)The effect of visual design and placement of intra-article navigation schemes on reading comprehension and website user perceptionsComputers in Human Behavior10.1016/j.chb.2012.03.00228:4(1399-1409)Online publication date: 1-Jul-2012
  • Show More Cited By

Index Terms

  1. Methods for assessing web design through the internet

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '05: CHI '05 Extended Abstracts on Human Factors in Computing Systems
    April 2005
    1358 pages
    ISBN:1595930027
    DOI:10.1145/1056808
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 April 2005

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. internet-based research
    2. remote testing
    3. web design assessment

    Qualifiers

    • Article

    Conference

    CHI05
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 15 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2017)Software Analytics for Web Usability: A Systematic MappingComputational Science and Its Applications – ICCSA 201710.1007/978-3-319-62407-5_17(246-261)Online publication date: 15-Jul-2017
    • (2012)From web designer to researcher: Using experiment patterns to research web design decisions2012 IEEE International Professional Communication Conference10.1109/IPCC.2012.6408636(1-10)Online publication date: Oct-2012
    • (2012)The effect of visual design and placement of intra-article navigation schemes on reading comprehension and website user perceptionsComputers in Human Behavior10.1016/j.chb.2012.03.00228:4(1399-1409)Online publication date: 1-Jul-2012
    • (2011)Does 'Letting Go of the Words' Increase EngagementCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979663(655-667)Online publication date: 7-May-2011
    • (2009)Internet-based research for the desktop and beyond: Building a foundation of excellence for information design on the web2009 IEEE International Professional Communication Conference10.1109/IPCC.2009.5208683(1-5)Online publication date: Jul-2009

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media