skip to main content
10.1145/1456536.1456551acmconferencesArticle/Chapter ViewAbstractPublication PagesdocConference Proceedingsconference-collections
research-article

An evaluation of web accessibility metrics based on their attributes

Published: 22 September 2008 Publication History

Abstract

Accessibility is a concept related to providing access to Web content to people with different abilities and people using different devices. A number of metrics have been proposed in the last years to help to obtain quantitative Web accessibility levels. Each Web development project has different aspects, and the choice of a given Web accessibility metric should be carefully considered according to the needs of the project. In this paper, we present a review on the main existing Web accessibility metrics, emphasizing the main features and comparing their correlations from experimental data obtained from large scale evaluations. Project managers and evaluators should consider specific features for each given project to effectively choose a proper metric. Needs to adjust customized coefficients or to adhere to automatic evaluation tools are important issues to be observed.

References

[1]
C. Benavídez, J. Fuertes, E. Gutiérrez, and L. Martínez. Semi-Automatic Evaluation of Web Accessibility with HERA 2.0. In Proceedings of the 10th International Conference on Computers Helping People with Special Needs (ICCHP 2006), pages 199--206. Springer, 2006
[2]
L. C. Briand, C. M. Differding, and H. D. Rombach. Practical Guidelines for Measurement-Based Process Improvement. Software Process Improvement and Practice Journal, 2(4), 1997.
[3]
C. Buhler, H. Heck, O. Perlick, A. Nietzio, and N. Ulltveit-Moe. Interpreting results from large-scale automatic evaluation of web accessibility. In Computers Helping People with Special Needs, volume 4061/2006, pages 184--191. Springer Berlin / Heidelberg, 2006.
[4]
W. W. A. B. Cluster. Unified Web Evaluation Methodology (UWEM 1.0), 2006. Available at http://www.wabcluster.org/uwem/. Last access on January/2008.
[5]
M. K. Daskalantonakis. A Practical View of Software Measurement and Implementation Experiences within Motorola. IEEE Transactions on Software Engineering, 18(11):998 -- 1010, 1992.
[6]
Dix, J. E. Finlay, G. D. Abowd, and R. Beale. Human-Computer Interaction. Prentice Hall, 3a. edition, 2003.
[7]
N. E. Fenton and S. L. Pfleeger. Software Metrics: A Rigorous and Practical Approach. PWS Publishing Co., Boston, MA, USA, 1998.
[8]
P. Freire, T. J. Bittar, and R. P. M. Fortes. An approach based on metrics for monitoring web accessibility in brazilian municipalities web sites. In Proceedings of the 23rd Annual ACM Symposium on Applied Computing, pages 2420--2424. ACM Press, 2008.
[9]
P. Freire, R. Goularte, and R. P. de Mattos Fortes. Techniques for developing more accessible web applications: a survey towards a process classification. In SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication, pages 162--169, New York, NY, USA, 2007. ACM Press.
[10]
P. Freire, E. H. Tanaka, S. M. A. de Lara, H. V. Rocha, and R. P. M. Fortes. Comparing accessibility in web based e-learning environments: a metric based approach. In Proceedings of the XIII Brazilian Symposium on Multimedia and the Web (Webmedia), pages 49--56. ACM Press, 2007.
[11]
Fuggetta, L. Lavazza, S. Morasca, S. Cinti, G. Oldano, and E. Orazi. Applying GQM in an Industrial Software Factory. ACM Transactions on Software Engineering and Methodology, 7(4):411--448, 1998.
[12]
J. Gonzalez, M. Macias, R. Rodriguez, and F. Sanchez. Accessibility metrics of web pages for blind end-users. In Proceedings of the 2003 International Conference on Web Engineering (ICWE), pages 374--383, Oviedo, Spain, 2003. Springer Berlin / Heidelberg.
[13]
ISO - International Standard Organization, New York, NY. (ISO/IEC 12207) Standard for Information Technology - Software Lifecycle Processes, 1998. 85 S.
[14]
ISO - International Standard Organization. (ISO 9126-1) Software Engineering - Product Quality-Part 1: Quality Model. Geneva, 2001.
[15]
M. Y. Ivory, R. R. Sinha, and M. A. Hearst. Empirically validated web page design metrics. In CHI '01: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 53--60, New York, NY, USA, 2001. ACM.
[16]
S. Kan. Metrics and Models in Software Quality Engineering. Addison Wesley, 1995.
[17]
L. Lavazza and G. Barresi. Automated support for process-aware definition and execution of measurement plans. In ICSE '05: Proceedings of the 27th international conference on Software engineering, pages 234--243, New York, NY, USA, 2005. ACM.
[18]
E. M. Mendes, N. Mosley, and S. Counsell. Web Metrics - Estimating Design and Authoring Effort. IEEE Multimedia, 8(1):50--57, 2001.
[19]
L. Olsina and G. Rossi. Measuring Web Application Quality with WebQEM. IEEE MultiMedia, 9(4):20--29, 2002.
[20]
Parmanto and X. Zeng. Metric for Web accessibility evaluation. Journal of the American Society for Information Science and Technology, 56(33):1394--1404, 2005.
[21]
H. Petrie, F. Hamilton, N. King, and P. Pavan. Remote usability evaluations with disabled people. In CHI '06: Proceedings of the SIGCHI conference on Human Factors in computing systems, pages 1133--1141, New York, NY, USA, 2006. ACM Press.
[22]
S. L. Pfleeger. Software Engineering: Theory and Practice. Prentice-Hall, Upper Saddle River New Jersey, 2a edition, 2001.
[23]
I. Spinuzzi. Learning our abcs: accessibility, bottlenecks, and control in an organized research unit's website. In SIGDOC '07: Proceedings of the 25th annual ACM international conference on Design of communication, pages 201--206, New York, NY, USA, 2007. ACM.
[24]
T. Sullivan and R. Matson. Barriers to use: usability and content accessibility on the Web's most popular sites. In CUU '00: Proceedings on the 2000 conference on Universal Usability, pages 139--144, New York, NY, USA, 2000. ACM Press.
[25]
M. Vigo, M. Arrue, G. Brajnik, R. Lomuscio, and J. Abascal. Quantitative metrics for measuring web accessibility. In W4A '07: Proceedings of the 2007 international cross-disciplinary conference on Web accessibility (W4A), pages 99--107, New York, NY, USA, 2007. ACM Press.
[26]
W3C. Web Content Accessibility Guidelines 1.0, 1999. Available at http://www.w3c.org/TR/WCAG10. Last access at February/2008.
[27]
W3C. Web Content Accessibility Guidelines 2.0 - Working Draft, 2007. Available at http://www.w3c.org/TR/WCAG20. Last access at February/2008.
[28]
X. Zeng. Evaluation and Enhancement of Web Content Accessibility for Persons with Disabilities. PhD thesis, University of Pittsburgh, 2004.

Cited By

View all
  • (2113)Intelligent Interaction in Accessible ApplicationsA Multimodal End-2-End Approach to Accessible Computing10.1007/978-1-4471-5082-4_5(93-117)Online publication date: 26-Mar-2113
  • (2024)Towards Designing a Set of Usability and Accessibility Heuristics Focused on Cognitive Diversity: An Exploratory Case Study with Generative Artificial IntelligenceInformation10.3390/info1512076915:12(769)Online publication date: 2-Dec-2024
  • (2024)Developing a blind user mental model (BlUMM) for web browsingUniversal Access in the Information Society10.1007/s10209-023-01035-523:3(1343-1367)Online publication date: 1-Aug-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGDOC '08: Proceedings of the 26th annual ACM international conference on Design of communication
September 2008
303 pages
ISBN:9781605580838
DOI:10.1145/1456536
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 September 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility metrics
  2. information accessibility
  3. web accessibility
  4. web engineering

Qualifiers

  • Research-article

Funding Sources

Conference

SIGDOC '08
Sponsor:

Acceptance Rates

Overall Acceptance Rate 355 of 582 submissions, 61%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)38
  • Downloads (Last 6 weeks)1
Reflects downloads up to 15 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2113)Intelligent Interaction in Accessible ApplicationsA Multimodal End-2-End Approach to Accessible Computing10.1007/978-1-4471-5082-4_5(93-117)Online publication date: 26-Mar-2113
  • (2024)Towards Designing a Set of Usability and Accessibility Heuristics Focused on Cognitive Diversity: An Exploratory Case Study with Generative Artificial IntelligenceInformation10.3390/info1512076915:12(769)Online publication date: 2-Dec-2024
  • (2024)Developing a blind user mental model (BlUMM) for web browsingUniversal Access in the Information Society10.1007/s10209-023-01035-523:3(1343-1367)Online publication date: 1-Aug-2024
  • (2024)Large-scale study of web accessibility metricsUniversal Access in the Information Society10.1007/s10209-022-00956-x23:1(411-434)Online publication date: 1-Mar-2024
  • (2022)A Systematic Review of Web Accessibility MetricsApp and Website Accessibility Developments and Compliance Strategies10.4018/978-1-7998-7848-3.ch004(77-108)Online publication date: 2022
  • (2021)Addressing Workplace Accessibility Practices Through Technical Communication Research Methods: One Size Does Not Fit AllIEEE Transactions on Professional Communication10.1109/TPC.2021.309403664:3(221-234)Online publication date: Sep-2021
  • (2021)Evaluating and Improving Accessibility of Web Applications: Zulip Chat Case Study2021 17th International Computer Engineering Conference (ICENCO)10.1109/ICENCO49852.2021.9698944(112-117)Online publication date: 29-Dec-2021
  • (2021)Evaluating the accessibility of public health websites: An exploratory cross-country studyUniversal Access in the Information Society10.1007/s10209-020-00788-721:3(771-789)Online publication date: 27-Jan-2021
  • (2021)User Experience and Trustworthiness Measurement: Challenges in the Context of e-Commerce ApplicationsProceedings of the Future Technologies Conference (FTC) 2021, Volume 110.1007/978-3-030-89906-6_13(173-192)Online publication date: 24-Oct-2021
  • (2020)Towards an evaluation method of how accessible serious games are to older adults2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH)10.1109/SeGAH49190.2020.9201655(1-8)Online publication date: Aug-2020
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media