skip to main content
10.1145/1296843.1296853acmconferencesArticle/Chapter ViewAbstractPublication PagesassetsConference Proceedingsconference-collections
Article

SAMBA: a semi-automatic method for measuring barriers of accessibility

Published: 15 October 2007 Publication History

Abstract

Although they play an important role in any assessment procedure, web accessibility metrics are not yet well developed and studied. In addition, most metrics are geared towards conformance, and therefore are not well suited to answer questions whether the web site has critical barriers with respect to some user group.
The paper addresses some open issues: how can accessibility be measured other than by conformance to certain guidelines? How can a metric merge results produced by accessibility evaluation tools and by expert reviewers? Does it consider error rates of the tool? How can a metric consider also severity of accessibility barriers? Can a metric tell us if a web site is more accessible for certain user groups rather than others?.
The paper presents a new methodology and associated metric for measuring accessibility that efficiently combine expert reviews with automatic evaluation of web pages. Examples and data drawn from tests performed on 1500 web pages are also presented.

References

[1]
M. Arrue, M. Vigo, and J. Abascal. Quantitative allallmetrics for web accessibility evaluation. In Proceedings of the ICWE 2005 Workshop on Web Metrics and Measurement, 2005.
[2]
G. Brajnik. Comparing accessibility evaluation tools: method for tool effectiveness. Universal Access in the Information Society, 3(3-4):252--263, Oct 2004. www.springerlink.com/openurl.asp?genre=article&id=
[3]
G. Brajnik. Web Accessibility Testing: When the Method is the Culprit. In K. Miesenberger, J. Klaus, W. Zagler, and A. Karshmer, editors, ICCHP 2006, 10th International Conference on Computers Helping People with Special Needs, Lecture Notes in Computer Science 4061, Linz, Austria, July 2006. Springer Verlag.
[4]
G. Brajnik. Web accessibility testing with barriers walkthrough. www.dimi.uniud.it/giorgio/projects/bw, March 2006. Visited: May 2007.
[5]
G. Brajnik. Ranking websites through prioritized web accessibility barriers. In Technology and Persons with Disabilities Conference, Los Angeles, March 2007. CSUN, California State University Northridge. www.dimi.uniud.it/giorgio/papers/csun07.pdf.
[6]
G. Brajnik, A. Mulas, and C. Pitton. Effects of sampling methods on web accessibility evaluations. In S. Trewin, editor, 9th Int. ACM SIGACCESS Conference on Computers and Accessibility, ASSETS, Tempe, AZ, Oct 2007. ACM Press.
[7]
T. DeMarco. Controlling Software Projects: Management, Measurement, and Estimates. Prentice Hall PTR, 1986.
[8]
A. Sears. Heuristic walkthroughs: finding the problems without the noise. Int. Journal of Human Computer Interaction, 9(3):213--234, 1997.
[9]
J. Slatin and S. Rush. Maximum Accessibility: Making Your Web Site More Usable for Everyone. Addison-Wesley, 2003.
[10]
T. Sullivan and R. Matson. Barriers to use: usability and content accessibility on the web's most popular sites. In Proc. of ACM Conference on Universal Usability, pages 139--144, 2000.
[11]
J. Thatcher, M. Burks, C. Heilmann, S. Henry, A. Kirkpatrick, P. Lauke, B. Lawson, B. Regan, R. Rutter, M. Urban, and C. Waddell. Web Accessibility: Web Standards and Regulatory Compliance. Friends of ED, 2006.
[12]
U. S. Government. SEC. 508. ELECTRONIC AND INFORMATION TECHNOLOGY, 1998 Amendment to Section 508 of the Rehabilitation Act. www.section508.gov/index.cfm?FuseAction=Content&ID=14, 1998. Visited: January 2007.
[13]
E. Velleman, C. A. Velasco, M. Snaprud, and D. Burger. D-WAB4 Unified Web Evaluation Methodology (UWEM 1.0). Technical report, WAB Cluster, 2006.
[14]
M. Vigo, M. Arrue, G. Brajnik, R. Lomuscio, and J. Abascal. Quantitative metrics for measuring web accessibility. In W4A '07: Proceedings of the 2007 International Cross-Disciplinary Workshop on Web Accessibility (W4A), pages 99--107, New York, NY, USA, 2007. ACM Press. www.dimi.uniud.it/giorgio/papers/w4a07.pdf.
[15]
X. Zeng. Evaluation of Enhancement of Web Content Accessibility for Persons with Disabilities. PhD thesis, University of Pittsburgh, 2004.

Cited By

View all
  • (2024)ALT-D: Enhancing Accessibility with an Adaptive Learning Technologies Assessment Model for Students with Disabilities2024 IEEE 30th International Conference on Telecommunications (ICT)10.1109/ICT62760.2024.10606129(1-5)Online publication date: 24-Jun-2024
  • (2024)Large-scale study of web accessibility metricsUniversal Access in the Information Society10.1007/s10209-022-00956-x23:1(411-434)Online publication date: 1-Mar-2024
  • (2022)A Systematic Review of Web Accessibility MetricsApp and Website Accessibility Developments and Compliance Strategies10.4018/978-1-7998-7848-3.ch004(77-108)Online publication date: 2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
Assets '07: Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
October 2007
282 pages
ISBN:9781595935731
DOI:10.1145/1296843
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2007

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. accessibility
  2. accessibility metric
  3. evaluation method
  4. quality assessment
  5. web accessibility

Qualifiers

  • Article

Conference

ASSETS07
Sponsor:

Acceptance Rates

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)21
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)ALT-D: Enhancing Accessibility with an Adaptive Learning Technologies Assessment Model for Students with Disabilities2024 IEEE 30th International Conference on Telecommunications (ICT)10.1109/ICT62760.2024.10606129(1-5)Online publication date: 24-Jun-2024
  • (2024)Large-scale study of web accessibility metricsUniversal Access in the Information Society10.1007/s10209-022-00956-x23:1(411-434)Online publication date: 1-Mar-2024
  • (2022)A Systematic Review of Web Accessibility MetricsApp and Website Accessibility Developments and Compliance Strategies10.4018/978-1-7998-7848-3.ch004(77-108)Online publication date: 2022
  • (2022)Helping Students with Upper Limb Motor Impairments Program in a Block-Based Programming Environment Using Voiceundefined10.12794/metadc1985949Online publication date: Aug-2022
  • (2022)Comparative Analysis of Accessibility Testing Tools and Their Limitations in RIAsHCI International 2022 – Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging10.1007/978-3-031-17902-0_34(479-500)Online publication date: 16-Oct-2022
  • (2020)A Heuristic Method for Evaluating Accessibility in Web-Based Serious Games for Users with Low VisionApplied Sciences10.3390/app1024880310:24(8803)Online publication date: 9-Dec-2020
  • (2019)A Heuristic Method to Evaluate Web Accessibility for Users With Low VisionIEEE Access10.1109/ACCESS.2019.29390687(125634-125648)Online publication date: 2019
  • (2019)FuturamaWeb Accessibility10.1007/978-1-4471-7440-0_40(791-803)Online publication date: 4-Jun-2019
  • (2019)Automatic Web Accessibility MetricsWeb Accessibility10.1007/978-1-4471-7440-0_27(505-521)Online publication date: 4-Jun-2019
  • (2018)Feasibility of Automatically Assigning Severity Scores to Web Accessibility ProblemsProceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3234695.3241001(364-366)Online publication date: 8-Oct-2018
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media