Libraries E-Resource Accessibility Testing
Overview
As part of the UW Libraries’ commitment to equitable service and access, we evaluate all third-party subscription electronic resources, such as databases, for accessibility before procurement or renewal.
Need Help?
For assistance, or if you have suggestions or comments, please contact UW Libraries Accessibility.
Project Guidelines
This work has several parts:
- We perform a keyboard navigation test as an initial screen.
- We review and score the vendor’s Accessibility Conformance Report (ACR), also known as a completed Voluntary Product Accessibility Template (VPAT).
- We negotiate contracts to include language that addresses accessibility or attach the UW Digital Accessibility Rider.
- We check for relevant testing performed by the Library Accessibility Alliance.
Products that do not pass the keyboard navigation test or have a poor VPAT/ACR score undergo more thorough evaluation and are subject to non-renewal.
Our work closely follows UW Accessible Technology Procurement guidance.
Testing Results
Interpreting Test Results
Keyboard Navigation Testing
Keyboard navigation testing is used as an initial screening tool. If a resource passes the keyboard test, further testing will need to be done to determine if a resource is fully accessible to WCAG 2.1 AA standards. However, we know that if a resource cannot pass the keyboard test, it is likely to be unusable by assistive technology like screen readers.
The data presented in the table shows the Keyboard Test Score, the VPAT score, and the total Accessibility Risk Score. Scores are reviewed annually.
Keyboard Test Score
This test is done in three parts. Each part gets one point if the task is not possible using just the keyboard. Score can range from 0 to 3, where 0 means it passes the keyboard test and 3 means it is probably unusable by assistive technology
- Perform Search: Can I perform a search using keyboard navigation?
- Retrieve Result: Can I select a specific search result using keyboard navigation?
Use Result: Can I interact with the selected search result (scroll, turn pages, etc) using keyboard navigation?
VPAT score
A rubric is used to rate a VPAT from 0 – 7.
VPAT Completion Score: 0-2 points possible.
- Zero points: The VPAT is complete; all metadata fields filled in; complete statements used.
- 2 points if most/all fields were left blank or are very vague, not far from the default template.
- 1 point for somewhere in between.
VPAT Success Score: 0-3 points possible.
- Zero points: specific testing methods listed; almost all success criteria show “supports” or “supports with exceptions”, comments in most of the success criteria fields.
- One point: specific testing methods listed, many “partially supports” or “does not support” with comments.
- Two points if no specific testing methods listed, many “partially supports” or “does not support” with comments.
- Three points if most of the success criteria show “does not support”, there are no comments; no specific testing methods listed. Also consider giving three points if every criteria is listed as “supports” or “not applicable” and no comments.
VPAT and Keyboard Test Agree: 0-2 points possible.
Success Criteria 1.3.1 requires keyboard navigation compatibility. What was the result from the keyboard navigation test? What does the VPAT say about SC 1.3.1? Do they agree?
- Zero points if the results are the same for both.
Two points if they disagree. It is not possible to get one point in this category.
Accessibility Risk Score
The Accessibility Risk Score is the sum of the Keyboard Test Score and the VPAT score, and ranges from 0 to 10. A result of 0 means the resource is very likely to be accessible. A score of 10 means the resource is almost definitely inaccessible.