Instructions for Accessibility Evaluations

Overview

The epubtest.org website allows both EPUB 3 Feature Conformance Testing as well as Accessibility Testing of reading systems. The instructions below apply to accessibility evaluations. If you are interested in EPUB 3 conformance testing, please see the section Instructions for Evaluators.

The basic assumption of evaluating accessibility is that all reading systems should support reading with eyes, ears, and fingers. It should be possible for users to read the content of the document by:

To evaluate the accessibility of reading systems, test plans have been prepared with sample content to carry out the tests; the test books provide tests and instructions to the person conducting the test. The reading systems should be evaluated using a wide variety of assistive technologies, e.g. screen readers, magnifiers, Braille displays and alternative input. Results from the testing of the various configurations must be stored in the form provided on the website.

Back to top

Getting Registered

If you want to evaluate the accessibility of EPUB 3 reading systems, please contact info@bisg.org and describe the reading system(s) you want to evaluate and the assistive technology you would use. Please also provide a short description of your qualifications or experience.

If you have additional accessibility related questions, you can use the Contact Us form on the DAISY Consortium website and select Reading System Evaluations in the message category. Your inquiry will be routed to a person from the DAISY Consortium, who will answer your questions.

A BISG representative or the appointed moderator will contact you to supervise the testing of your selected reading system. You will be added as an evaluator and provided the appropriate login credentials. You can then evaluate the accessibility of reading systems using the test books and testing form provided on the site. Testing results will be stored in a central database and may be reviewed by moderators before publishing. The moderator who contacts you will be your go-to person for assistance in any testing related questions.

If you are interested in being a moderator, please see the description of qualifications and duties and contact us via one of the methods above.

Back to top

Getting Started

  1. Go to the Manage section.
  2. Choose "Add Evaluation". On the next page select the Reading System you want to evaluate.
  3. You may first wish to add a reading system if it's not already listed on the site.
  4. Under "Select Test Suite", choose Accessibility and click Save.
  5. You will need to provide information on the Assistive Technology, input type and output modes you will test on the next page. You can put any additional information you want to include in the Notes field. Click "Save and continue to next section" button.

Back to top

Performing the tests

  1. The evaluation is broken up into one or more sections, depending on the Test Suite being evaluated against.
  2. There is a link at the top of the page for each section where you can download the required EPUBs You may also download them from the Test Suite page.
  3. Open the fundamental test book in your Reading System. You will see a series of tests. Each test in the test book has an ID such as file-010. These test IDs correspond to the entries in the form open now on the EPUBTEST website.
  4. Each test includes a description of its purpose followed by the actual test statement, which can generally be determined either to be supported or not supported.
  5. The results of each test should be recorded in the corresponding field in the form. There is a text field for comments in the online form.
  6. You can save the incomplete evaluation form and return to finish it later.
  7. When you have completed all tests, contact your moderator or send an email to info@bisg.org to publish your results.
  8. With time more test books may be added for accessibility evaluation or tests may be modified. Your accessibility evaluation will then be flagged as "Update Required". You are encouraged to visit the site frequently and update your evaluation when requested.