Skip navigation Menu

• Executive summary
• Introduction
• Evaluation procedures and conformance
• Resources lists and Sampling
• Tests for conformance evaluation
• Aggregation model for test results
• Reporting of test results
• Scorecard report
• Appendices

Reporting of test results

Reporting of test results under UWEM needs to be unambiguously defined. To that end, the most suitable language is the Evaluation and Report Language EARL [EARL10-Schema], soon becoming a candidate recommendation within W3C. However, it must be acknowledged that this format is not the more suitable for expert evaluation, especially when there might be neither tools at hand that support EARL nor RDF knowledge by the expert. Therefore, UWEM offers the possibility of an alternative format to EARL following a descriptive approach following the template of Appendix B. This template is based on the W3C/WAI evaluation suite template that serves as a model for accessibility evaluation reports.

The proposed minimal detail level of reporting for expert evaluation is per checkpoint for the entire sample. More detailed reporting (such as reporting per test and/or reporting for each sampled resource) is optional.

The Evaluation and Report Language is a framework to express test results. The concept of a test under EARL is taken in a wider meaning, and can include bug reports, software unit tests, test suite evaluations, and conformance claims, among others. EARL is based upon RDF.