In the second round of testing, the framework as developed in chapter 2 and in more detail in Appendix Evaluation of Writers' Aids was applied in an evaluation of the English grammar checker, E1. An evaluation was carried out of the functionality of the checker as stated in the accompanying documentation. We then applied the results of the evaluation to see whether the checker could meet the requirements of a specific user group. This comparison led to an extra round of testing of some of the specific user requirements which were not mentioned in the documentation.
The aim of performing the evaluation was to verify that the framework is indeed suited for the evaluation of an NLP product.