Above, we tested some of the quality characteristics which are part of the coverage claimed by the producers in their documentation. However, as mentioned earlier, an evaluation has to take its point of departure in actual user requirements. As it is a big task in itself to establish such user requirements, we chose to use the list provided by the producer and to supplement it by requirements of a specific user group. The only indication of intended users of E1 is a small paragraph in the documentation stating that professionals as well as students may benefit from using the grammar checker. We have chosen to focus on second language students.
The second language students whose requirements we describe, are Danish students aged 16-19 years having been taught English in school for 7-10 years.
Below are the ten most frequent error types for the user group according to (Faerch84). The list is not ordered, but the error types mentioned cover about 80 of the total amount of errors, so together they constitute the most important part.
Some of these problems are specific to Danish writers, some specific to second language writers of English in general, and some belong to the more general area of errors of writers of English. As could be hoped, some of these error types are already part of the list established by the grammar checker provider. But there are also types which were not explicitly mentioned. Below we have chosen to test two of these, i.e. Tense, Aspect and Modality and Collectives.
She's been seen.
He's been succeeding.
The reason for the lower precision score is that there seems to be a gap in its coverage of auxiliaries. Incorrect sentences containing 'have' as an auxiliary are typically not rejected: