Table 3: Assessment based on Quality Appraisal of Reliability Studies (QAREL) checklist.
| Item | Criteria | |||||||||
| 1 | Was the sample of subject’s representative? | |||||||||
| 2 | Was the sample of rater’s representative? | |||||||||
| 3 | Were raters blinded to the findings of other raters? | |||||||||
| 4 | Were raters blinded to their own prior findings? | |||||||||
| 5 | Were raters blinded to the accepted reference standard? | |||||||||
| 6 | Were raters blinded to clinical information not part of test? | |||||||||
| 7 | Were raters blinded to additional non-clinical cues? | |||||||||
| 8 | Was the order of examination varied? | |||||||||
| 9 | Was the time interval between repeated measures appropriate? | |||||||||
| 10 | Was the test applied correctly and interpreted appropriately? | |||||||||
| 11 | Were appropriate statistical measures of agreement used? | |||||||||
| Item | Friesecke | Claridge | Bollen | Mehta | David | Mentzelopoulos | Cartotto | Mehta | Ferguson | Finkielman |
| 1 | Y | N | Y | Y | Y | Y | Y | N | Y | N |
| 2 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 3 | N | N | U | N | N | Y | N | N | N | N |
| 4 | N | N | U | N | N | Y | N | N | N | N |
| 5 | N | N | U | N | N | U | N | N | N | N |
| 6 | U | N | U | N | N | U | N | N | N | N |
| 7 | U | N | U | U | N | Y | N | N | N | N |
| 8 | U | U | Y | N | U | Y | N | N | N | U |
| 9 | U | U | Y | Y | Y | Y | N | N | Y | Y |
| 10 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 11 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| Total | 4\11 | 3\11 | 6\11 | 5\11 | 5\11 | 9\11 | 4\11 | 3\11 | 5\11 | 4\11 |
| % | 36% | 27% | 55% | 45% | 45% | 82% | 36% | 27% | 45% | 36% |
| Item | Friesecke | Fort | Anderson | Young | Derdak | Demory | Ferguson | Papazian | Shah | Pachl |
| 1 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 2 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 3 | N | N | N | Y | Y | Y | U | Y | Y | N |
| 4 | N | N | N | Y | Y | Y | U | Y | Y | N |
| 5 | N | N | N | Y | Y | Y | U | Y | Y | N |
| 6 | N | N | N | Y | Y | Y | U | Y | Y | N |
| 7 | N | N | N | Y | Y | Y | U | Y | Y | N |
| 8 | U | U | N | Y | U | U | Y | Y | Y | U |
| 9 | Y | Y | Y | U | U | U | Y | U | U | Y |
| 10 | Y | Y | Y | Y | Y | Y | Y | Y | Y | Y |
| 11 | Y | Y | Y | Y | Y | U | Y | Y | U | Y |
| Total | 4\11 | 5\11 | 5\11 | 10\11 | 9\11 | 8\11 | 6\11 | 10\11 | 9\11 | 5\11 |
| % | 36% | 45% | 45% | 91% | 82% | 73% | 55% | 91% | 82% | 45% |