Table 1: Observer concordance for 27 Synchronous Studies. Overall agreement = percent agreement between pairs of observers (1-2, 1-3, 2-3). Complete agreement = exact grading agreement between all observers. Partial Discordance = one observer giving a one-grade difference from the other two observers. Complete discordance = at least one observer giving a two point grade difference from at least one other observer. Kappa interpretation: almost perfect (0.81 - 1.0), substantial agreement (0.61 - 0.80), moderate agreement (0.41 - 0.60).
| Observer concordance synchronous studies | |||||
| Overall agreement | Fleiss' free margin kappa | Complete agreement | Partial discordance (1 v. 2 or 2 v. 3) | Complete discordance (1 v. 3) | |
| ASL | 78% | 0.67 | 18/27 67% |
9/27 33% |
0/27 0% |
| DSC | 69% | 0.56 | 15/27 54% |
12/27 44% |
1/27 4% |