Rater | 2 | 3 | 4 | 5 |
---|---|---|---|---|
1 | 0.91 (0.83–0.99) | 0.96 (0.91–1.0) | 0.91 (0.83–0.99) | 0.89 (0.80–0.98) |
2 | 0.94 (0.88–1.0) | 0.85 (0.75–0.95) | 0.83 (0.73–0.94) | |
3 | 0.91 (0.83–0.99) | 0.85 (0.75–0.95) | ||
4 | 0.83 (0.73–0.94) |
↵a Interrater reliabilities between each pair of raters ranged from 0.83–0.96. The average coefficient was 0.89. The smallest 95% CI lower limit was 0.73, and the largest upper limit was 1.0. Although a formula for computing the PABAK interreliability for more than 2 raters simultaneously is not available, using this mean and range of confidence limits provides a reasonable approximation of the interrater reliability of the 5 raters simultaneously (PABAK, 0.89; 95% CI, 0.73–1.0).