Ceiling Effects
DataSet: BC CH GL G2 HD HE … Mean
C4 72 99.2 63.2 74.3 73.6 81.2 ... 85.9
1R* 72.5 69.2 56.4 77 78 85.1 ... 83.8
Max 72.5 99.2 63.2 77 78 85.1 … 87.4
- C4 achieves only about 2% better than 1R*
- If we take the best of the C4/1R* in each case, we can only achieve 87.4% accuracy
- We have only weak evidence that C4 better
- both methods performing near ceiling of possible
- Ceiling effect is that we can’t compare the two methods well because both are achieving near the best practicable