Case Study: MYCIN
Control for judge’s bias for/against computers
- judges did not know who recommended each therapy
Control for easy problems
- medical student did badly, so problems not easy
Control for our standard being low
- e.g. random choice should do worse
Control for factor of interest
- e.g. hypothesis in MYCIN that “knowledge is power”
- have groups with different levels of knowledge