Case Study: MYCIN
MYCIN was a medial expert system
- recommended therapy for blood/meningitis infections
How to evaluate its recommendations?
Shortliffe used
- 10 sample problems
- 8 other therapy recommenders
- 5 faculty at Stanford Med. School, 1 senior resident, 1 senior postdoctoral researcher, 1 senior student
- 8 impartial judges gave 1 point per problem
- Max score was 80
- Mycin: 65 Faculty 40-60, Fellow 60, Resident 45, Student 30