Note on Baselines
Many Evaluations Weak
- 2-way Ambiguous Words
- Small Sets, Isolated
Baseline: Human
- 2-way forced choice > 90%
- Many-way: as low as 60-70%
Baseline: Corpus
- 28% One Sense - For Free
- Multi-Sense
- Guessing: 28%, Frequency, Co-occurrence: 58%
- Overall: 70%
- Note: Ambiguous: 70%