Description of Evaluation/Error Analysis Plan

For this assignment, you should write a short paper (1-2 pages total) addressing the following:

• State the task you are approaching
• Describe the evaluation metric you will be using (should be standard for the task)
  • Illustrate this description with at least one sample output compared to the corredponsing sample gold standard (drawn from train or dev data)
• Describe the test data (how much, drawn from what source)
• Prelimiary error analysis over the output of the baseline system. What kinds of errors do you find? How do you go about finding/categorizing them? How frequent is each type?

Turn in the paper (as pdf) to CollectIt under "Evaluation plan", by 5/9.