How to do an NLG Evaluation: Task-Based (Extrinsic) Performance in Real-World Context
Advice on how to evaluate an NLG system by getting people to use it in the real world, and then measuring how effective the system was.
Tag: evaluation
How to do an NLG Evaluation: Human Ratings in Real-World Context
Advice on how to evaluate an NLG system by asking human subjects to rate the system, when they are using it in a real-world context.
Types of NLG Evaluation: Which is Right for Me?
A high-level discussion of the different ways of evaluating NLG systems.
How to do an NLG Evaluation: Human Ratings in Artificial Context
Advice on how to evaluate an NLG system by asking human subjects to rate the system, in an artificial experiment context (ie, not real world usage). This is the most common type of NLG evaluation
Evaluation in Medicine and NLG/NLP
Evaluation in NLP/NLG has a long way to go before it reaches the standards of hypothesis testing in clinical medicine
Ehud Reiter's Blog 