How to do an NLG Evaluation: Metrics
I am really dubious about evaluations based on BLEU and other metrics. I explain why, and also give advice on best practice for people who are committed to using metrics
Author: ehudreiter
How to do an NLG Evaluation: Task-Based (Extrinsic) Performance in Real-World Context
Advice on how to evaluate an NLG system by getting people to use it in the real world, and then measuring how effective the system was.
Academic Teaching vs Commercial Training Courses
I’ve just finished delivering a commercial training course, it was a very different (and in many ways better) experience than the academic teaching I’ve done for decades
Why isnt there More Open-Source NLG Software?
Why isnt there more open-source NLG software, and what can be done to encourage more open-source NLG?
How to do an NLG Evaluation: Human Ratings in Real-World Context
Advice on how to evaluate an NLG system by asking human subjects to rate the system, when they are using it in a real-world context.
Writing NLG Pages for Wikipedia
My experiences in writing NLG pages for Wikipedia; mostly positive, but sometimes frustrating.
How do I Build an NLG System: Testing and Quality Assurance
How do we test an NLG system, and ensure that it is robust, reliable, and meets its quality goals?
How do I Build an NLG System: Requirements and Corpora
The key to success in building an NLG system is getting requirements right; this is true of software in general, and its true of NLG.
How do I Build an NLG System: Tools?
What are the best tools for building NLG systems?
Types of NLG Evaluation: Which is Right for Me?
A high-level discussion of the different ways of evaluating NLG systems.
Ehud Reiter's Blog 