Response to Goldberg’s Blog on Deep Learning for NLG
My response to Goldberg’s “adversarial review” of some research on using deep learning in NLG
Study Design for Systematic Review of BLEU Validity: Comments Welcome!
I’m planning to do a systematic review of the validity of BLEU, and am very keen to get comments and suggestions on study design from others!
Cycling through Northern England
A short travelogue about a holiday cycling trip I did in May 2017 (nothing to do with NLG!)
PhD Studentship: Advanced Data Storytelling
I’m looking for a PhD student to work on Advanced Data Storytelling!
Regression to Mean
Some explanation and advice about regression to mean, which is a statistical phenomena that can impact NLG evaluations.
You Need to Understand your Corpora! The Weathergov Example
People who use corpora to build NLG systems need to understand what is in the corpora. The widely used Weathergov corpus, for example, probably contains computer-generated texts rather than human-written texts. So learning from it is essentially reverse-engineering a rule-based NLG system.
How to do an NLG Evaluation: Metrics
I am really dubious about evaluations based on BLEU and other metrics. I explain why, and also give advice on best practice for people who are committed to using metrics
How to do an NLG Evaluation: Task-Based (Extrinsic) Performance in Real-World Context
Advice on how to evaluate an NLG system by getting people to use it in the real world, and then measuring how effective the system was.
Academic Teaching vs Commercial Training Courses
I’ve just finished delivering a commercial training course, it was a very different (and in many ways better) experience than the academic teaching I’ve done for decades
Why isnt there More Open-Source NLG Software?
Why isnt there more open-source NLG software, and what can be done to encourage more open-source NLG?
Ehud Reiter's Blog 