Skip to content

Ehud Reiter's Blog

Ehud's thoughts about Natural Language Generation. Also see my book on NLG.

  • Home
  • Blog Index
  • About
  • What is NLG
  • Publications
  • Resources
  • University
  • Book
  • Contact

Category: Uncategorized

Uncategorized

Exciting NLG Research Topics (June 2017)

Jun 20, 2017Jun 20, 2017 ehudreiterLeave a comment

A visitor recently asked me what NLG research topics I found most interesting and exciting. Great question, I’ve written here an expanded version of what I told him.

Uncategorized

Response to Goldberg’s Blog on Deep Learning for NLG

Jun 19, 2017Jan 3, 2018 ehudreiter13 Comments

My response to Goldberg’s “adversarial review” of some research on using deep learning in NLG

Uncategorized

Study Design for Systematic Review of BLEU Validity: Comments Welcome!

Jun 13, 2017Jun 13, 2018 ehudreiter5 Comments

I’m planning to do a systematic review of the validity of BLEU, and am very keen to get comments and suggestions on study design from others!

Uncategorized

Cycling through Northern England

Jun 6, 2017Jun 7, 2017 ehudreiter1 Comment

A short travelogue about a holiday cycling trip I did in May 2017 (nothing to do with NLG!)

Uncategorized

PhD Studentship: Advanced Data Storytelling

May 19, 2017May 19, 2017 ehudreiter1 Comment

I’m looking for a PhD student to work on Advanced Data Storytelling!

Uncategorized

Regression to Mean

May 18, 2017May 18, 2017 ehudreiter1 Comment

Some explanation and advice about regression to mean, which is a statistical phenomena that can impact NLG evaluations.

Uncategorized

You Need to Understand your Corpora! The Weathergov Example

May 9, 2017May 9, 2017 ehudreiter8 Comments

People who use corpora to build NLG systems need to understand what is in the corpora. The widely used Weathergov corpus, for example, probably contains computer-generated texts rather than human-written texts. So learning from it is essentially reverse-engineering a rule-based NLG system.

Uncategorized

How to do an NLG Evaluation: Metrics

May 3, 2017May 5, 2017 ehudreiter6 Comments

I am really dubious about evaluations based on BLEU and other metrics. I explain why, and also give advice on best practice for people who are committed to using metrics

Uncategorized

How to do an NLG Evaluation: Task-Based (Extrinsic) Performance in Real-World Context

Apr 27, 2017Apr 27, 2017 ehudreiter5 Comments

Advice on how to evaluate an NLG system by getting people to use it in the real world, and then measuring how effective the system was.

Uncategorized

Academic Teaching vs Commercial Training Courses

Mar 29, 2017 ehudreiterLeave a comment

I’ve just finished delivering a commercial training course, it was a very different (and in many ways better) experience than the academic teaching I’ve done for decades

Posts navigation

Older Posts
Newer posts
  • LinkedIn
  • Twitter

News: Come to my retirement symposium on NLG evaluation! https://retroeval.github.io/

Top Posts & Pages

  • Do LLMs cheat on benchmarks
  • What LLMs cannot do
  • Good diagrams for research papers
  • What is NLG
  • "Will I Pass my PhD Viva"
  • Challenges in Evaluating LLMs
  • MQM shows the power of a gold-standard evaluation
  • About
  • Publish in Journals!
  • Questions from readers of my book
Blog at WordPress.com.
Ehud Reiter's Blog
Blog at WordPress.com.
  • Subscribe Subscribed
    • Ehud Reiter's Blog
    • Join 102 other subscribers.
    • Already have a WordPress.com account? Log in now.
    • Ehud Reiter's Blog
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...