Skip to content

Ehud Reiter's Blog

Ehud's thoughts about Natural Language Generation. Also see my book on NLG.

  • Home
  • Blog Index
  • About
  • What is NLG
  • Publications
  • Resources
  • University
  • Book
  • Contact

Month: May 2017

Uncategorized

PhD Studentship: Advanced Data Storytelling

May 19, 2017May 19, 2017 ehudreiter1 Comment

I’m looking for a PhD student to work on Advanced Data Storytelling!

Uncategorized

Regression to Mean

May 18, 2017May 18, 2017 ehudreiter1 Comment

Some explanation and advice about regression to mean, which is a statistical phenomena that can impact NLG evaluations.

Uncategorized

You Need to Understand your Corpora! The Weathergov Example

May 9, 2017May 9, 2017 ehudreiter8 Comments

People who use corpora to build NLG systems need to understand what is in the corpora. The widely used Weathergov corpus, for example, probably contains computer-generated texts rather than human-written texts. So learning from it is essentially reverse-engineering a rule-based NLG system.

Uncategorized

How to do an NLG Evaluation: Metrics

May 3, 2017May 5, 2017 ehudreiter6 Comments

I am really dubious about evaluations based on BLEU and other metrics. I explain why, and also give advice on best practice for people who are committed to using metrics

  • LinkedIn
  • Twitter

News: I am likely to retire in summer 2026. Looking for interesting things to do afterwards.

Top Posts & Pages

  • What LLMs cannot do
  • Retirement Plans: Travel and some academics
  • Types of NLG Evaluation: Which is Right for Me?
  • Even good leaderboards may not be useful, because they are gamed
  • Do LLM coding benchmarks measure real-world utility?
  • Exercise: Find Problems in an Evaluation
  • Blog Index
  • Hallucination in Neural NLG
  • Most common uses of AI in Healthcare
  • Do a sanity check on your experiments
Blog at WordPress.com.
  • Subscribe Subscribed
    • Ehud Reiter's Blog
    • Join 102 other subscribers.
    • Already have a WordPress.com account? Log in now.
    • Ehud Reiter's Blog
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar