Skip to content

Ehud Reiter's Blog

Ehud's thoughts about Natural Language Generation. Also see my book on NLG.

  • Home
  • Blog Index
  • About
  • What is NLG
  • Publications
  • Resources
  • University
  • Book
  • Contact

Tag: Natural Language Generation

Uncategorized

PhD Studentship: Advanced Data Storytelling

May 19, 2017May 19, 2017 ehudreiter1 Comment

I’m looking for a PhD student to work on Advanced Data Storytelling!

Uncategorized

Regression to Mean

May 18, 2017May 18, 2017 ehudreiter1 Comment

Some explanation and advice about regression to mean, which is a statistical phenomena that can impact NLG evaluations.

Uncategorized

You Need to Understand your Corpora! The Weathergov Example

May 9, 2017May 9, 2017 ehudreiter8 Comments

People who use corpora to build NLG systems need to understand what is in the corpora. The widely used Weathergov corpus, for example, probably contains computer-generated texts rather than human-written texts. So learning from it is essentially reverse-engineering a rule-based NLG system.

Uncategorized

How to do an NLG Evaluation: Metrics

May 3, 2017May 5, 2017 ehudreiter6 Comments

I am really dubious about evaluations based on BLEU and other metrics. I explain why, and also give advice on best practice for people who are committed to using metrics

Uncategorized

How to do an NLG Evaluation: Task-Based (Extrinsic) Performance in Real-World Context

Apr 27, 2017Apr 27, 2017 ehudreiter5 Comments

Advice on how to evaluate an NLG system by getting people to use it in the real world, and then measuring how effective the system was.

Uncategorized

Academic Teaching vs Commercial Training Courses

Mar 29, 2017 ehudreiterLeave a comment

I’ve just finished delivering a commercial training course, it was a very different (and in many ways better) experience than the academic teaching I’ve done for decades

Uncategorized

Why isnt there More Open-Source NLG Software?

Mar 17, 2017Mar 17, 2017 ehudreiter5 Comments

Why isnt there more open-source NLG software, and what can be done to encourage more open-source NLG?

Uncategorized

How to do an NLG Evaluation: Human Ratings in Real-World Context

Feb 23, 2017 ehudreiter4 Comments

Advice on how to evaluate an NLG system by asking human subjects to rate the system, when they are using it in a real-world context.

Uncategorized

Writing NLG Pages for Wikipedia

Feb 15, 2017May 19, 2017 ehudreiter1 Comment

My experiences in writing NLG pages for Wikipedia; mostly positive, but sometimes frustrating.

Uncategorized

How do I Build an NLG System: Testing and Quality Assurance

Feb 10, 2017 ehudreiter2 Comments

How do we test an NLG system, and ensure that it is robust, reliable, and meets its quality goals?

Posts navigation

Older Posts
Newer posts
  • LinkedIn
  • Twitter

News: Come to my retirement symposium on NLG evaluation! https://retroeval.github.io/

Top Posts & Pages

  • My Eureka moments in research
  • "Will I Pass my PhD Viva"
  • Good diagrams for research papers
  • What LLMs cannot do
  • Blog Index
  • LLM hype brings memories of IBM Watson
  • Do a sanity check on your experiments
  • Dont ignore omissions!
  • Google: Please Stop Telling Lies About Me
  • MQM shows the power of a gold-standard evaluation
Blog at WordPress.com.
Ehud Reiter's Blog
Blog at WordPress.com.
  • Subscribe Subscribed
    • Ehud Reiter's Blog
    • Join 102 other subscribers.
    • Already have a WordPress.com account? Log in now.
    • Ehud Reiter's Blog
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...