Skip to content

Ehud Reiter's Blog

Ehud's thoughts about Natural Language Generation. Also see my book on NLG.

  • Home
  • Blog Index
  • About
  • What is NLG
  • Publications
  • Resources
  • University
  • Book
  • Contact

Tag: ecological validity

Uncategorized

How to do an NLG Evaluation: Task-Based (Extrinsic) Performance in Real-World Context

Apr 27, 2017Apr 27, 2017 ehudreiter5 Comments

Advice on how to evaluate an NLG system by getting people to use it in the real world, and then measuring how effective the system was.

Uncategorized

Types of NLG Evaluation: Which is Right for Me?

Jan 19, 2017May 3, 2017 ehudreiter10 Comments

A high-level discussion of the different ways of evaluating NLG systems.

  • LinkedIn
  • Twitter

News: I am likely to retire in summer 2026. Looking for interesting things to do afterwards.

Top Posts & Pages

  • What LLMs cannot do
  • Publish in Journals!
  • Do LLMs cheat on benchmarks
  • We need better LLM benchmarks
  • Is building neural NLG faster than rules NLG? No one knows, but I suspect not.
  • Generated Texts Must Be Accurate!
  • Do We Encourage Researchers to Use Inappropriate Data Sets?
  • Benchmarks distract us from what matters
  • Google: Please Stop Telling Lies About Me
  • We Need Robust Ways to Select Content of NLG Texts
Blog at WordPress.com.
  • Subscribe Subscribed
    • Ehud Reiter's Blog
    • Join 100 other subscribers.
    • Already have a WordPress.com account? Log in now.
    • Ehud Reiter's Blog
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar