Skip to content

Ehud Reiter's Blog

Ehud's thoughts about Natural Language Generation. Also see my book on NLG.

  • Home
  • Blog Index
  • About
  • What is NLG
  • Publications
  • Resources
  • University
  • Book
  • Contact

Tag: ecological validity

Uncategorized

How to do an NLG Evaluation: Task-Based (Extrinsic) Performance in Real-World Context

Apr 27, 2017Apr 27, 2017 ehudreiter5 Comments

Advice on how to evaluate an NLG system by getting people to use it in the real world, and then measuring how effective the system was.

Uncategorized

Types of NLG Evaluation: Which is Right for Me?

Jan 19, 2017May 3, 2017 ehudreiter10 Comments

A high-level discussion of the different ways of evaluating NLG systems.

  • LinkedIn
  • Twitter

News: I have now formally retired from Aberdeen University.

Top Posts & Pages

  • Desk rejection is an unfortunate necessity
  • Localising NLG content in a driving feedback system
  • What LLMs cannot do
  • Publications
  • Do LLMs cheat on benchmarks
  • Pragmatic correctness is a challenge for NLG
  • Book
  • Do LLM coding benchmarks measure real-world utility?
  • What is the purpose of ACL conferences?
  • I am worried by NLP research culture
Blog at WordPress.com.
  • Subscribe Subscribed
    Ehud Reiter's Blog
    Join 107 other subscribers.

    Have a WordPress.com account? Log in now.

  • Ehud Reiter's Blog
    View site in Reader
    Manage subscriptionsSign upLog in
    Report this content
    Collapse this bar