Skip to content

Ehud Reiter's Blog

Ehud's thoughts about Natural Language Generation. Also see my book on NLG.

  • Home
  • Blog Index
  • About
  • What is NLG
  • Publications
  • Resources
  • University
  • Book
  • Contact

Tag: shared task

Uncategorized

Shared Task on Evaluating Accuracy?

Feb 18, 2020Feb 1, 2021 ehudreiter1 Comment

We’re thinking of organising a shared task on evaluating the accuracy of texts produced by NLG systems. Comments welcome, also let me know if you might participate.

  • LinkedIn
  • Twitter

News: I am likely to retire in summer 2026. Looking for interesting things to do afterwards.

Top Posts & Pages

  • Retirement Plans: Travel and some academics
  • What LLMs cannot do
  • Even good leaderboards may not be useful, because they are gamed
  • Types of NLG Evaluation: Which is Right for Me?
  • Hallucination in Neural NLG
  • Most common uses of AI in Healthcare
  • Blog Index
  • Do a sanity check on your experiments
  • Do LLM coding benchmarks measure real-world utility?
  • I'm very worried about data contamination
Blog at WordPress.com.
  • Subscribe Subscribed
    • Ehud Reiter's Blog
    • Join 102 other subscribers.
    • Already have a WordPress.com account? Log in now.
    • Ehud Reiter's Blog
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar