Skip to content

Ehud Reiter's Blog

Ehud's thoughts and observations about Natural Language Generation

  • Home
  • Blog Index
  • About
  • What is NLG
  • Publications
  • Resources
  • University
  • Contact

Category: Uncategorized

Uncategorized

chatGPT in Health: Exciting if we ignore the hype

Apr 9, 2023Apr 11, 2023 ehudreiterLeave a comment

I think there is a lot of potential in using chatGPT in healthcare, provided that we focus on real use cases instead of trying to debate whether chatGPT is somehow better than a doctor.

Uncategorized

Please check the boring details in your paper!

Sep 25, 2020 ehudreiterLeave a comment

Over the past few weeks, on several occasions I’ve struggled to understand papers because authors made mistakes in references, tables, figures,or formulas. I know that its boring for authors to check such things, but it makes life much easier for your readers!

Uncategorized

Objective evaluation of NLG texts

Sep 8, 2020Sep 8, 2020 ehudreiter1 Comment

I would love to be able to define objective criteria for evaluating NLG texts. In principle, I think we can use task-based evaluation to measure utility, and some kind of mistake counting to measure accuracy. However its harder to think of a way to measure fluency without relying on human judgements

Uncategorized

Reviewing has changed over the years; conferences need to change as well

Aug 24, 2020 ehudreiter3 Comments

Reviewing for big NLP conferences has changed drastically since 1990, when 11 senior researchers reviewed all ACL submissions. Perhaps our expectations about conference papers also need to change, and become more similar to expectations in other scientific fields.

Uncategorized

Is GPT3 Useful for NLG?

Aug 10, 2020 ehudreiter1 Comment

Many people have asked me if OpenAI’s GPT3 will have a big impact on NLG. I suspect its overall impact will be limited (outside of a few niches), but of course time will tell.

Uncategorized

Small differences in BLEU are meaningless

Jul 28, 2020 ehudreiter6 Comments

I was very impressed by a paper we recently read in our reading group, which showed that small differences in BLEU scores for MT usually dont mean anything. Since lots of academic papers justify a new model on the basis of such small differences, this is a real problem for NLP.

Uncategorized

We Need Robust Ways to Select Content of NLG Texts

Jul 13, 2020Jul 13, 2020 ehudreiter3 Comments

NLG texts need to communicate good content as well as be accurate. Rule-based NLG systems are very good at accuracy, but sometimes struggle to reliably choose appropriate content in a wide variety of circumstances.

Uncategorized

I enjoy reviewing for TACL

Jun 22, 2020Jun 22, 2020 ehudreiter1 Comment

Most reviewing is a chore, but reviewing for TACL is fun. I learn things and feel I “add value”, which is much rarer in conference reviewing. Plus I can focus on one paper at a time, since TACL reviewing is spread out across the year.

Uncategorized

Human editing of NLG texts

Jun 8, 2020 ehudreiterLeave a comment

If an NLG system produces inferior texts once in a while, should we ask a human writer to “post-edit” NLG texts? I review some of the literature and give some advice.

Uncategorized

Adding Narrative to a Covid Dashboard

May 21, 2020 ehudreiter2 Comments

The Tibco Covid dashboard is a nice example of how NLG narratives can “add value” to complex visualisations. Hopefully we’ll see more dashboards like this!

Posts navigation

Older Posts
  • LinkedIn
  • Twitter

Top Posts & Pages

  • ACL vs TACL Reviewing
  • Future of NLG evaluation: LLMs and high quality human eval?
  • "Will I Pass my PhD Viva"
  • Evaluating chatGPT
  • How to Validate Metrics
  • Publications
  • Bayesian vs Neural Networks
  • Good Papers are Hard to Publish
  • Blog Index
  • Unresponsive Authors and Experimental Flaws
Blog at WordPress.com.
Ehud Reiter's Blog
Blog at WordPress.com.
  • Follow Following
    • Ehud Reiter's Blog
    • Join 83 other followers
    • Already have a WordPress.com account? Log in now.
    • Ehud Reiter's Blog
    • Customise
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...