In 2016, I was shocked by the poor scientific quality of research in neural NLG. Fortunately, the situation is better in 2021! However, progress has been less than I had hoped, I think in part because the “leaderboard” culture does not encourage good science.
I’m looking for a PhD student to work on using AI and NLG to help cancer patients who are managing their condition at home. The student will be jointly supervised by people at Aberdeen’s Medical School. I think this is a very exciting PhD, and a chance to work on ideas that could make a real difference to people’s lives!
Why would anyone use a Bayesian model instead of a neural model in clinical decision support? Perhaps because the Bayesian model is much easier to justify and adapt to a changing world. Explaining Bayesian models is also a really interesting research challenge, and one of my colleagues has funding for a PhD student in this area.
I am really excited by the potential of NLG in healthcare. However, if we want to build real-world NLG systems which improve health, we need to surmount the “pain points” of data, evaluation, and safety.
If you are considering using a new dataset from a repository such as Kaggle, you should first check that the data in the dataset is of high quality and appropriate for your needs. A bit of “due diligence” at the beginning can stop you wasting lots of time and effort on an unsuitable data set.
I was surprised to find out that some institutions require PhD students to publish a certain number of papers before they can graduate. This is not my view; my goal as a supervisor is to train students to be good scientists, and rigid publication targets are not appropriate for this goal.
I’m a strong proponent of human evaluations, but they need to be high quality in order to give meaningful results; a quick/cheap/sloppy human evaluation may not be very useful.
Texts produced by NLG systems need to communicate valuable, useful, and accurate information. I would love to see more research on content production and selection in NLG.
If we want to use NLG to communicate information to all sorts of different people, then it would be really helpful if the NLG system can adapt its language to the reading skill, domain knowledge, emotional state, etc of the user. I think this kind of user adaptation is essential to achieving my vision of using NLG to humanise data.
I think NLG can help humanise and democratise data and AI reasoning. If so, this would provide huge benefits to society in a world which will increasingly by driven by data and data-based reasoning.
Ehud Reiter's Blog 