Jumbled-up sentences show that AIs still don’t really understand language
By Will Douglas Heaven,
MIT Technology Review
| 01. 12. 2021
Many AIs that appear to understand language and that score better than humans on a common set of comprehension tasks don’t notice when the words in a sentence are jumbled up, which shows that they don’t really understand language at all. The problem lies in the way natural-language processing (NLP) systems are trained; it also points to a way to make them better.
Researchers at Auburn University in Alabama and Adobe Research discovered the flaw when they tried to get an NLP system to generate explanations for its behavior, such as why it claimed different sentences meant the same thing. When they tested their approach, they realized that shuffling words in a sentence made no difference to the explanations. “This is a general problem to all NLP models,” says Anh Nguyen at Auburn University, who led the work.
The team looked at several state-of-the-art NLP systems based on BERT (a language model developed by Google that underpins many of the latest systems, including GPT-3). All of these systems score better than humans on GLUE (General Language Understanding Evaluation)...
Related Articles
By Fyodor Urnov, Time | 08.12.2024
After a lifetime in the field of epigenetics, and nearly 20 years after my colleagues and I coined the term “genome editing,” I will be the first to admit that describing the “epigenome”—a marvelous biological process that guides...
By Azeen Ghorayshi and Sarah Kliff, The New York Times | 08.12.2024
An emerging movement against in vitro fertilization is driving some doctors and patients in red states to move or destroy frozen embryos.
The embryo migration is most striking in Alabama, where the State Supreme Court ruled in February that embryos...
By Gemma Conroy, Nature | 06.27.2024
Image by Robina Weermeijer from Unsplash
A molecular-editing tool that’s small enough to be delivered to the brain shuts down the production of proteins that cause prion diseases, a rare but deadly group of neurodegenerative disorders.
The system — known...
By Staff, AP-NORC | 07.12.2024
Image by Dr. Jayesh Amin from Wikimedia Commons licensed under CC by-SA 3.0
Most adults support protecting access to in vitro fertilization, or IVF, a type of fertility treatment where eggs are combined with sperm outside the body in a...