Towards a New Generation of Human-Inspired Language Models

Towards a New Generation of Human-Inspired Language Models

Can a computer learn a language the way a child does? A recent study published in the leading journal Computational Linguistics by professors Katrien Beuls (University of Namur) and Paul Van Eecke (AI Lab, Vrije Universiteit Brussel) sheds new light on this question. The researchers advocate for a fundamental revision of how artificial intelligence acquires and processes language.

"Children learn their native language by communicating with the people around them in their environment. As they play and experiment with language, they attempt to interpret the intentions of their conversation partners. In this way, they gradually learn to understand and use linguistic constructions. This process, in which language is acquired through interaction and meaningful context, is at the core of human language acquisition," says Katrien Beuls.

"The current generation of large language models (LLMs), such as ChatGPT, learns language in a very different way," adds Paul Van Eecke. "By observing vast amounts of text and identifying which words frequently appear together, they generate texts that are often indistinguishable from human writing. This results in models that are extremely powerful in many forms of text generation—such as summarizing, translating, or answering questions—but that also exhibit inherent limitations. They are susceptible to hallucinations and biases, often struggle with human reasoning, and require enormous amounts of data and energy to build and operate."

The researchers propose an alternative model in which artificial agents learn language as humans do—by engaging in meaningful communicative interactions within their environment. Through a series of experiments, they demonstrate how these agents develop linguistic constructions that are directly linked to their surroundings and sensory perceptions. This leads to language models that:

  • Are less prone to hallucinations and biases, as their language comprehension is grounded in direct interaction with the world.
  • Use data and energy more efficiently, resulting in a smaller ecological footprint.
  • Are more deeply rooted in meaning and intention, enabling them to understand language and context in a more human-like manner.

"Integrating communicative and situated interactions into AI models is a crucial step in developing the next generation of language models. This research offers a promising path toward language technologies that more closely resemble how humans understand and use language," the researchers conclude.

 

Reference:

Katrien Beuls, Paul Van Eecke; Humans Learn Language from Situated Communicative Interactions. What about Machines?. Computational Linguistics 2024; 50 (4): 1277–1311. doi: https://doi.org/10.1162/coli_a_00534


Contact:

Katrien Beuls
katrien.beuls@unamur.be
​+32 (0)81 72 55 13

Paul Van Eecke
paul@ai.vub.ac.be
​+32 (0)2 629 37 01

Koen Stein
Koen Stein Perscontact wetenschap & innovatie

 

 

 

WE
About Press - Vrije Universiteit Brussel

Vrije Universiteit Brussel is an internationally oriented university in Brussels, the heart of Europe. By providing excellent research and education on a human scale, VUB wants to make an active and committed contribution to a better society.

The World Needs You

The Vrije Universiteit Brussel assumes its scientific and social responsibility with love and decisiveness. That’s why VUB launched the platform De Wereld Heeft Je Nodig – The World Needs You, which brings together ideas, actions and projects based on six Ps. The first P stands for People, because that’s what it’s all about: giving people equal opportunities, prosperity, welfare, respect. Peace is about fighting injustice, big and small, in the world. Prosperity combats poverty and inequality. Planet stands for actions on biodiversity, climate, air quality, animal rights... With Partnership, VUB is looking for joint actions to make the world a better place. The sixth and last P is for Poincaré, the French philosopher Henri Poincaré, from whom VUB derives its motto that thinking should submit to nothing except the facts themselves. VUB is an ‘urban engaged university’, strongly anchored in Brussels and Europe and working according to the principles of free research.

www.vub.be/dewereldheeftjenodig

 


Press - Vrije Universiteit Brussel
Pleinlaan 2
1050 Brussel