JUNE 25, 2024 by Diana Yates, University of Illinois at Urbana-Champaign

Collected at: https://techxplore.com/news/2024-06-cyberslug-cyberoctopus-ai-explores-novelty.html

By giving artificial intelligence simple associative learning rules based on the brain circuits that allow a sea slug to forage—and augmenting it with better episodic memory, like that of an octopus—scientists have built an AI that can navigate new environments, seek rewards, map landmarks and overcome obstacles.

Reported in the journal Neurocomputing, the new approach gives AI the ability to explore and gather the information it needs to expand its spatial and temporal awareness, growing its knowledge base while learning on the job, said Ekaterina Gribkova, a postdoctoral researcher at the University of Illinois Urbana-Champaign who led the study with U. of I. molecular and integrative physiology professor emeritus Rhanor Gillette, with support from agricultural and biological engineering professor Girish Chowdhary.

“This essentially makes our artificial intelligence much more animal-like than current artificial intelligences,” Gribkova said. “We are learning how to go from something like the memory of a sea slug, which is very, very simple, to something like us.”

The new approach has the added advantage of being more efficient than the standard method of pretraining AI with vast amounts of data before it performs basic functions, she said.

By adding a memory module that allows the AI to retain information about past events, very simple spatial learning can be expanded to much more complex learning, Gribkova said.

“We can use the same types of associations to learn, for example, sequences of motor behaviors, or how to map social networks or even linguistic problem-solving,” she said. “Learning in the spatial domain, and actually navigating the environment making shortcuts, which our memory module is able to do, can be very well applied to more abstract concepts.”

To achieve this, the team built on their previous work simulating the decision-making neural circuits of a sea slug of the genus Pleurobranchaea, a project known as “Cyberslug.” They named their simulated creature ASIMOV, after Isaac Asimov, a science fiction writer who explored the safety concerns and ethics of robotics in human society.

From 'CyberSlug' to 'CyberOctopus': New AI explores, remembers, seeks novelty, overcomes obstacles
Rhanor Gillette, left, and Ekaterina Gribkova developed an AI that can navigate new environments, seek novelty and rewards, and learn in real time. Their research into the neural pathways that drive behavior in sea slugs and octopuses guided the work. Credit: Fred Zwicky

The researchers programmed ASIMOV to monitor its own internal state and seek satiation and reward. When it was “hungry,” after not having eaten for a while, ASIMOV learned through trial and error to select nutritious over noxious food items. When the researchers added an intoxicating simulated drug to its range of options, ASIMOV behaved as if addicted, chasing after the drug even though it had no nutritional value.

ASIMOV lived in the moment, however, and while it could learn from experience, its memory and ability to integrate information from past experiences were limited. So Gribkova added a computational module for episodic memory, called the Feature Association Matrix, modeled on the architecture and functions of the hippocampus, a brain region essential to learning and memory. This work also was informed by studies of the brain networks that drive behavior in an octopus. The researchers called the ASIMOV-FAM agent a “CyberOctopus.”

“Episodic memory encodes both spatial and temporal contexts of past events and experience,” the authors wrote. This is a fundamental building block of natural intelligence, which most current AI models lack, they said.

More information: Ekaterina D. Gribkova et al, Cognitive mapping and episodic memory emerge from simple associative learning rules, Neurocomputing (2024). DOI: 10.1016/j.neucom.2024.127812

Leave a Reply

Your email address will not be published. Required fields are marked *

0 0 votes
Article Rating
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments