Autonomous Learning Paradigm for Spiking Neural Networks

Junxiu Liu, Liam J. McDaid, Jim Harkin, Shvan Karim, Anju P. Johnson, David M. Halliday, Andy M. Tyrrell, Jon Timmis, Alan G. Millard, James Hilder

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Compared to biological systems, existing learning systems lack the ability to learn autonomously, especially in changing and dynamic environments. This paper addresses the issue of autonomous learning by developing a self-learning spiking neural network (SNN) and demonstrating its autonomous learning capability using a simple robot controller application. Our proposed learning rule exploits an inherit property of the existing Spike-Timing-Dependent Plasticity (STDP) rule in that if the instantaneous presynaptic frequency decreases, then for a conventional Hebbian window the STDP rule potentiates. Conversely if the instantaneous frequency increases the STDP rule depresses: the opposite is true for anti-Hebbian window. This paper will also show that obstacle avoidance is achievable using a conventional Hebbian learning window while object tracking can be learned using an anti-Hebbian learning window. Hence the proposed learning paradigm is novel in that it does not require external supervisions for either these tasks. The proposed learning paradigm also uses a previously explored astrocyte neuron interaction where a periodic Slow Inward Current (SIC) from an astrocyte can potentiate a postsynaptic neuron for a period of time: this time window can be used to strengthen/weaken synaptic pathways. An obstacle avoidance task is used for the performance analysis and results show that the SNN based robot controller has autonomous learning capabilities under the dynamic conditions.

Original languageEnglish
Title of host publicationArtificial Neural Networks and Machine Learning – ICANN 2019
Subtitle of host publicationTheoretical Neural Computation - 28th International Conference on Artificial Neural Networks, 2019, Proceedings
EditorsIgor V. Tetko, Pavel Karpov, Fabian Theis, Vera Kurková
PublisherSpringer Verlag
Pages737-744
Number of pages8
ISBN (Print)9783030304867
DOIs
Publication statusPublished - 9 Sep 2019
Externally publishedYes
Event28th International Conference on Artificial Neural Networks - Munich, Germany
Duration: 17 Sep 201919 Sep 2019
Conference number: 28
https://e-nns.org/icann2019/

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11727 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference28th International Conference on Artificial Neural Networks
Abbreviated titleICANN 2019
CountryGermany
CityMunich
Period17/09/1919/09/19
Internet address

Fingerprint Dive into the research topics of 'Autonomous Learning Paradigm for Spiking Neural Networks'. Together they form a unique fingerprint.

Cite this