Affect-driven learning in an avalanche neural network modeling early ...

1 downloads 0 Views 293KB Size Report
Jul 13, 2009 - early sensorimotor intelligence. Richard E Hill*, Quinn Macpherson and Richard B Wells. Address: MRC Institute, University of Idaho, Moscow, ...
BMC Neuroscience

BioMed Central

Open Access

Poster presentation

Affect-driven learning in an avalanche neural network modeling early sensorimotor intelligence Richard E Hill*, Quinn Macpherson and Richard B Wells Address: MRC Institute, University of Idaho, Moscow, ID, 83844-1024, USA Email: Richard E Hill* - [email protected] * Corresponding author

from Eighteenth Annual Computational Neuroscience Meeting: CNS*2009 Berlin, Germany. 18–23 July 2009 Published: 13 July 2009 BMC Neuroscience 2009, 10(Suppl 1):P143

doi:10.1186/1471-2202-10-S1-P143

Eighteenth Annual Computational Neuroscience Meeting: CNS*2009

Don H Johnson Meeting abstracts – A single PDF containing all abstracts in this Supplement is available here. http://www.biomedcentral.com/content/pdf/1471-2202-10-S1-info.pdf

This abstract is available from: http://www.biomedcentral.com/1471-2202/10/S1/P143 © 2009 Hill et al; licensee BioMed Central Ltd.

This paper discusses a key learning element in an agentbased model of early sensorimotor learning during the first month of life. The system is based on the hypothesis that the earliest learned habits are driven by affectivity (innate non-objective preferences) and are grafted onto innate sensorimotor habits. The agent demonstrates the ability for learned associations, gradually overriding innate reflexes and producing learned voluntary motions. Additionally, the agent exhibits learned avoidance behaviors that could override innate affective preferences and reflexes [1].

reflexes supply the unconditioned stimulus and learned responses are formed by mimicking these primitive reflexes (see Figure 1). Over time, the learned associations gradually take over control of motor movement execution by means of a simple assimilation network. This paper deals primarily with the learning dynamics of the 3-level avalanche.

The key learning element discussed here is an enhanced three-layer avalanche chain network. Avalanche chain neural network theory [2] was originally developed by Grossberg to model motor learning based upon a psychological model. He presented a conceptual mathematical schema for these systems. In this work, we report a specific implementation of the system. One finding of this work is that the original 2-level Grossberg topology must be extended to a 3-level system to deal with interruptions and unanticipated changes in the affective state of the agent. Specific sets of mathematical equations implementing robust avalanche chain learning are presented.

References

Acknowledgements This work was supported by the National Science Foundation, award # 0648202.

1.

2.

Hill R, Macpherson Q, Wells R: Conditioned learning dynamics in avalanche chain neural networks. 1st INCF Congress on Neuroinformatics 2008 Abstracts, "Databasing and modeling the brain," International Neuroinformatics Coordinating Facility, Stockholm, Sweden, Sept. 7–9 2008:108. Grossberg S: A theory of human memory: Self-organization and performance of sensory-motor codes, maps, and plans. In Progress in theoretical biology Volume 5. Edited by: Rosen R, Snell S. New York: Academic Press; 1978:233-374.

The avalanche network proxies functions of the motor cortex and lower level motor networks (e.g. in brain stem). Its learning dynamics are aroused by signals generated in a proxy limbic system and associated dipole-network conditioning functions [2]. Pre-set innate motor

Page 1 of 2 (page number not for citation purposes)

BMC Neuroscience 2009, 10(Suppl 1):P143

http://www.biomedcentral.com/1471-2202/10/S1/P143

Figurediagram Block 1 of learning agent Block diagram of learning agent.

Publish with Bio Med Central and every scientist can read your work free of charge "BioMed Central will be the most significant development for disseminating the results of biomedical researc h in our lifetime." Sir Paul Nurse, Cancer Research UK

Your research papers will be: available free of charge to the entire biomedical community peer reviewed and published immediately upon acceptance cited in PubMed and archived on PubMed Central yours — you keep the copyright

BioMedcentral

Submit your manuscript here: http://www.biomedcentral.com/info/publishing_adv.asp

Page 2 of 2 (page number not for citation purposes)

Suggest Documents