Neural Network Model with Discrete and Continuous Information Representation
スポンサーリンク
概要
- 論文の詳細を見る
An associative memory model and a neural network model with a Mexican-hat type interaction are two major attractor neural network models. The associative memory model has discretely distributed fixed-point attractors, and achieves a discrete information representation. On the other hand, a neural network model with a Mexican-hat type interaction uses a ring attractor to achieves a continuous information representation, which can be seen in the working memory in the prefrontal cortex and columnar activity in the visual cortex. In the present study, we propose a neural network model that achieves discrete and continuous information representation. We use a statistical–mechanical analysis to find that a localized retrieval phase exists in the proposed model, where the memory pattern is retrieved in the localized subpopulation of the network. In the localized retrieval phase, the discrete and continuous information representation is achieved by using the orthogonality of the memory patterns and the neutral stability of fixed points along the positions of the localized retrieval. The obtained phase diagram suggests that the antiferromagnetic interaction and the external field are important for generating the localized retrieval phase.
- 2009-11-15
著者
-
Okada Masato
Graduate School Of Engineering Science Osaka University
-
Omori Toshiaki
Graduate School of Frontier Sciences, The University of Tokyo, 5-1-5 Kashiwanoha, Kashiwa, Chiba 277-8561, Japan
-
Kitazono Jun
Graduate School of Frontier Sciences, The University of Tokyo, 5-1-5 Kashiwanoha, Kashiwa, Chiba 277-8561
関連論文
- Statistical Mechanical Study of Code-Division Multiple-Access Multiuser Detectors : Analysis of Replica Symmetric and One-Step Replica Symmetry Breaking Solutions(General)
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- Retrieval Property of Attractor Network with Synaptic Depression(General)
- Analysis of Ensemble Learning Using Simple Perceptrons Based on Online Learning Theory
- Retrieval of Branching Sequences in an Associative Memory Model with Common External Input and Bias Input(Cross-disciplinary physics and related areas of science and technology)
- Residual Energies after Slow Quantum Annealing(General)
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex(General)
- Image Restoration with a Truncated Gaussian Model(General)
- Statistical Mechanics of On-line Node-perturbation Learning
- Ensemble Learning of Linear Perceptrons : On-Line Learning Theory(General)
- Analysis of XY Model with Mexican-Hat Interaction on a Circle
- Exact Inference in Discontinuous Firing Rate Estimation Using Belief Propagation
- Influence of Synaptic Depression on Memory Storage Capacity
- Neural Network Model of Spatial Memory: Associative Recall of Maps
- Statistical Mechanics of On-Line Mutual Learning with Many Linear Perceptrons
- Statistical Mechanics of Mutual Learning with a Latent Teacher(General)
- Mean Field Analysis of Stochastic Neural Network Models with Synaptic Depression
- Rate Reduction for Associative Memory Model n Hodgkin-Huxley-Type Network(Cross-disciplinary physics and related areas of science and technology)
- Higher Order Effects on Rate Reduction for Networks of Hodgkin-Huxley Neurons(Cross-disciplinary physics and related areas of science and technology)
- Estimation of Intracellular Calcium Ion Concentration by Nonlinear State Space Modeling and Expectation-Maximization Algorithm for Parameter Estimation
- Neural Network Model with Discrete and Continuous Information Representation
- Estimating Membrane Resistance over Dendrite Using Markov Random Field
- Stability Analysis of Stochastic Neural Network with Depression and Facilitation Synapses
- Analysis of XY Model with Mexican-Hat Interaction on a Circle ---Derivation of Saddle Point Equations and Study of Bifurcation Structure---
- Solvable Model of a Phase Oscillator Network on a Circle with Infinite-Range Mexican-Hat-Type Interaction
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex
- Image Segmentation and Restoration Using Switching State-Space Model and Variational Bayesian Method
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- Stability Analysis of Attractor Neural Network Model of Inferior Temporal Cortex —Relationship between Attractor Stability and Learning Order—
- Bayesian Image Restoration for Medical Images Using Radon Transform
- Statistical Mechanics of Mexican-Hat-Type Horizontal Connection
- Statistical Mechanics of Node-Perturbation Learning for Nonlinear Perceptron
- Inter-Layer Correlation in a Feed-Forward Network with Intra-Layer Common Noise
- Continuous Attractor that Appears in Autoassociative Memory Model Extended to XY Spin System
- Statistical–Mechanical Analysis of Attractor Dynamics in a Hysteretic Neuron Network
- A Numerical Analysis of Learning Coefficient in Radial Basis Function Network
- Inter-Layer Correlation in a Feed-Forward Network with Intra-Layer Common Noise
- Analysis of Ensemble Learning Using Simple Perceptrons Based on Online Learning Theory