Theory of Time Domain Ensemble On-Line Learning of Perceptron under the Existence of External Noise(General)
スポンサーリンク
概要
- 論文の詳細を見る
We analyze the time domain ensemble on-line learning of a Perceptron under the existence of external noise. We adopt three typical learning rules, Hebbian, Perceptron, and AdaTron rules. We treat the input and output noises. In order to improve the learning when it does not succeed in the sense that the student vector does not converge to the teacher vector, we use an averaging method and give theoretical analysis of the method. We obtain the precise formula for the overlap between the teacher vector and the time averaged student vector for t→∞ limit as a function of the number of student vectors to be averaged. We compare the theoretical results with numerical simulations and find that the theoretical results agree quite well with the numerical simulations.
- 社団法人日本物理学会の論文
- 2007-11-15
著者
-
OKADA Masato
Division of Protein Metabolism, Institute for Protein Research, Osaka University
-
Miyoshi Seiji
Department Of Electronic Engineering Kobe City College Of Technology
-
Miyoshi Seiji
Department Of Electrical And Electronic Engineering Faculty Of Engineering Science Kansai University
-
OKADA MASATO
Graduate School of Frontier Sciences, The University of Tokyo
-
UEZU Tatsuya
Graduate School of Humanities and Sciences, Nara Women's University
-
Uezu Tatsuya
Graduate School Of Human Culture Nara Women's University
-
Miyoshi Seiji
Kobe City College Of Technology
-
IZUO Mika
Department of Physics, Faculty of Science, Nara Women's University
-
Izuo Mika
Department Of Physics Faculty Of Science Nara Women's University
-
OKADA Masato
University of Tokyo
-
Okada Masato
Division Of Transdisciplinary Of Sciences Graduate School Of Frontier Sciences The University Of Tok
-
Okada Masato
Division Of Protein Metabolism Institute For Protein Research Osaka University
-
Uezu Tatsuya
Nara Women's Univ. Nara
-
OKADA Masato
Laboratory for Mathematical Neuroscience, RIKEN Brain Science Institute:"Intelligent Cooperation and Control", PRESTO, JST, co RIKEN BSI:Department of Complexity Science and Engineering, Graduate School of Frontier Sciences, the University of To
-
Okada Masato
Division of Allergy and Rheumatology, St. Luke's International Hospital, Japan
-
OKADA Masato
Division of Allergy and Rheumatology, St. Luke's International Hospital
関連論文
- Analysis Method Combining Monte Carlo Simulation and Principal Component Analysis : Application to Sourlas Code(General)
- A PCA Approach to Sourlas Code Analysis
- Comparison of Survival-Promoting Effects of Brain-Derived Neurotrophic Factor and Neurotrophin-3 on PC12h Cells Stably Expressing TrkB Receptor^1
- Statistical Mechanics of On-Line Node-Perturbation Learning
- Statistical Mechanical Study of Code-Division Multiple-Access Multiuser Detectors : Analysis of Replica Symmetric and One-Step Replica Symmetry Breaking Solutions(General)
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- Retrieval Property of Attractor Network with Synaptic Depression(General)
- Analysis of Ensemble Learning Using Simple Perceptrons Based on Online Learning Theory
- Retrieval of Branching Sequences in an Associative Memory Model with Common External Input and Bias Input(Cross-disciplinary physics and related areas of science and technology)
- Effect of Slow Switching of Ensemble Teachers in On-line Learning
- Statistical Mechanics of Online Learning for Ensemble Teachers(General)
- Residual Energies after Slow Quantum Annealing(General)
- On-line Learning of Perceptron from Noisy Data by One and Two Teachers(General)
- A Theoretical Analysis of On-Line Learning Using Correlated Examples
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex(General)
- Distinction of Coexistent Attractors in an Attractor Neural Network Model Using a Relaxation Process of Fluctuations in Firing Rates : Analysis with Statistical Mechanics(General)
- Dynamical Behavior of Phase Oscillator Networks on the Bethe Lattice(General)
- Theory of Time Domain Ensemble On-Line Learning of Perceptron under the Existence of External Noise(General)
- Statistical Mechanics of Time-Domain Ensemble Learning(General)
- Transfer Matrix Method for Instantaneous Spike Rate Estimation
- Image Restoration with a Truncated Gaussian Model(General)
- Depolarization-Induced Tyrosine Phosphorylation of p130^
- Estimation of Distribution Algorithm Incorporating Switching
- Exact Inference in Discontinuous Firing Rate Estimation Using Belief Propagation
- Response to Invasion by Antigens and Effects of Threshold in an Immune Network Dynamical System Model with a Small Number of Degrees of Freedom
- Analysis of an Immune Network Dynamical System Model with a Small Number of Degrees of Freedom
- Naive Mean Field Approximation for Sourlas Error Correcting Code(Biocybernetics, Neurocomputing)
- Statistical Mechanics of Mexican-Hat-Type Horizontal Connection
- Associative memory by recurrent neural networks with delay elements
- Statistical Mechanical Analysis of Simultaneous Perturbation Learning
- Bayesian-Optimal Image Reconstruction for Translational-Symmetric Filters(Cross-disciplinary physics and related areas of science and technology)
- A Novel Clock-Related Protein, SCOP, in the Suprachiasmatic Nucleus
- A Large Scale Dynamical System Immune Network Model with Finite Connectivity(Oscillation, Chaos and Network Dynamics in Nonlinear Science)
- Analysis of XY Model with Mexican-Hat Interaction on a Circle
- Statistical Mechanics of Nonlinear On-line Learning for Ensemble Teachers(General)
- Analysis of On-Line Learning when a Moving Teacher Goes around a True Teacher(General)
- On the Conditions for the Existence of Perfect Learning and Power Law Behaviour in Learning from Stochastic Examples by Ising Perceptrons
- Learning of Non-Monotonic Target Functions by Ising Perceptrons : Learning Curve, Perfect Learning and Perfect Anti-Learning (General)
- Analysis of XY model with mexican-hat interaction on a circle : Derivation of saddle point equations and study of bifurcation structure
- Rate Reduction for Associative Memory Model n Hodgkin-Huxley-Type Network(Cross-disciplinary physics and related areas of science and technology)
- Higher Order Effects on Rate Reduction for Networks of Hodgkin-Huxley Neurons(Cross-disciplinary physics and related areas of science and technology)
- Statistical Mechanics of On-line Learning When a Moving Teacher Goes around an Unlearnable True Teacher(General)
- Statistical Mechanics of Linear and Nonlinear Time-Domain Ensemble Learning(General)
- Solvable Model of a Phase Oscillator Network on a Circle with Infinite-Range Mexican-Hat-Type Interaction
- Online Learning of Perceptron from Noisy Data: A Case in which Both Student and Teacher Suffer from External Noise
- Effect of Slow Switching of Ensemble Teachers in On-line Learning
- Retrieval Properties of Hopfield and Correlated Attractors in an Associative Memory Model (General)
- Estimating Membrane Resistance over Dendrite Using Markov Random Field
- Approximate Bayesian Estimation of Varying Binomial Process
- Analysis of XY Model with Mexican-Hat Interaction on a Circle ---Derivation of Saddle Point Equations and Study of Bifurcation Structure---
- Solvable Model of a Phase Oscillator Network on a Circle with Infinite-Range Mexican-Hat-Type Interaction
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- Stability Analysis of Attractor Neural Network Model of Inferior Temporal Cortex —Relationship between Attractor Stability and Learning Order—
- Belief Propagation for Error Correcting Codes and Lossy Compression Using Multilayer Perceptrons
- Image Restoration and Segmentation using Region-Based Latent Variables: Bayesian Inference Based on Variational Method
- Learning from Stochastic Rules by Spherical Perceptrons under Finite Temperature ---Optimal Temperature and Asymptotic Learning Curve---
- A PCA Approach to Sourlas Code Analysis
- Continuous Attractor that Appears in Autoassociative Memory Model Extended to XY Spin System
- Analysis of Ensemble Learning Using Simple Perceptrons Based on Online Learning Theory
- Superconvergence of Period-Doubling Cascade in Trapezoid Maps : Its Rigorous Proof and Superconvergence of the Period-Doubling Cascade Starting from a Period p Solution
- Depolarization-Induced Tyrosine Phosphorylation in PC12h Cells.
- Infliximab for Behcet disease with aortic involvement : two novel case reports without concurrent use of immunosuppressive agents or corticosteroids
- Depolarization-Induced Tyrosine Phosphorylation of pl30cas.
- Vasoactive Intestinal Peptide Induces Tyrosine Phosphorylation in PC12h Cells.