Online Learning of Perceptron from Noisy Data: A Case in which Both Student and Teacher Suffer from External Noise
スポンサーリンク
概要
- 論文の詳細を見る
We analyze the online learning of a Perceptron (student) from signals produced by a single Perceptron (teacher) in which both the student and the teacher suffer from external noise. We adopt three typical learning rules and treat the input and output noises. In order to improve learning when it fails in the sense that the student vector does not converge to the teacher vector, we use a method based on the optimal learning rate. Furthermore, in order to control learning, we propose a concrete method for the Perceptron rule in the output noise model. Finally, we analyze time domain ensemble online learning. The theoretical results agree quite well with the numerical simulation results.
- 2010-09-15
著者
-
Yoshida Mika
Graduate School Of Humanities And Sciences Nara Women's University
-
Uezu Tatsuya
Graduate School Of Human Culture Nara Women's University
-
Yoshida Mika
Graduate School of Sciences and Humanities, Nara Women's University, Nara 630-8506, Japan
-
Yamaguchi Sachi
Graduate School of Sciences and Humanities, Nara Women's University, Nara 630-8506, Japan
-
Tomiyasu Mami
Faculty of Science, Department of Physics, Nara Women's University, Nara 630-8506, Japan
-
Tomiyasu Mami
Faculty of Science, Department of Physics, Nara Women's University, Nara 630-8506, Japan
-
Yamaguchi Sachi
Graduate School of Sciences and Humanities, Nara Women's University, Nara 630-8506, Japan
関連論文
- Statistical Mechanical Study of Code-Division Multiple-Access Multiuser Detectors : Analysis of Replica Symmetric and One-Step Replica Symmetry Breaking Solutions(General)
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- On-line Learning of Perceptron from Noisy Data by One and Two Teachers(General)
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex(General)
- Distinction of Coexistent Attractors in an Attractor Neural Network Model Using a Relaxation Process of Fluctuations in Firing Rates : Analysis with Statistical Mechanics(General)
- Dynamical Behavior of Phase Oscillator Networks on the Bethe Lattice(General)
- Theory of Time Domain Ensemble On-Line Learning of Perceptron under the Existence of External Noise(General)
- Statistical Mechanics of Time-Domain Ensemble Learning(General)
- Response to Invasion by Antigens and Effects of Threshold in an Immune Network Dynamical System Model with a Small Number of Degrees of Freedom
- Analysis of an Immune Network Dynamical System Model with a Small Number of Degrees of Freedom
- A Large Scale Dynamical System Immune Network Model with Finite Connectivity(Oscillation, Chaos and Network Dynamics in Nonlinear Science)
- Analysis of XY Model with Mexican-Hat Interaction on a Circle
- On the Conditions for the Existence of Perfect Learning and Power Law Behaviour in Learning from Stochastic Examples by Ising Perceptrons
- Learning of Non-Monotonic Target Functions by Ising Perceptrons : Learning Curve, Perfect Learning and Perfect Anti-Learning (General)
- Online Learning of Perceptron from Noisy Data: A Case in which Both Student and Teacher Suffer from External Noise
- Retrieval Properties of Hopfield and Correlated Attractors in an Associative Memory Model (General)
- Analysis of XY Model with Mexican-Hat Interaction on a Circle ---Derivation of Saddle Point Equations and Study of Bifurcation Structure---
- Solvable Model of a Phase Oscillator Network on a Circle with Infinite-Range Mexican-Hat-Type Interaction
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- Stability Analysis of Attractor Neural Network Model of Inferior Temporal Cortex —Relationship between Attractor Stability and Learning Order—
- Learning from Stochastic Rules by Spherical Perceptrons under Finite Temperature ---Optimal Temperature and Asymptotic Learning Curve---
- Continuous Attractor that Appears in Autoassociative Memory Model Extended to XY Spin System
- Superconvergence of Period-Doubling Cascade in Trapezoid Maps : Its Rigorous Proof and Superconvergence of the Period-Doubling Cascade Starting from a Period p Solution