Statistical Mechanics of Node-Perturbation Learning for Nonlinear Perceptron
スポンサーリンク
概要
- 論文の詳細を見る
Node-perturbation learning is a type of statistical gradient descent algorithm that can be applied to problems where the objective function is not explicitly formulated, including reinforcement learning. Node-perturbation learning with M linear perceptrons has previously been analyzed using the methods of statistical mechanics. It was shown that cross-talk noise, which originates from the error of the other outputs, increases the generalization error as the number of outputs increases. On the other hand, a nonlinear perceptron has several advantages over a linear perceptron, such as the ability to use nonlinear outputs, learnability, storage capacity, and so forth. However, node-perturbation for a nonlinear perceptron has yet to be analyzed theoretically. In this paper, we derive a learning rule of node-perturbation learning for a nonlinear perceptron within the framework of REINFORCE learning and analyze the learning behavior by using statistical mechanical methods. From the results, we found that the signal and cross-talk terms of the order parameter Q have different forms for a nonlinear perceptron. Moreover, the increase in the generalization error with increasing number of outputs is less than for a linear perceptron.
- 2013-05-15
著者
-
Okanoya Kazuo
Riken Brain Science Institute
-
Hara Kazuyuki
College Of Industrial Technology Nihon University
-
Okada Masato
Graduate School Of Engineering Science Osaka University
-
Katahira Kentaro
Japan Science and Technology Agency, ERATO Okanoya Emotional Information Project, Wako, Saitama 351-0198, Japan
-
Okanoya Kazuo
Riken Brain Science Institute, Wako, Saitama 351-0198, Japan
関連論文
- 3P-226 多点同時記録によって抽出されたジュウシマツHVC局所回路における機能的ネットワーク(神経回路・脳の情報処理,日本生物物理学会若手奨励賞選考会,若手招待講演,第46回日本生物物理学会年会)
- Statistical Mechanics of On-line Node-perturbation Learning
- Information-Theoretic Analysis for Understanding the Behavior of Song Learning by the Bengalese Finch
- Vocal control area-related expression of neuropilin-1, plexin-A4, and the ligand semaphorin-3A has implications for the evolution of the avian vocal system
- Statistical Mechanics of On-Line Node-Perturbation Learning
- Information-Theoretic Analysis for Understanding the Behavior of Song Learning by the Bengalese Finch
- Automatic Detection and Recognition of the Behavioral Sequences of Bengalese Finch Song by Using Image Processing
- SEX DIFFERENCE IN THE PEP-19 EXPRESSION IN SONG NUCLEI OF ZEBRA FINCHES DURING EARLY BRAIN DEVELOPMENT
- Prefrontal activity during koh-do incense discrimination
- Statistical Mechanics of On-Line Node-Perturbation Learning
- Statistical Mechanical Study of Code-Division Multiple-Access Multiuser Detectors : Analysis of Replica Symmetric and One-Step Replica Symmetry Breaking Solutions(General)
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- Spontaneous vocal differentiation of coo-calls for tools and food in Japanese monkeys
- Retrieval Property of Attractor Network with Synaptic Depression(General)
- Analysis of Ensemble Learning Using Simple Perceptrons Based on Online Learning Theory
- Retrieval of Branching Sequences in an Associative Memory Model with Common External Input and Bias Input(Cross-disciplinary physics and related areas of science and technology)
- Residual Energies after Slow Quantum Annealing(General)
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex(General)
- Image Restoration with a Truncated Gaussian Model(General)
- 能面は能で想定した情動を正しく伝えているのか?
- 25pTD-11 非線形パーセプトロンを用いたノードパータベーション学習の統計力学(25pTD ニューラルネットワーク,領域11(統計力学,物性基礎論,応用数学,力学,流体物理))
- マッチング則に従う意思決定の履歴依存性における指数フィルタ特性を説明するシナプス学習則
- キンカチョウとジュウシマツにおける空耳基本波の知覚
- Statistical Mechanics of On-line Node-perturbation Learning
- Ensemble Learning of Linear Perceptrons : On-Line Learning Theory(General)
- マッチング行動を説明するベイズ的意思決定モデル(知的システム,一般)
- Analysis of XY Model with Mexican-Hat Interaction on a Circle
- Exact Inference in Discontinuous Firing Rate Estimation Using Belief Propagation
- Influence of Synaptic Depression on Memory Storage Capacity
- Neural Network Model of Spatial Memory: Associative Recall of Maps
- Statistical Mechanics of On-Line Mutual Learning with Many Linear Perceptrons
- Statistical Mechanics of Mutual Learning with a Latent Teacher(General)
- 非線形パーセプトロンのためのノードパータベーション学習の統計力学(ニューロコンピューティングの実装及び人間科学のための解析・モデル化,一般)
- Mean Field Analysis of Stochastic Neural Network Models with Synaptic Depression
- Statistical Mechanics of the Delayed Reward-Based Learning with Node Perturbation
- Rate Reduction for Associative Memory Model n Hodgkin-Huxley-Type Network(Cross-disciplinary physics and related areas of science and technology)
- Higher Order Effects on Rate Reduction for Networks of Hodgkin-Huxley Neurons(Cross-disciplinary physics and related areas of science and technology)
- Estimation of Intracellular Calcium Ion Concentration by Nonlinear State Space Modeling and Expectation-Maximization Algorithm for Parameter Estimation
- Neural Network Model with Discrete and Continuous Information Representation
- Estimating Membrane Resistance over Dendrite Using Markov Random Field
- Stability Analysis of Stochastic Neural Network with Depression and Facilitation Synapses
- Analysis of XY Model with Mexican-Hat Interaction on a Circle ---Derivation of Saddle Point Equations and Study of Bifurcation Structure---
- Statistical Mechanics of On-line Ensemble Teacher Learning through a Novel Perceptron Learning Rule
- Solvable Model of a Phase Oscillator Network on a Circle with Infinite-Range Mexican-Hat-Type Interaction
- Multiple Stability of a Sparsely Encoded Attractor Neural Network Model for the Inferior Temporal Cortex
- Image Segmentation and Restoration Using Switching State-Space Model and Variational Bayesian Method
- Statistical Mechanical Analysis of CDMA Multiuser Detectors : AT Stability and Entropy of the RS Solution, and 1RSB Solution
- Stability Analysis of Attractor Neural Network Model of Inferior Temporal Cortex —Relationship between Attractor Stability and Learning Order—
- Bayesian Image Restoration for Medical Images Using Radon Transform
- Statistical Mechanics of Mexican-Hat-Type Horizontal Connection
- Statistical Mechanics of Node-Perturbation Learning for Nonlinear Perceptron
- Inter-Layer Correlation in a Feed-Forward Network with Intra-Layer Common Noise
- Continuous Attractor that Appears in Autoassociative Memory Model Extended to XY Spin System
- Statistical–Mechanical Analysis of Attractor Dynamics in a Hysteretic Neuron Network
- A Numerical Analysis of Learning Coefficient in Radial Basis Function Network
- Theoretical Analysis of Learning Speed in Gradient Descent Algorithm Replacing Derivative with Constant
- Inter-Layer Correlation in a Feed-Forward Network with Intra-Layer Common Noise
- Analysis of Ensemble Learning Using Simple Perceptrons Based on Online Learning Theory