Nonparametric Regression Method Based on Orthogonalization and Thresholding
スポンサーリンク
概要
- 論文の詳細を見る
In this paper, we consider a nonparametric regression problem using a learning machine defined by a weighted sum of fixed basis functions, where the number of basis functions, or equivalently, the number of weights, is equal to the number of training data. For the learning machine, we propose a training scheme that is based on orthogonalization and thresholding. On the basis of the scheme, vectors of basis function outputs are orthogonalized and coefficients of the orthogonalized vectors are estimated instead of weights. The coefficient is set to zero if it is less than a predetermined threshold level assigned component-wise to each coefficient. We then obtain the resulting weight vector by transforming the thresholded coefficients. In this training scheme, we propose asymptotically reasonable threshold levels to distinguish contributed components from unnecessary ones. To see how this works in a simple case, we derive an upper bound for the generalization error of the training scheme with the given threshold levels. It tells us that an increase in the generalization error is of O(log n/n) when there is a sparse representation of a target function in an orthogonal domain. In implementing the training scheme, eigen-decomposition or the Gram-Schmidt procedure is employed for orthogonalization, and the corresponding training methods are referred to as OHTED and OHTGS. Furthermore, modified versions of OHTED and OHTGS, called OHTED2 and OHTGS2 respectively, are proposed for reduced estimation bias. On real benchmark datasets, OHTED2 and OHTGS2 are found to exhibit relatively good generalization performance. In addition, OHTGS2 is found to be obtain a sparse representation of a target function in terms of the basis functions.
論文 | ランダム
- 健康被害を起こしたダイエット食品「天天素」の生体作用
- 健康食品中に混入を想定した下剤ピコスルファートナトリウムのマウスにおける生体作用の検討
- 哺乳期雄ラットの前立腺の微細構造に対するビスフェノールA低用量投与の影響
- 哺乳期マウスの子宮及び膣の微細構造に及ぼすエストラジオールの影響
- チアベンダゾール(TBZ)のマウスにおける催奇形性について