Nonparametric Regression Method Based on Orthogonalization and Thresholding
スポンサーリンク
概要
- 論文の詳細を見る
In this paper, we consider a nonparametric regression problem using a learning machine defined by a weighted sum of fixed basis functions, where the number of basis functions, or equivalently, the number of weights, is equal to the number of training data. For the learning machine, we propose a training scheme that is based on orthogonalization and thresholding. On the basis of the scheme, vectors of basis function outputs are orthogonalized and coefficients of the orthogonalized vectors are estimated instead of weights. The coefficient is set to zero if it is less than a predetermined threshold level assigned component-wise to each coefficient. We then obtain the resulting weight vector by transforming the thresholded coefficients. In this training scheme, we propose asymptotically reasonable threshold levels to distinguish contributed components from unnecessary ones. To see how this works in a simple case, we derive an upper bound for the generalization error of the training scheme with the given threshold levels. It tells us that an increase in the generalization error is of O(log n/n) when there is a sparse representation of a target function in an orthogonal domain. In implementing the training scheme, eigen-decomposition or the Gram-Schmidt procedure is employed for orthogonalization, and the corresponding training methods are referred to as OHTED and OHTGS. Furthermore, modified versions of OHTED and OHTGS, called OHTED2 and OHTGS2 respectively, are proposed for reduced estimation bias. On real benchmark datasets, OHTED2 and OHTGS2 are found to exhibit relatively good generalization performance. In addition, OHTGS2 is found to be obtain a sparse representation of a target function in terms of the basis functions.
論文 | ランダム
- 海外文献紹介『実験実存心理学ハンドブック』[Greenberg, J., Koole, S. L., & Pyszcynski, T. (Eds.) Handbook of experimental existential psychology]
- ユーモア態度と対人関係における因果モデル (因果性を探る--共分散構造分析の実際)
- 美しい都市を取り戻す100年へ(行く世紀、来る世紀2)
- 平成11年度都市計画学会 石川賞を受賞して ぼくたちのまちづくり
- 研究の現状と展望 住宅・土地