Entropy-based regularization of AdaBoost
Authors:
- Michał Bereta
Abstract
In this study, we introduce an entropy-based method to regularize the AdaBoost algorithm. The AdaBoost algorithm is a well-known algorithm used to create aggregated classifiers. In many real-world classification problems in addition to paying special attention classification accuracy of the final classifier, great focus is placed on tuning the number of the so-called weak learners, which are aggregated by the final (strong) classifier. The proposed method is able to improve the AdaBoost algorithm in terms of both criteria. While many approaches to the regularization of boosting algorithms can be complicated, the proposed method is straightforward and easy to implement. We compare the results of the proposed method (EntropyAdaBoost) with the original AdaBoost and also with its regularized version, e-AdaBoost on several classification problems. It is shown that the proposed methods of EntropyAdaBoost and e-AdaBoost are strongly complementary when the improvement of AdaBoost is considered.
- Record ID
- CUTe255ef76395c406c872c39aa36658d6b
- Publication categories
- ;
- Author
- Journal series
- Computer Assisted Methods in Engineering and Science, ISSN 2299-3649
- Issue year
- 2017
- Vol
- 24
- No
- 2
- Pages
- 89-100
- Other elements of collation
- tab.; wykr.; Bibliografia (na s.) - 99-100; Bibliografia (liczba pozycji) - 18; Oznaczenie streszczenia - Streszcz. ang.; Numeracja w czasopiśmie - Vol. 24, No. 2
- Keywords in English
- AdaBoost, regularization, entropy, EntropyAdaBoost
- URL
- http://cames.ippt.pan.pl/index.php/cames/issue/view/29 Opening in a new tab
- Language
- eng (en) English
- License
- Score (nominal)
- 14
- Uniform Resource Identifier
- https://cris.pk.edu.pl/info/article/CUTe255ef76395c406c872c39aa36658d6b/
- URN
urn:pkr-prod:CUTe255ef76395c406c872c39aa36658d6b
* presented citation count is obtained through Internet information analysis, and it is close to the number calculated by the Publish or PerishOpening in a new tab system.