Bibliographic Details
| Title: |
A Hybrid Regression Model for Improving Prediction Accuracy. |
| Authors: |
Poojari, Satyanarayana1 sathya1301@gmail.com, B., Ismail2 |
| Superior Title: |
Electronic Journal of Applied Statistical Analysis. 2023, Vol. 16 Issue 3, p784-801. 18p. |
| Subject Terms: |
*REGRESSION analysis, *REGRESSION trees, *MONTE Carlo method, *K-nearest neighbor classification, *FEATURE selection, *PREDICTION models |
| Geographic Terms: |
DELHI (India) |
| Abstract: |
Regression Tree (RT) and K-Nearest Neighbor (KNN) models play significant roles in machine learning. RT facilitates interpretable decision-making, aiding in the comprehension of complex data relationships, while KNN is valued for its simplicity, adaptability to non-linear data, and robustness to noise, making it a versatile tool across various applications. The primary drawback of Regression Tree is its tendency to assign the same predicted value (average value) to all tuples satisfying the same corresponding splitting criterion. K-Nearest Neighbors (KNN) is sensitive to irrelevant or redundant features since all features contribute to similarity. This paper proposes a hybrid regression model based on Regression Tree (RT) and KNN, addressing the aforementioned issues. The model's performance is compared with KNN using 10 types of distance measures and further assessed against RT, KNearest Neighbor regression (KNN), and Support Vector Regression (SVR) through a Monte Carlo simulation study. Simulation results indicate that the hybrid model outperforms all other regression models, regardless of sample size, when observations follow normal distributions or t-distributions. The proposed model's effectiveness is demonstrated through a real-life application using data on global warming in Delhi. [ABSTRACT FROM AUTHOR] |
|
Copyright of Electronic Journal of Applied Statistical Analysis is the property of Electronic Journal of Applied Statistical Analysis (EJASA) and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Database: |
Academic Search Premier |