Comparison of Ridge Regression and GA-RF Models for Boston House Price Prediction

Liang Ye

Article ID: 3213
Vol 6, Issue 4, 2023

VIEWS - 664 (Abstract) 138 (PDF)

Abstract


The purpose of this paper is to explore the performance of ridge regression and the random forest model improved by genetic algorithm in predicting the Boston house price data set and conduct a comparative analysis. To achieve it, the data is divided into training set and test set according to the ratio of 70-30. The RidgeCV library is used to select the best regularization parameter for the Ridge regression model, and for the random forest model, the genetic algorithm is used to optimize the model's hyperparameters. The result shows that compared with ridge regression, the random forest model improved by genetic algorithm can perform better in the regression problem of Boston house prices.


Keywords


Ridge Regression; Random Forest; Genetic Algorithm; Model Comparison

Full Text:

PDF


References


1. Pearson K. (1895). "Notes on regression and inheritance in the case of two parents". Proceedings of the Royal Society of London. 58: 240–242.

2. Hoerl AE., & Kennard RW. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12(1), 55-67.

3. Breiman L. (2001). Random Forests. Machine Learning, 45(1), 5-32.

4. Zhihua Z. Machine learning[M]: Beijing: Tsinghua University Press, 2016.

5. Holland JH. (1975). Adaptation in Natural and Artificial Systems. University of Michigan Press.

6. Khan MN, Ghafoor U, Abdullah A, et al. Prediction of thermal diffusivity of volcanic rocks using machine learning and genetic algorithm hybrid strategy[J]. International Journal of Thermal Sciences, 2023, 192: 108403.

7. Huo ZG, Zha XT, Lu MY, Ma TQ, Lu ZC, Prediction of Carbon Emission of the Transportation Sector in Jiangsu Province-Regression Prediction Model Based on GA-SVM, Sustainability 15(4) (2023).




DOI: https://doi.org/10.24294/ijmss.v6i4.3213

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Creative Commons License

This site is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.