On Some New Hybridized Regression Estimation and Feature Selection Techniques


Authors : Adamu Buba; Umar Usman; Yakubu Musa; Murtala Muhammed Hamza

Volume/Issue : Volume 8 - 2023, Issue 9 - September

Google Scholar : https://tinyurl.com/rykhfsu9

Scribd : https://tinyurl.com/9udpsvcs

DOI : https://doi.org/10.5281/zenodo.10029183

Abstract : Conventional regularization techniques like LASSO, SCAD and MCP have been shown to perform poorly in the presence of extremely large or ultra-high dimensional covariates. This has created the need for and led to the development and reliance on filtering technique like screening. Screening techniques (such as SIS, DC-SIS, and DC – RoSIS) have been shown to reduce the computational complexity in selecting important covariates from ultrahigh dimensional candidates. To this end, there have been various attempts to hybridize the conventional regularization techniques. In this paper, we combine some regularization techniques (LASSO and SCAD) with a screening technique (DC – RoSIS) to form new hybrid methods with a view to achieving better dimension reduction and variable selection simultaneously. Extensive simulation results and real life data performance show that the proposed methods perform better than the conventional methods.

Keywords : Regularization Techniques, Screening Technique, LASSO DC–RoSIS, SCAD DC – RoSIS.

Conventional regularization techniques like LASSO, SCAD and MCP have been shown to perform poorly in the presence of extremely large or ultra-high dimensional covariates. This has created the need for and led to the development and reliance on filtering technique like screening. Screening techniques (such as SIS, DC-SIS, and DC – RoSIS) have been shown to reduce the computational complexity in selecting important covariates from ultrahigh dimensional candidates. To this end, there have been various attempts to hybridize the conventional regularization techniques. In this paper, we combine some regularization techniques (LASSO and SCAD) with a screening technique (DC – RoSIS) to form new hybrid methods with a view to achieving better dimension reduction and variable selection simultaneously. Extensive simulation results and real life data performance show that the proposed methods perform better than the conventional methods.

Keywords : Regularization Techniques, Screening Technique, LASSO DC–RoSIS, SCAD DC – RoSIS.

CALL FOR PAPERS


Paper Submission Last Date
31 - May - 2024

Paper Review Notification
In 1-2 Days

Paper Publishing
In 2-3 Days

Video Explanation for Published paper

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe