Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: A Statistical-Modelling Approach to Feedforward Neural Network Model Selection
(Submitted on 9 Jul 2022 (v1), last revised 1 May 2024 (this version, v5))
Abstract: Feedforward neural networks (FNNs) can be viewed as non-linear regression models, where covariates enter the model through a combination of weighted summations and non-linear functions. Although these models have some similarities to the approaches used within statistical modelling, the majority of neural network research has been conducted outside of the field of statistics. This has resulted in a lack of statistically-based methodology, and, in particular, there has been little emphasis on model parsimony. Determining the input layer structure is analogous to variable selection, while the structure for the hidden layer relates to model complexity. In practice, neural network model selection is often carried out by comparing models using out-of-sample performance. However, in contrast, the construction of an associated likelihood function opens the door to information-criteria-based variable and architecture selection. A novel model selection method, which performs both input- and hidden-node selection, is proposed using the Bayesian information criterion (BIC) for FNNs. The choice of BIC over out-of-sample performance as the model selection objective function leads to an increased probability of recovering the true model, while parsimoniously achieving favourable out-of-sample performance. Simulation studies are used to evaluate and justify the proposed method, and applications on real data are investigated.
Submission history
From: Andrew McInerney [view email][v1] Sat, 9 Jul 2022 11:07:04 GMT (499kb,D)
[v2] Mon, 24 Oct 2022 19:15:53 GMT (527kb,D)
[v3] Mon, 7 Nov 2022 09:52:08 GMT (238kb,D)
[v4] Tue, 21 Feb 2023 17:23:13 GMT (1033kb,D)
[v5] Wed, 1 May 2024 13:36:27 GMT (566kb,D)
Link back to: arXiv, form interface, contact.