On the number of latent representations in deep neural networks for tabular data
(2023) 31st European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning — Location: Bruges, Belgium (4.October.2023)
Files
Couplet2023_ES2023-156.pdf
Open Access - Adobe PDF
- 2.02 MB
Details
- Authors
De Bodt, Cyril 
- Abstract
- Most recent deep neural network architectures for tabular data operate at the feature level and process multiple latent representations simultaneously. While the dimension of these representations is set through hyper-parameter tuning, their number is typically fixed and equal to the number of features in the original data. In this paper, we explore the impact of varying the number of latent representations on model performance. Our results suggest that increasing the number of representations beyond the number of features can help capture more complex interactions, whereas reducing their number can improve performance in cases where there are many uninformative features.
- Affiliations
Citations
Couplet, E., Lambert, P., Verleysen, M., Lee, J., & De Bodt, C. (2023). On the number of latent representations in deep neural networks for tabular data. ESANN proceedings, 1(1), 1-6. https://doi.org/10.14428/esann/2023.ES2023-156 (Original work published 2023)