On the number of latent representations in deep neural networks for tabular data

Couplet, Edouard;Lambert, Pierre;Verleysen, Michel;Lee, John;De Bodt, Cyril
(2023) 31st European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning — Location: Bruges, Belgium (4.October.2023)

Files

Couplet2023_ES2023-156.pdf
  • Open Access
  • Adobe PDF
  • 2.02 MB
Download

Details

Authors
Abstract
Most recent deep neural network architectures for tabular data operate at the feature level and process multiple latent representations simultaneously. While the dimension of these representations is set through hyper-parameter tuning, their number is typically fixed and equal to the number of features in the original data. In this paper, we explore the impact of varying the number of latent representations on model performance. Our results suggest that increasing the number of representations beyond the number of features can help capture more complex interactions, whereas reducing their number can improve performance in cases where there are many uninformative features.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Couplet, E., Lambert, P., Verleysen, M., Lee, J., & De Bodt, C. (2023). On the number of latent representations in deep neural networks for tabular data. ESANN proceedings, 1(1), 1-6. https://doi.org/10.14428/esann/2023.ES2023-156 (Original work published 2023)