Parameter Learning using Approximate Model Counting
(2024) 18th International conference on Neural-Symbolic Learning and Reasoning — Location: Barcelona (9.September.2024)
Files
Paper_NeSy_Partial_Compilation-1.pdf
Preprint
Open Access - Adobe PDF
- 370.66 KB
Details
- Authors
Dierckx, Lucile 
Dubray, Alexandre
- Abstract
- An emerging class of neurosymbolic methods relies on the use of neural networks to determine the parameters of symbolic probabilistic models. To train these hybrid models, these methods use a knowledge compiler to turn the symbolic model into a differentiable arithmetic circuit, after which gradient descent can be performed. However, these methods require compiling a reasonably sized circuit, which is not always possible, as for many symbolic probabilistic models calculating a gradient towards the parameters is #P-hard. We introduce a new approach for learning parameters using partially compiled circuits with approximation nodes. We show that, if the errors made in the approximation nodes are bounded, the error on the gradient of partially compiled circuits can also be bounded. We evaluate the impact of various approximation guarantees on this approach’s learning and generalization performance. Using approximation allows more complex queries to be compiled and our experiments show that their addition helps reduce the training loss. However, we observe that there is a limit to the addition of partial circuits after which there is no more improvement.
- Affiliations
Citations
Dierckx, L., Dubray, A., & Nijssen, S. (2024). Parameter Learning using Approximate Model Counting. 18th International conference on Neural-Symbolic Learning and Reasoning, Barcelona. https://hdl.handle.net/2078.5/256060