Sampling the XY model with an attention-based neural network
📄 arXiv:2610.23783 · 📥 PDF · 2026-10-16 · cond-mat.stat-mech
Authors: Piotr Białas [arXiv · scholar] , Christian D. Morales [arXiv · scholar] , Tomasz Stebel [arXiv · scholar] , Dawid Zapolski [arXiv · scholar]
📄 Abstract
We present a transformer-based variational autoregressive network for sampling lattice systems with continuous degrees of freedom and apply it to the two-dimensional XY model near the Berezinskii-Kosterlitz-Thouless transition. The architecture is combined with physics-informed ingredients: locality-informed attention and approximate probabilities. The resulting sampler significantly outperforms existing neural samplers. We train the model on lattices up to $96\times96$, verify with a mode-dropping estimator that no parts of the configuration space are missed, and reproduce the energy, magnetization and helicity modulus obtained with the traditional Markov Chain Monte Carlo algorithm.