Join us for this seminar by Yasser Roudi (King's) as part of the Maths in the Life Sciences seminar series (and the online North West Seminar Series in Mathematical Biology and Data Sciences in collaboration with Liverpool Universities).
Title: Long-term behaviour of learning machines under closed-loop learning
Abstract: In the standard setup for learning, a learning machine, whether a neural newtork, statistical model, biological agent, attempts to lear structure from data generated from the environment. In a closed-loop learning, on the other hand, model parameters are repeatedly estimated from data generated from the model itself, another model with a similar structure. Given the possibility that large neural network models may, in the future, be primarily trained with data generated by artificial neural networks themselves, understanding the long-term behaviour of learning machines under closed-loop learning is receiving a lot of attention.
In this talk, we study this process in the case of models that belong to exponential families. We show that in this case, maximum likelihood estimation of the parameters results in a process that converges to absorbing states that amplify initial biases present in the data. This outcome may, however, be prevented if the data contains at least one data point generated from a ground truth model, by relying on maximum a posteriori estimation or by introducing regularisation. Simulations also show that similar results are observed in the Hopfield or Restricted Boltzmann Machines.
Ref: https://arxiv.org/abs/2506.20623 arxiv.org
The talk will be also be streamed via Teams, please contact carl.whitfield@manchester.ac.uk or igor.chernyavsky@manchester.ac.uk for the zoom link, or sign up to the mailing list.
To subscribe to the mailing list for this event series, please send an e-mail with the phrase “subscribe math-lifesci-seminar” in the message body to listserv@listserv.manchester.ac.uk
