PhD Studentship: Improving Artificial Intelligence through Neuroscience

Neuroscience has been a major source of inspiration for modern Artificial Intelligence frameworks, such as Deep Networks, Reinforcement Learning, and Large Language Models. This project investigates how two more recent Neuroscience developments could help improve Deep Networks. The first development is the realisation in the last 20 years that a population of brain cells, astrocytes, have complex and coordinated responses to neural activity, and feed back onto neural activity.

What is the effect of these neuron-astrocyte interactions on brain computations? You will explore the hypothesis that astrocytes provide a source of regularisation to neural networks. That is, they provide constraints to the networks, making them simpler and thus better able to generalise learned concepts to data they have not yet seen. Concretely, you will add astrocyte-inspired regularisation rule to Deep Network training, and then test whether the resulting networks generalise better, are more resistant to injury, and are easier to explain than standard ones. The second development is the description of spontaneous, coordinated activity in developing networks. For instance, before eye opening there are spontaneous waves of activity on the retina, which drive synaptic plasticity in downstream brain structures.

So, before neural networks involved in visual processing "see" their first images, they have already been sculpted by spontaneous retinal waves. In other words, the connections between neurons are not set randomly. This could help with initialisation of Deep Networks. Initial connection weights determines whether the networks can learn effectively and how fast they learn. Learning also requires a large amount of data, because of the large number of connection weights that need to be optimised through training. Drawing on what is known about these waves and the plasticity they drive, you will apply the resulting synaptic plasticity rules to initialise Deep Networks, and then determine if this speeds up learning and if less data is required to train the networks. Answering these questions will lead to the development of better, more explainable, and more sustainable AI.

Funded by: EPSRC Engineering and Physical Sciences Research Council