Learning algorithm and capacity in the biological circuits
Project Description
Artificial Recurrent Neural Networks (ANN) such as LSTM and GRU have recently gained an intense interest in machine learning. These models are highly versatile and achieve breakthrough performance in many applications of sequential data. However, the learning algorithm of ANN, such as backpropagation, is challenging to implement in biological circuits with living cells.

In this project, we focus on an archetypal circuit of biological learning --- the mushroom body in insects. Despite its simple design, the circuit is responsible for the complex navigation behaviors in honeybees and fruit flies. Over the past decades, the field has accumulated comprehensive experimental data on the structure (connections between neurons) and function (plasticity or how the connection strength between neurons changes in response to the environment) of the mushroom body, setting a perfect stage to advance the circuit at the theoretical level.

In this project, we seek to (i) understand the key components of its learning algorithms, such as plasticity rules and types of connections between circuit layers, and (ii) characterize mathematically the capacity (i.e., how many stimulus patterns an animal can remember) of the mushroom body circuit given the components in (i).
Supervisor
HU Yu
Quota
2
Course type
UROP1100
Applicant's Roles
1. Perform numerical simulations of the mushroom body circuit during learning in various tasks and conditions and compare them with experimental and other modeling results in the literature.
2. Conduct a mathematical analysis of the learning capacity of the mushroom body circuit

Prerequisites are fundamental solid math skills (i.e., high scores in calculus, linear algebra, basic probability or statistics), proficiency in any programming language (e.g., Python, Matlab, C++), ability to learn quickly, and strong motivation and responsibility. Knowledge of neuroscience is favorable but not required.

The minimum time commitment is 5 hours per week.

Applicant's Learning Objectives
1. Grasp the basics of training and testing neural network models in association learning and reinforcement learning tasks.
2. Learn mathematical methods to calculate the learning capacity of feedforward circuits.
Complexity of the project
Challenging