Physics 178/278 - Biophysics and dynamics of neurons and networks

(Thoughts without content are empty, intuitions without concepts are blind.*)

Course overview

This course explores underlying principles and design rules for the neuronal circuits that control animal behavior. The emphasis in on analytically tractable models of neuronal network dynamics and computation. We present analytical pathways that involve dimensionality reduction to go from the "exact" dynamics of single neurons and synapses to simplified but tractable aspects of network activity. One case involves networks of coupled neurons with arhythmic firing rates that form extensive recurrent connections. Here, the interactions among neurons are strong and can lead to attractor dynamics. Such circuits serve to understand motor control, sensory processing, and memory. A second case involves networks of coupled neuronal oscillators in which each neuron is rhythmically active and described by its phase in a limit cycle. Here, the interactions among neurons affect only the relative timing between neurons. These networks provide a means to understand behaviors that range from locomotion to neurovascular dynamics in fMRI. A special aspect of the class is the inclusion of ongoing efforts in connectomics to bridge prediction and experimental reality. Aspects of applied mathematics such as propability and information theory, biophysics, and statistical mechanics are presented as needed.

(Truth is much too complicated to allow anything but approximations.**)

There is no official textbook. Detailed lecture notes, with illustrations from relevant experimental papers, are provided as handouts, along with links to background material. There are four homework assignements plus a class project. For Winter 2025, we will focus on two types of projects.

One set of projects focuses on associative networks in honor of this year's Nobel Prize in Physics to Prof. John Hopfield. We will consider theoretical papers that extend the original work and experimental papers that claim to provide evidence for line and ring attractors, as well as bistable and multistable point attractors.

A second set of projects build on the ideas of Prof. Marcello Rozenberg and use fed-back thyristors as spiking elements and current-mirrors as synapses to construct small neural circuits in hardware. Laboratory space and electronic gear for these projects is set aside in 7130 Urey Hall.

Sincheng Huang and the first working thyrisor-neuron

Photograph: Mr. Sincheng Huang demonstrates spiking of a thyistor-neuron (blue trace) after accumulation of synaptic inputs (yellow trace) from a current source (green trace).

For Winter 2025, we are pleased to have Mr. Haidong Qin as the class teaching assistant. Mr. Qin will help run an optional discussion section every Friday at 8:00 - 8:50 AM in Mayer 5301 and will hold an office hour immediately after class. Office hours with Prof. Kleinfeld are immediately after class and by appointment.

Lecture notes for Winter 2025

("Chapters" comprise one to three 1-1/3 hour lectures).

(Chapter 1) - Introduction: Neurons, synapses, and the tiniest circuits
DK lecture notes (9.2 MB PDF)
Saturated Reconstruction of a Volume of Neocortex - Kasthuri, Hayworth, ... & Lichtman reprint (5.4 MB PDF)
(Chapter 2) - Recurrent neuronal networks: Brain states and discrete attractors
DK lecture notes (7.5 MB PDF)
Statistical Mechanics of Neural Networks - Sompolinsky reprint (4.0 MB PDF)
(Chapter 3) - Electrical and optical tools of the trade
DK lecture notes (includes primer on mutual information) (1.6 MB PDF)
Electrophysiology in the age of light - Scanziani & Hausser reprint (2.2 MB PDF)
Can one concurrently record electrical spikes from every neuron in a mammalian brain? - Kleinfeld, Luan, Mitra, Robertson, Sarpeshkar, Shepard, Xie & Harris reprint (3.8 MB PDF)
(Bonus) - Derivation of network equations from conductance models
DK lecture notes (1.0 MB PDF)
(Bonus) - Integrators, line attractors, and mono-stability
DK lecture notes (3.9 MB PDF)
(Chapter 4) - Recurrent neuronal networks: Invariant tuning and continuous attractors
DK lecture notes (7.2 MB PDF)
New Perspectives on the Mechanisms for Orientation Selectivity - Shapley & Sompolinsky reprint (1.1 MB PDF)
Ring Attractor Dynamics in the Drosophila Central Brain - Kim, Rouault, Druckmann & Jayaraman reprint (5.3 MB PDF)
Modeling Feature Selectivity in Local Cortical Circuits - Hansel & Sompolinsky book chapter reprint (3.7 Mb PDF)
(Bonus) - Biophysics of conductance-based neuronal dynamics.
DK lecture notes (1.0 MB PDF)
(Chapter 5) - Reduced Models of Spiking
DK lecture notes (4.2 MB PDF)
(Chapters 6-8) - Rhythmic dynamics in neuronal networks
DK lecture notes on Derivation of Weakly Coupled Phase Oscillators (1.0 MB PDF)
DK lecture notes on Circuits of Weakly Coupled Phase Oscillators (5.1 MB PDF)
DK lecture notes on Time Delays and Patterns and Waves with Coupled Oscillators (9.5 MB PDF)
Traveling Electrical Waves in Cortex: Insights from Phase Dynamics and Speculation on a Computational Role - Ermentrout & Kleinfeld reprint (0.6 MB PDF)
Cortical Travelling Waves: Mechanisms and Computational Principles - Muller, Chavane, Reynolds & Sejnowski reprint (1.7 MB PDF)

The Beach Boys in 1966

(Chapter 9) - Variability is a fundamental aspect of the neuronal response
DK lecture notes (7.1 MB PDF)
Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity - van Vreeswijk & Sompolinsky reprint (0.8 MB PDF)
How does function constrain synaptic connectivity? - Mrsic-Flogel slides (1.5 MB PDF)
Inhibition Stabilization is a Widespread Property of Cortical Networks - Sanzeni, Akitake, Goldbach, Leedy, Brunel & Histed reprint (2.7 MB PDF)
(Chapter 10) - Analytical tools of the trade
DK lecture notes (4.4 MB PDF)
"Analysis of spike trains" - Aljadeff, Lansdell, Fairhall & Kleinfeld reprint. (7.8 MB PDF)
(Chapter 11) - Layered feedforward networks
DK lecture notes (2.7 MB PDF)
Review of layered networks - Chapter 6 of "Neural Networks: A Comprehensive Foundation" by Simon Haykin. (11.5 MB PDF)
(Bonus) - Layered networks for optimal stimulus reconstruction
DK lecture notes (0.3 MB PDF)
A simplified neuron model as a principal component analyzer - Oja reprint. (0.3 MB PDF)
(Bonus) - Information theory and stimulus coding
DK lecture notes (6.5 MB PDF)
General principles for sensory coding - Sharpee reprint (2.7 MB PDF)

Optional discussion sections

Review of circuit equations: Time domain
Review of linear algebra: Basics
Review of Fourier transforms
Review of correlation and coherence
Review of ordinary differential equations and stability
Review of probability
Review of numerical methods

Homework (upload through the Gradescope for this class using Entry Code:6J26X6)

Number 1: Due 8:00 AM on Tues 21 Jan (0.4 MB PDF)
Number 1 Solutions (XX MB PDF)
Number 2: Due 8:00 AM on Tues 4 Feb (0.1 MB PDF)
Number 2 Solutions (XX MB PDF)
Number 3: Due 8:00 AM on Tues 25 Feb (0.2 MB PDF)
Number 3 Solutions (XX MB PDF)
Number 4: Due 8:00 AM on Tues 11 Mar (0.2 MB PDF)
Number 4 Solutions (XX MB PDF)
Presentations are on Thursday 20 Mar @ 8:00-noon; final report due midnight on Saturday 22 Mar

Bonus lectures on neuronal biophysics

Review of diffusion. Notes of DK (0.3 MB PDF)
Review of electrodiffusion across membranes. Notes of DK (3.8 Mb PDF)
Review of electrotonic properties of dendrites and axons. Notes of DK. (0.7 MB PDF)

Darly Hannah and Rutger Hauer in Blade Runner

Suggested publications for 2025 literature deconstruction project

Causal evidence of a line attractor encoding an affective state. (18.5 MB PDF)
An approximate line attractor in the hypothalamus encodes an aggressive state. (13.1 MB PDF)
Transformations of neural representations in a social behaviour network (16.9 MB PDF)
Encoding of female mating dynamics by a hypothalamic line attractor (15.0 MB PDF)
Recurrent switching dynamical systems models for multiple interacting neural populations (0.7 MB PDF)
The importance of mixed selectivity in complex cognitive tasks (1.4 MB PDF)
Adaptation without parameter change. Dynamic gain control in motion detection. (0.5 MB PDF)
A brainstem integrator for self-localization and positional homeostasis. (4.4 MB PDF)
Glia accumulate evidence that actions are futile and suppress unsuccessful behavior. (28.3 MB PDF)
Neural dynamics and architecture of the heading direction circuit in zebrafish. (13.6 MB PDF)
Neural circuits underlying visually evoked escapes in larval zebrafish. (5.6 MB PDF)
Generation of stable heading representations in diverse visual scenes. (19.6 MB PDF)
Theory of neuronal perturbome in cortical networks. (2.0 MB PDF)
Optimal degrees of synaptic connectivity. (1.9 MB PDF)
Inhibition stabilization is a widespread property of cortical networks. (2.7 MB PDF)
Maximization of the connectivity repertoire as a statistical principle governing the shapes of dendritic arbors. (5.4 MB PDF)
Is cortical connectivity optimized for storing information. (0.7 MB PDF) (1.2 MB PDF Supplemental Material)
Frequency plateaus in a chain of weakly coupled oscillators. (2.5 MB PDF)
Time-delayed spatial patterns in a two-dimensional array of coupled oscillators. (0.2 MB PDF)

Literature for thyristor-neuron project

An ultra-compact leaky-integrate and-fire model for building spiking neural networks - Rozenberg, Schneegans & Stollar, Science Reports, 2019. (1.6 MB PDF)
A dynamic neuro-synaptic hardware platform for spiking neural networks - Wu, d’Hollande, Du & Rozenberg, preprint. (16 MB PDF)
IN914 diode (0.1 MB PDF)
2N2700 n-channel MOS FET (0.1 MB PDF)
VP0104 p-channel DMOS FET (0.1 MB PDF)
P0118MA2AL3 thyristor
This is the preferred thyristor for projects.
(0.1 MB PDF)
CR02AM thyristor (0.4 MB PDF)
AD711 operational amplifier (0.7 MB PDF)
ALD1105PBL dual n-channel and p-channel FET pair
See "Current source with gate control" on page 5 for the "current mirror".
(0.1 MB PDF)
AD7555 general-purpose RC timer module (2.1 MB PDF)
Variable_Duty_Cycle_Timing_for_555_Chip (1.3 MB JPG)
The Howland Current Pump (0.7 MB PDF)
Current-Output Circuit Techniques Add Versatility to Your Analog Toolbox (0.1 MB PDF)
Notes on n-channel JFETs in the active region (1.1 MB PDF)
Spectral mixing of rhythmic neuronal signals in sensory cortex (0.7 MB PDF)

Background material

NEUROSCIENCE: Exploring the Brain, 4th edition. Textbook by Mark Bear, Barry Connors & Michael Paradiso (49.6 MB PDF)
Foundations of Mathematical Neuroscience. Textbook by Bard Ermentrout & David Therman (9.2 MB PDF)
Review of mammalian CNS anatomy. MBL Neuroinformatics graphics of Helen Basbas. (1.7 MB PDF)
Everything you always wanted to know about fMRI*, part 1:2 (*but were afraid to ask). Graphics of Jonathan Polimeni and DK. (51.3 MB PPT)
Everything you always wanted to know about fMRI*, part 2:2 (*but were afraid to ask). Graphics of Jonathan Polimeni and DK (29.3 MB PPT)
Review of linear algebra. MBL Neuroinformatics notes of DK. (2.1 MB PDF)
Stability analysis of a two dimensional dynamical system. Notes of Yonitan Aljadeff. (0.1 MB PDF)
Review of Fourier transforms. Notes of DK. (0.1 MB PDF)
Review of Poisson distribution. Notes of John Cooper. (0.1 MB PDF)
Review of neuronal variability and Poisson statistics. Notes of Yonitan Aljadef. (0.1 MB PDF)
Reverse correlation, stimulus design, and analysis. Notes of Yonitan Aljadeff. (7.7 MB PDF)
"Spectral methods" - Kleinfeld & Mitra reprint. (5.3 MB PDF)
Basic MATLAB tutorial. Notes of Douglas Rubino. (0.1 MB M-code)
Advanced Matlab tutorial. (0.1 Mb zipped M-code)

*Immanuel Kant, 1724 - 1804, in Critique of Pure Reason.

.

**John von Neumann, 1903-1957.