Transformers in Neuroscience

Cosyne 2025 Tutorial Session Sponsored by the Simons Foundation

In this tutorial, we'll introduce the fundamentals of transformers and their applications in neuroscience using our new software package, torch_brain. Participants will explore how transformers can be used to analyze both electrophysiology data.

Tutorial Materials

Access notebooks and resources for the tutorial

Notebook 1

Building Data Objects

Learn how to prepare and structure neuroscience data for transformer models

Notebook 2

Building a Model & Fine-Tuning

Explore transformer architectures and learn how to fine-tune models on neuroscience data

Useful Resources

Documentation and libraries to help you continue your learning

temporaldata logo

temporaldata

Library for handling temporal neural data with efficient data structures and processing tools

brainsets logo

brainsets

A collection of pre-processed neuroscience datasets ready for model training and evaluation

torch_brain logo

torch_brain

A PyTorch-based library for building transformer models for neuroscience applications

Schedule

Join us on March 27, 2025 from 12:30 p.m. to 4:30 p.m.

1

Introduction

12:30 p.m. - 1:30 p.m.

2

Session #1: Building Data Objects

1:30 p.m. - 2:15 p.m.

Break

2:15 p.m. - 2:45 p.m.

3

Session #2: Building a Model & Fine-Tuning

2:45 p.m. - 4:30 p.m.