Difference between revisions of "CoSMo 2016"

(Modeling movement and disorders)
 
(47 intermediate revisions by 3 users not shown)
Line 2: Line 2:
 
[[File:CoSMo2016_small.jpg | thumb | CoSMo logo]]
 
[[File:CoSMo2016_small.jpg | thumb | CoSMo logo]]
  
 +
 +
----
  
 
== Introduction ==
 
== Introduction ==
Line 11: Line 13:
 
[https://docs.google.com/spreadsheets/d/1s__C3bNpU4SrfkMitqgMCnj-v4nlC2VhfaiMgs76yK0/edit?usp=sharing Paul]
 
[https://docs.google.com/spreadsheets/d/1s__C3bNpU4SrfkMitqgMCnj-v4nlC2VhfaiMgs76yK0/edit?usp=sharing Paul]
 
[https://docs.google.com/spreadsheets/d/16q8gw0KI7_eKHgIa8s_i9RL_FBQ5qLs74jRgu2VqaRg/edit?usp=sharing Konrad]
 
[https://docs.google.com/spreadsheets/d/16q8gw0KI7_eKHgIa8s_i9RL_FBQ5qLs74jRgu2VqaRg/edit?usp=sharing Konrad]
 +
  
 
=== Day 1 - Overview of sensory-motor computations ===
 
=== Day 1 - Overview of sensory-motor computations ===
Line 21: Line 24:
 
'''Afternoon tutorial 1 - plotting neural data'''
 
'''Afternoon tutorial 1 - plotting neural data'''
  
Here is the file [[http://klab.smpp.northwestern.edu/wiki/images/6/6f/M1_Stevenson_Binned.mat Stevenson Data Set]]
+
Here is the file [[http://compneurosci.com/wiki/images/M1_Stevenson_Binned.mat Stevenson Data Set]]
 
As part of the tuning curve exercise we will understand it. <br>
 
As part of the tuning curve exercise we will understand it. <br>
  
Line 41: Line 44:
 
'''Morning lectures and tutorial (Konrad)'''
 
'''Morning lectures and tutorial (Konrad)'''
  
[http://klab.smpp.northwestern.edu/wiki/images/d/db/Chapter_1_2015_02_16_figures.pptx Conditional Probabilities slides]
+
[http://compneurosci.com/wiki/images/Chapter_1_2015_02_16_figures.pptx Conditional Probabilities slides]
  
[http://klab.smpp.northwestern.edu/wiki/images/9/9a/Ch2_figures_20120104W.pptx Bayesian models slides]
+
[http://compneurosci.com/wiki/images/Ch2_figures_20120104W.pptx Bayesian models slides]
  
[http://klab.smpp.northwestern.edu/wiki/images/8/8e/Ch_4_figs_20120118.pptx Cuecumber nation slides]
+
[http://compneurosci.com/wiki/images/Ch_4_figs_20120118.pptx Cuecumber nation slides]
  
[http://klab.smpp.northwestern.edu/wiki/images/4/40/NCM_tutorial.zip Tutorial] and additional steps for  [http://klab.smpp.northwestern.edu/wiki/images/0/03/NCM_contest.zip extra points] <br>
+
[http://compneurosci.com/wiki/images/NCM_tutorial.zip Tutorial] and additional steps for  [http://compneurosci.com/wiki/images/NCM_contest.zip extra points] <br>
  
  
Line 75: Line 78:
  
 
Konrad talked about model fitting... <br>
 
Konrad talked about model fitting... <br>
Paul talked about Model Complexity and it's consequences. Link [http://klab.smpp.northwestern.edu/wiki/images/5/5c/ComplexityTradeOff.pdf here] <br>
+
Paul talked about Model Complexity and it's consequences. Link [http://compneurosci.com/wiki/images/ComplexityTradeOff.pdf here] <br>
 
[[Media:Model_evaluation_CoSMo2016.pdf | Model evaluation slides]] <br>
 
[[Media:Model_evaluation_CoSMo2016.pdf | Model evaluation slides]] <br>
 +
 +
----
  
  
Line 89: Line 94:
 
''' Day 5 (Francisco) '''
 
''' Day 5 (Francisco) '''
  
[http://valerolab.org/fundamentals/ Book website for Fundamentals of Neuromechanics]
+
[[Media:Francisco_2016_CoSMo.pdf | Francisco's slides]]
 +
 
 +
[http://valerolab.org/fundamentals/ Book website for Fundamentals of Neuromechanics] (free pdf!)
  
 
[https://github.com/bcohn12/vectormap/archive/master.zip Link to tutorial code] from [http://valerolab.org/book_chapters/ch9.html chapter 9].  
 
[https://github.com/bcohn12/vectormap/archive/master.zip Link to tutorial code] from [http://valerolab.org/book_chapters/ch9.html chapter 9].  
 
  
  
Line 100: Line 106:
 
[[Media:Sternad.Task-Dynamic.Approach.CosMo.2016s2b.pdf | Dagmar's slides]]
 
[[Media:Sternad.Task-Dynamic.Approach.CosMo.2016s2b.pdf | Dagmar's slides]]
  
 +
----
  
 
== The Bayesian Brain ==
 
== The Bayesian Brain ==
 
''Aug 8'' <br>
 
''Aug 8'' <br>
 
Lecturer: Adam Johnson
 
Lecturer: Adam Johnson
 +
 +
[https://umn.webex.com/umn/lsr.php?RCID=eb155d99eae44a46a47b39902ca840fb Link] to lecture video (requires installing webex plugin).
  
 
Individual Meeting Sign-up Sheet:
 
Individual Meeting Sign-up Sheet:
Line 109: Line 118:
  
  
[http://klab.smpp.northwestern.edu/wiki/images/f/f0/COSMO_Adam.zip Tutorials link]
+
[http://compneurosci.com/wiki/images/COSMO_Adam.zip Tutorials link]
  
 
[https://drive.google.com/open?id=0B8bK-gM8hHDpVHIzaDJ3R0VHd2c Link to drive with talk slides and videos]
 
[https://drive.google.com/open?id=0B8bK-gM8hHDpVHIzaDJ3R0VHd2c Link to drive with talk slides and videos]
 +
 +
----
  
  
Line 117: Line 128:
 
''Aug 9'' <br>
 
''Aug 9'' <br>
 
Lecturer: Jörn Diedrichsen
 
Lecturer: Jörn Diedrichsen
 +
 +
[https://umn.webex.com/umn/lsr.php?RCID=5836584e15a44625b6c248cc74335ede Link] to lecture video.
  
 
Individual Meeting Sign-up Sheet:
 
Individual Meeting Sign-up Sheet:
[https://docs.google.com/spreadsheets/d/1eA6B5dgClg2ow5SRYKfsoJhqDWZZDwLks2jwV5dEXOM/edit?usp=sharing Jörn Diedrichsen]
+
[https://docs.google.com/spreadsheets/d/1eA6B5dgClg2ow5SRYKfsoJhqDWZZDwLks2jwV5dEXOM/edit?usp=sharing Jörn Diedrichsen] <br>
  
 +
 +
[[Media:Jorn_slides_COSMO_2016_small.pdf | Joern's lecture slides]]
  
 
[[Media:Representational_models_Joern_2016.pdf | Representational models]] paper by Joern and Niko (in preparation)
 
[[Media:Representational_models_Joern_2016.pdf | Representational models]] paper by Joern and Niko (in preparation)
Line 127: Line 142:
  
 
[https://github.com/rsagroup/rsatoolbox RSA tooblox] on Github
 
[https://github.com/rsagroup/rsatoolbox RSA tooblox] on Github
 +
 +
----
  
  
Line 132: Line 149:
 
''Aug 10 & 11'' <br>
 
''Aug 10 & 11'' <br>
 
Lecturers: Reza Shadmehr, John Krakauer, & Alaa Ahmed
 
Lecturers: Reza Shadmehr, John Krakauer, & Alaa Ahmed
 +
 +
[[Media:Neural_prelude_to_movement_Reza_CoSMo2016.pdf | Reza's slides]] <br>
 +
 +
[https://umn.webex.com/umn/lsr.php?RCID=736b51abdbf44ed5a04b7819d9d5ae0e Link] to Wed lecture video.
 +
 +
[https://umn.webex.com/umn/lsr.php?RCID=e6e9fa863c6d4ec8bbc2c081110638e5 Link] to Thurs lecture video (better video forthcoming). [https://drive.google.com/open?id=0B8bK-gM8hHDpT2pfZDdoTDZSSVE Here] are pictures of the whiteboard from Reza's talk.
 +
 +
[https://www.youtube.com/channel/UCsktEryM0y0WqtXIMjnHcZA JHU learning theory YouTube channel]: Reza teaching
 +
  
 
Individual Meeting Sign-up Sheets:
 
Individual Meeting Sign-up Sheets:
Line 142: Line 168:
 
[[Media:Assignment_Alaa_CoSMo2016.pdf | Assignment instructions]] <br>
 
[[Media:Assignment_Alaa_CoSMo2016.pdf | Assignment instructions]] <br>
 
[[Media:EffMassDounskaia_2016.mat | Data]] and [[Media:Minjerk.m | associated Matlab file]]
 
[[Media:EffMassDounskaia_2016.mat | Data]] and [[Media:Minjerk.m | associated Matlab file]]
 +
 +
----
  
  
Line 150: Line 178:
 
You can get the DREAM project from Gunnar on a USB drive.  DREAM can also be downloaded piece-wise (data sets, models, tools, and documentation) from CRCNS: http://crcns.org/data-sets/movements/dream/downloading-dream.  You will need to [https://crcns.org/join_form?came_from=http%3A//crcns.org/data-sets/movements/dream/downloading-dream create] an account on CRCNS to be able to download the project files.
 
You can get the DREAM project from Gunnar on a USB drive.  DREAM can also be downloaded piece-wise (data sets, models, tools, and documentation) from CRCNS: http://crcns.org/data-sets/movements/dream/downloading-dream.  You will need to [https://crcns.org/join_form?came_from=http%3A//crcns.org/data-sets/movements/dream/downloading-dream create] an account on CRCNS to be able to download the project files.
 
<!--[[File:AllDream.zip]]-->
 
<!--[[File:AllDream.zip]]-->
If you want "all" of DREAM (models, tools, and documentation), click here: [http://klab.smpp.northwestern.edu/wiki/images/d/d2/AllDream.zip AllDream.zip] <br>
+
If you want "all" of DREAM (models, tools, and documentation), click here: [http://compneurosci.com/wiki/images/AllDream.zip AllDream.zip] <br>
  
 
:If you're familiar with svn and would like info/credentials for code in the repository, contact [[Ben Walker]]
 
:If you're familiar with svn and would like info/credentials for code in the repository, contact [[Ben Walker]]
Line 174: Line 202:
 
*[[Media:Wei_2010.pdf | Wei 10]] -- movement in differing force fields <br>
 
*[[Media:Wei_2010.pdf | Wei 10]] -- movement in differing force fields <br>
 
*[[Media:Young_2009.pdf | Young]] -- movement time stayed the same, but distance changed; fast, medium, slow reaches. <br>
 
*[[Media:Young_2009.pdf | Young]] -- movement time stayed the same, but distance changed; fast, medium, slow reaches. <br>
 +
 +
----
  
  
Line 181: Line 211:
 
[https://docs.google.com/document/d/1uSXjGmlbal8-Y3qmbntZYRA9in3Re2bCTWcA19c00yI/edit?usp=sharing Here] are some ideas for 2-week project topics. <br>
 
[https://docs.google.com/document/d/1uSXjGmlbal8-Y3qmbntZYRA9in3Re2bCTWcA19c00yI/edit?usp=sharing Here] are some ideas for 2-week project topics. <br>
  
[[Media:HowtoModel_CoSMo2016.pdf | How-to-model tutorial]] (Aug 2, evening)
+
[[Media:HowtoModel_CoSMo2016.pdf | How-to-model tutorial]] (Aug 2, evening) <br>
 +
 
 +
[[Media:GroupProjectPresentationTemplate_CoSMo2016.pptx | Template for final project presentations]] <br>
 +
 
 +
 
 +
'''Instructions:''' Every group will have a 30min slot (20min presentation, 10min questions). The research question, hypotheses and rationale for the choice of the approach should be clearly presented. Models, simulations, results, discussion etc should be detailed enough for everyone to follow. <br>
 +
'''Best group gets a free short talk at TCMC 2016!!!''' (confirmed by John Krakauer) <br>
 +
Here is a link to the SfN [https://www.sfn.org/annual-meeting/neuroscience-2016/sessions-and-events/satellite-events satellite events] - submission deadline Sept 1 !!! The winner has to apply too and specify you are CoSMo 2016 project winner... <br>
 +
 
 +
 
 +
'''PROJECT PRESENTATIONS (Aug 13)''' <br>
 +
 
 +
''4:00-4:30pm - The Name’s Irrelephant'' <br>
 +
"Encoding Sequentially Presented Items with a Recurrent Memory Network" <br>
 +
Group: Charles Holmes, Silvia Maggi, Kevin Willeford <br>
 +
[https://drive.google.com/file/d/0B9R9s19vjIEJSDhWUGttenJFS0U/view?ts=57b3181e Slides] <br>
 +
 
 +
 
 +
''4:30-5:00 - Neuro Miners'' <br>
 +
"Towards bayesian decoding of ECoG channels" <br>
 +
Group: Shuchen, Ali Marjaninejad, Rajat <br>
 +
[[Media:BayesianDecoders.pptx.pdf | Slides]] <br>
 +
 
 +
 
 +
''5:00-5:30 - Granger Danger'' <br>
 +
"Modeling feedback-driven perceptual learning" <br>
 +
Group: Daniel Lametti, Josh Moskowitz, Xiang Mou <br>
 +
[[Media:Feedback_driven_perceptual_learning_Moskowitz_Lametti_Mou_COSMO_2016.pdf | Slides]] <br>
 +
 
 +
 
 +
''5:30-6:00 - BASH Group'' <br>
 +
"Modeling increased learning with intermittent feedback" <br>
 +
Group: Maria Ayala, Dan Blustein, James Heald, Raphael Schween <br>
 +
[[Media:BASHteamCoSMo_Presentation_CoSMo2016.pdf | Slides]] <br>
 +
 
 +
 
 +
''6:00-6:30 - Cool, Kalm an' collected'' <br>
 +
"Modeling the relationship between reward and sensory feedback in sensory motor adaptation" <br>
 +
Group: Elizabeth, Giacomo, Giulia, Jerry, Patrick <br>
 +
[[Media:CoSMo2016_GroupProjectPresentation_CKC.pdf | Slides]] <br>
 +
 
 +
 
 +
''Dinner break''  <br>
 +
 
 +
 
 +
''7:00-7:30 - State EsTeamation'' <br>
 +
"Velocity Modulation given State Estimation Uncertainty" <br>
 +
Group: Brian Cohn, Clare Palmer, Darius Parvin, Vonne van Polanen, Ivan Trujillo-Priego <br>
 +
 
 +
 
 +
''7:30-8:00 - Horrible Acrylic Nails'' <br>
 +
"If we only had more time to prepare for this…" <br>
 +
Group: Nathan Wispinski, Cole Simpson, Claire Chambers, Erik Summerside <br>
 +
 
 +
 
 +
''8:00-8:30 - BayesX'' - '''WINNER !!!'''<br>
 +
"Environmental consistency increases learning saturation level in a visuomotor rotation task" <br>
 +
Group: Scott Albert, Lonneke Teunissen, Hannah Sheahan, Koenraad Vandevoorde <br>
 +
[[Media:Final_presentation_bayesx_for_submission.pdf | Slides]] <br>
 +
 
 +
 
 +
''8:30-9:00 - The Swan Elks'' <br>
 +
"Dissecting the nature of persistent activity in macaque parietal cortex" <br>
 +
Group: Nakahashi, Sedaghat, Katz, Weingaertner <br>
 +
[https://www.dropbox.com/s/xy4xk4gc1hqcv2c/2016_CoSMo_SwanElks_FINAL_VERSION.key?dl=0 Slides] <br>
 +
 
 +
 
 +
''9:00-9:30 - Utterly Unpredictable'' <br>
 +
"To Go or Not To Go: Bayesian Integration of Stimulus Statistics and Reward Structure in Action Decision Making" <br>
 +
Group: Quan Lei, Thomas Ringstrom, Huaiyong Zhao <br>

Latest revision as of 16:23, 19 July 2019

This page contains course materials for the CoSMo 2016 summer school.

CoSMo logo



Introduction

Aug 1-4
Lecturers: Gunnar Blohm, Paul Schrater, Konrad Kording

Individual Meeting Sign-up Sheets: Gunnar Paul Konrad


Day 1 - Overview of sensory-motor computations

Organization slides
Philosophy of modelling slides
Sensorimotor overview slides


Afternoon tutorial 1 - plotting neural data

Here is the file [Stevenson Data Set] As part of the tuning curve exercise we will understand it.


Afternoon tutorial 2: gain modulation for reference frame transformations

The goal of this tutorial is to understand how gain modulation can be used for reference frame transformations and how gain modulation can emerge from training a simple artificial neural network carrying out reference frame transformations.
There are 2 different approaches to solving this:

  • exact determination of read-out weights from eye-position gain-modulated neurons as in this seminal paper. Here the solution can be found by computing the least-square optimal set of weights mapping the gain-modulated neurons (population code) to head-centered output neuron(s). For this to work, population code neurons need to be of the exponential function family.
  • training a neural network to perform reference frame transformations using this code. For this you can plot each individual neuron's receptive field for different eye positions and analyze how the receptive field changes with eye position in each network layer.


Day 2 - Bayesian approaches

Bayesian perception - an introduction: a tremendous book written by Wei Ji Ma, Konrad Kording, Daniel Goldreich


Morning lectures and tutorial (Konrad)

Conditional Probabilities slides

Bayesian models slides

Cuecumber nation slides

Tutorial and additional steps for extra points


Afternoon lectures and tutorial (Paul)

Face attractiveness and decision tutorials, and lecture slides

Here are modeling tutorial instructions. Please also read the papers by Lappe and Seno.


Day 3 - Linear systems

Morning lectures and tutorials (Theory and saccades)
Linear systems theory slides
Modelling saccades slides
This Matlab file contains both the time representation and frequency representation (using the control systems toolbox) solutions for modelling saccades. Here is yet another way to approach the solution through explicit convolution (this is not preferred but possible ;-) ).

van Opstal syllabus - linear systems theory: a great syllabus developed by John van Opstal for CoSMo on using linear systems to model gaze control with theory, exercises and answers to exercises


Afternoon lectures and tutorials (Kalman filter)
Understanding the Basis of the Kalman Filter Via a Simple and Intuitive Derivation
Kalman Filter tutorials and slides


Day 4 - Optimality and data analyses

Konrad talked about model fitting...
Paul talked about Model Complexity and it's consequences. Link here
Model evaluation slides



Modeling movement and disorders

Aug 5-6
Lecturers: Dagmar Sternad & Francisco Valero-Cuevas

Individual Meeting Sign-up Sheets: Dagmar Francisco


Day 5 (Francisco)

Francisco's slides

Book website for Fundamentals of Neuromechanics (free pdf!)

Link to tutorial code from chapter 9.


Day 6 (Dagmar)

Link to dropbox with tutorial code.
Dagmar's slides


The Bayesian Brain

Aug 8
Lecturer: Adam Johnson

Link to lecture video (requires installing webex plugin).

Individual Meeting Sign-up Sheet: Adam Johnson


Tutorials link

Link to drive with talk slides and videos



Computational Neuroimaging

Aug 9
Lecturer: Jörn Diedrichsen

Link to lecture video.

Individual Meeting Sign-up Sheet: Jörn Diedrichsen


Joern's lecture slides

Representational models paper by Joern and Niko (in preparation)

Tutorial instructions and dataset

RSA tooblox on Github



Motor control & learning

Aug 10 & 11
Lecturers: Reza Shadmehr, John Krakauer, & Alaa Ahmed

Reza's slides

Link to Wed lecture video.

Link to Thurs lecture video (better video forthcoming). Here are pictures of the whiteboard from Reza's talk.

JHU learning theory YouTube channel: Reza teaching


Individual Meeting Sign-up Sheets: Reza Shadmehr John Krakauer Alaa Ahmed


Afternoon tutorials - Aug 10
Assignment instructions
Data and associated Matlab file



DREAM database - Shared data and models for CoSMo projects

Jul 31 - Aug 14
Curtesy: Konrad Kording

You can get the DREAM project from Gunnar on a USB drive. DREAM can also be downloaded piece-wise (data sets, models, tools, and documentation) from CRCNS: http://crcns.org/data-sets/movements/dream/downloading-dream. You will need to create an account on CRCNS to be able to download the project files. If you want "all" of DREAM (models, tools, and documentation), click here: AllDream.zip

If you're familiar with svn and would like info/credentials for code in the repository, contact Ben Walker


Here's the latest version of LoadDreamPaths.m. (This script should work for all OSes.)


Here is a description of data sets currently in Dream. Dream is growing, but this list is accurate as of the time of the summer school (click on the link to access the related publication).

  • Burns -- reaching with head tilt and left/right visual perturbations
  • Corbett -- reach trajectory predictions based on EMG and gaze movements
  • Fernandes -- reaching with uncertain and rotated midpoint feedback
  • Flint -- decoding of reaching movements from local field potentials
  • Kording -- reaching with uncertain midpoint feedback
  • Mattar 07 -- generalizing from one, two or multi targets to another direction
  • Mattar 10 -- reaching to a distance (short/long), generalizing to the other one (long/short)
  • Ostry -- move in force field, get an estimation of where the hand is
  • Scott -- monkey (no spike), center out: even and not evenly distributed targets, also a forward/back
  • Stevenson -- center out, monkey with neural time stamps
  • Thoroughman -- reach adaptation to perturbations with different complexity
  • Vahdat -- movement in force field with FMRI scans pre/post learning
  • Wei 08 -- visual perturbations, cursor shown only at target
  • Wei 10 -- movement in differing force fields
  • Young -- movement time stayed the same, but distance changed; fast, medium, slow reaches.


Group projects

Jul 31 - Aug 14

Here are some ideas for 2-week project topics.

How-to-model tutorial (Aug 2, evening)

Template for final project presentations


Instructions: Every group will have a 30min slot (20min presentation, 10min questions). The research question, hypotheses and rationale for the choice of the approach should be clearly presented. Models, simulations, results, discussion etc should be detailed enough for everyone to follow.
Best group gets a free short talk at TCMC 2016!!! (confirmed by John Krakauer)
Here is a link to the SfN satellite events - submission deadline Sept 1 !!! The winner has to apply too and specify you are CoSMo 2016 project winner...


PROJECT PRESENTATIONS (Aug 13)

4:00-4:30pm - The Name’s Irrelephant
"Encoding Sequentially Presented Items with a Recurrent Memory Network"
Group: Charles Holmes, Silvia Maggi, Kevin Willeford
Slides


4:30-5:00 - Neuro Miners
"Towards bayesian decoding of ECoG channels"
Group: Shuchen, Ali Marjaninejad, Rajat
Slides


5:00-5:30 - Granger Danger
"Modeling feedback-driven perceptual learning"
Group: Daniel Lametti, Josh Moskowitz, Xiang Mou
Slides


5:30-6:00 - BASH Group
"Modeling increased learning with intermittent feedback"
Group: Maria Ayala, Dan Blustein, James Heald, Raphael Schween
Slides


6:00-6:30 - Cool, Kalm an' collected
"Modeling the relationship between reward and sensory feedback in sensory motor adaptation"
Group: Elizabeth, Giacomo, Giulia, Jerry, Patrick
Slides


Dinner break


7:00-7:30 - State EsTeamation
"Velocity Modulation given State Estimation Uncertainty"
Group: Brian Cohn, Clare Palmer, Darius Parvin, Vonne van Polanen, Ivan Trujillo-Priego


7:30-8:00 - Horrible Acrylic Nails
"If we only had more time to prepare for this…"
Group: Nathan Wispinski, Cole Simpson, Claire Chambers, Erik Summerside


8:00-8:30 - BayesX - WINNER !!!
"Environmental consistency increases learning saturation level in a visuomotor rotation task"
Group: Scott Albert, Lonneke Teunissen, Hannah Sheahan, Koenraad Vandevoorde
Slides


8:30-9:00 - The Swan Elks
"Dissecting the nature of persistent activity in macaque parietal cortex"
Group: Nakahashi, Sedaghat, Katz, Weingaertner
Slides


9:00-9:30 - Utterly Unpredictable
"To Go or Not To Go: Bayesian Integration of Stimulus Statistics and Reward Structure in Action Decision Making"
Group: Quan Lei, Thomas Ringstrom, Huaiyong Zhao