ARTICLE Communicated by Ruoyu Sun Critical Point-Finding Methods Reveal Gradient-Flat Regions of Deep Network Losses Charles G. Frye cfrye59@gmail.com Redwood Center for Theoretical Neuroscience and Helen Wills Neuroscience Institute, Universidad de California, berkeley, California 94720, U.S.A. James Simon james.simon@berkeley.edu Redwood Center for Theoretical Neuroscience and Department of Physics, Universidad de California, berkeley, California 94720, U.S.A. Neha S. Wadia neha.wadia@berkeley.edu Andrew Ligeralde ligeralde@berkeley.edu Redwood Center for

ARTICLE Communicated by Shun-ichi Amari On the Achievability of Blind Source Separation for High-Dimensional Nonlinear Source Mixtures Takuya Isomura takuya.isomura@riken.jp Laboratory for Neural Computation and Adaptation and Brain Intelligence Theory Unit, RIKEN Center for Brain Science, Wako, Saitama 351-0198, Japan Taro Toyoizumi taro.toyoizumi@riken.jp Laboratory for Neural Computation and Adaptation, RIKEN Center for Brain Science, Wako, Saitama 351-0198, Japón, and Department of Mathematical Informatics, Graduate School

ARTICLE Communicated by Stefano Panzeri The Refractory Period Matters: Unifying Mechanisms of Macroscopic Brain Waves Corey Weistuch corey.weistuch@stonybrook.edu Laufer Center for Physical and Quantitative Biology and Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, Nueva York 11794, U.S.A. Lilianne R. Mujica-Parodi lilianne.strey@stonybrook.edu Laufer Center for Physical and Quantitative Biology, Departments of Biomedical Engineering and of Physics and Astronomy, Program in Neuroscience, and Department

LETTER Communicated by Raoul-Martin Memmesheimer The Remarkable Robustness of Surrogate Gradient Learning for Instilling Complex Function in Spiking Neural Networks Friedemann Zenke friedemann.zenke@fmi.ch Centre for Neural Circuits and Behaviour, Universidad de Oxford, Oxford OX1 3SR, REINO UNIDO., and Friedrich Miescher Institute for Biomedical Research, 4058 Basel, Switzerland Tim P. Vogels tim.vogels@ist.ac.at Centre for Neural Circuits and Behaviour, Universidad de Oxford, Oxford OX1 3SR, REINO UNIDO., and Institute

LETTER Communicated by Terrence Sejnowski Whence the Expected Free Energy? Beren Millidge beren@millidge.name School of Informatics, University of Edinburgh, Edimburgo, EH8 9AB, REINO UNIDO. Alexander Tschantz tschantz.alec@gmail.com Sackler Center for Consciousness Science, School of Engineering and Informatics, University of Sussex, Falmer, Brighton, BN1 9RH, REINO UNIDO. Christopher L. Buckley C.L.Buckley@sussex.ac.uk Evolutionary and Adaptive Systems Research Group, School of Engineering and Informatics, University of Sussex, Falmer, Brighton, BN1

ARTICLE Communicated by Alain Destexhe From Biophysical to Integrate-and-Fire Modeling Tomas Van Pottelbergh tmjv2@cam.ac.uk Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, REINO UNIDO. Guillaume Drion gdrion@ulg.ac.be Department of Electrical Engineering and Computer Science, University of Liège, 4000 Liège, Belgium Rodolphe Sepulchre r.sepulchre@eng.cam.ac.uk Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, REINO UNIDO. This article proposes a methodology to extract a low-dimensional integrate-and-fire model from

ARTICLE Communicated by Dirk Ostwald Learning in Volatile Environments With the Bayes Factor Surprise Vasiliki Liakoni* vasiliki.liakoni@epfl.ch Alireza Modirshanechi* alireza.modirshanechi@epfl.ch Wulfram Gerstner wulfram.gerstner@epfl.ch Johanni Brea johanni.brea@epfl.ch École Polytechnique Fédérale de Lausanne, School of Computer and Communication Sciences and School of Life Sciences, 1015 Lausanne, Switzerland Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian

LETTER Communicated by Ian Robertson Deeply Felt Affect: The Emergence of Valence in Deep Active Inference Casper Hesp* c.hesp@uva.nl Department of Psychology and Amsterdam Brain and Cognition Centre, University of Amsterdam, 1098 XH Amsterdam, Países Bajos; Institute for Advanced Study, University of Amsterdam, 1012 GC Amsterdam, Países Bajos; and Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, REINO UNIDO. Ryan Smith* RSmith@laureateinstitute.org Laureate Institute for

ARTICLE Communicated by Terrence Sejnowski A Cerebellar Computational Mechanism for Delay Conditioning at Precise Time Intervals Terence D. Sanger terry@sangerlab.net Departments of Biomedical Engineering, Neurología, and Biokinesiology, University of Southern California, Los Angeles, California 90089, U.S.A. Mitsuo Kawato kawato@atr.jp Brain Information Communication Research Laboratory Group, Advanced Telecommunications Research Institutes International, Kioto 619-0288, Japón, and Center for Advanced Intelligence Project, RIKEN, Chuo-ku, Tokio, 103-0027, Japan The

LETTER Communicated by Justin Dauwels Reverse-Engineering Neural Networks to Characterize Their Cost Functions Takuya Isomura takuya.isomura@riken.jp Brain Intelligence Theory Unit, RIKEN Center for Brain Science, Wako, Saitama 351-0198, Japan Karl Friston k.friston@ucl.ac.uk Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, Londres, WC1N 3AR, REINO UNIDO. This letter considers a class of biologically plausible cost functions for neural networks, where the same cost function

ARTICLE Communicated by Igor Goychuk Fast and Accurate Langevin Simulations of Stochastic Hodgkin-Huxley Dynamics Shusen Pu sxp600@case.edu Department of Mathematics, Applied Mathematics, and Statistics, Case Western Reserve University, Cleveland, OH 44106, U.S.A. Peter J. Thomas pjthomas@case.edu Department of Mathematics, Applied Mathematics, and Statistics; Biología; Ciencia cognitiva; and Electrical, Computadora, and Systems Engineering: Case Western Reserve University, Cleveland, OH 44106, U.S.A. Fox and Lu introduced a

ARTICLE Communicated by Diego Pazò A Mean-Field Description of Bursting Dynamics in Spiking Neural Networks with Short-Term Adaptation Richard Gast rgast@cbs.mpg.de Helmut Schmidt hschmidt@cbs.mpg.de Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany Thomas R. Knösche knoesche@cbs.mpg.de Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Alemania, and Institute for Biomedical Engineering and Informatics, TU 98693 Ilmenau, Germany Bursting plays

ARTICLE Communicated by Tilo Schwalger Inference of a Mesoscopic Population Model from Population Spike Trains Alexandre René arene010@uottawa.ca Department of Physics, University of Ottawa, Ottawa K1N 6N5, Canada; Max Planck Research Group Neural Systems Analysis, Center of Advanced European Studies and Research (caesar), Bonn 53175, Alemania; and Institute of Neuroscience and Medicine (INM-6) and Institute for Advanced Simulation (IAS-6) and JARA-Institute Brain Structure-Function Relationships (INM-10),

ARTICLE Communicated by Ruben Moreno-Bote Heterogeneous Synaptic Weighting Improves Neural Coding in the Presence of Common Noise Pratik S. Sachdeva pratik.sachdeva@berkeley.edu Redwood Center for Theoretical Neuroscience and Department of Physics, Universidad de California, berkeley, berkeley, California 94720 EE.UU., and Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, berkeley, California 94720, U.S.A. Jesse A. Livezey jlivezey@lbl.gov Redwood Center for Theoretical Neuroscience, Universidad de California, berkeley,

ARTICLE Communicated by Luca Mazzucato Nonequilibrium Statistical Mechanics of Continuous Attractors Weishun Zhong wszhong@mit.edu James Franck Institute, University of Chicago, chicago, IL 60637, and Department of Physics, CON, Cambridge, MAMÁ 02139, U.S.A. Zhiyue Lu zhiyuelu@unc.edu James Franck Institute, University of Chicago, chicago, IL 60637, U.S.A. David J. Schwab dschwab@gc.cuny.edu Initiative for the Theoretical Sciences, CUNY Graduate Center, Nueva York, Nueva York 10016, and Center for the

ARTICLE Communicated by Shun-ichi Amari Center Manifold Analysis of Plateau Phenomena Caused by Degeneration of Three-Layer Perceptron Daiji Tsutsui d-tsutsui@cr.math.sci.osaka-u.ac.jp Osaka University, Toyonaka-shi, Osaka 560-0043, Japan A hierarchical neural network usually has many singular regions in the parameter space due to the degeneration of hidden units. Aquí, we fo- cus on a three-layer perceptron, which has one-dimensional singular regions comprising both attractive and repulsive parts.

ARTICLE Communicated by Terrence Sejnowski Hidden Aspects of the Research ADOS Are Bound to Affect Autism Science Elizabeth B. Torres ebtorres@psych.rutgers.edu Psychology Department; Computer Science, Center for Biomedical Imagining and Modeling; and Rutgers University Center for Cognitive Science, Rutgers University, Piscataway, Nueva Jersey 08854, U.S.A. Richa Rai richarai9@gmail.com Psychology Department, Rutgers University, Piscataway, Nueva Jersey 08854, U.S.A. Sejal Mistry sejal.mistry@hsc.utah.edu Mathematics Department, Rutgers University, Piscataway, Nueva Jersey 08854,

LETTER Communicated by Frederic Crevecoeur Model-Free Robust Optimal Feedback Mechanisms of Biological Motor Control Tao Bian tbian@nyu.edu Control and Networks Lab, Department of Electrical and Computer Engineering, Tandon School of Engineering, New York University, Brooklyn, Nueva York 11201, U.S.A. Daniel M. Wolpert wolpert@columbia.edu Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, Nueva York, Nueva York 10027, EE.UU., and Department of Engineering, University of Cambridge, Cambridge