Biological Learning and Control
In Biological Learning and Control, Reza Shadmehr and Sandro Mussa-Ivaldi present a theoretical framework for understanding the regularity of the brain's perceptions, its reactions to sensory stimuli, and its control of movements. They offer an account of perception as the combination of prediction and observation: the brain builds internal models that describe what should happen and then combines this prediction with reports from the sensory system to form a belief.
Considering the brain's control of movements, and variations despite biomechanical similarities among old and young, healthy and unhealthy, and humans and other animals, Shadmehr and Mussa-Ivaldi review evidence suggesting that motor commands reflect an economic decision made by our brain weighing reward and effort. This evidence also suggests that the brain prefers to receive a reward sooner than later, devaluing or discounting reward with the passage of time; then as the value of the expected reward changes in the brain with the passing of time (because of development, disease, or evolution), the shape of our movements will also change.
The internal models formed by the brain provide the brain with an essential survival skill: the ability to predict based on past observations. The formal concepts presented by Shadmehr and Mussa-Ivaldi offer a way to describe how representations are formed, what structure they have, and how the theoretical concepts can be tested.
About the Authors
Reza Shadmehr is Professor of Biomedical Engineering and Neuroscience at Johns Hopkins University and the author of The Computational Neurobiology of Reaching and Pointing (MIT Press, 2005).
Sandro Mussa-Ivaldi is Professor of Physiology in the Medical School at Northwestern University, with joint appointments in Physical Medicine and Rehabilitation and Biomedical Engineering. He is also Founder and Director of the Robotics Laboratory at the Rehabilitation Institute of Chicago.
Table of Contents
- Biological Learning and Control
- Computational Neuroscience
- Terence J. Sejnowski and Tomaso A. Poggio, editors
- For a complete list of books in this series, see the back of the book and
- Biological Learning and Control
- How the Brain Builds Representations, Predicts Events, and Makes Decisions
- Reza Shadmehr and Sandro Mussa-Ivaldi
- The MIT Press
- Cambridge, Massachusetts
- London, England
- Massachusetts Institute of Technology
- All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher.
- MIT Press books may be purchased at special quantity discounts for business or sales promotional use. For information, please email firstname.lastname@example.org or write to Special Sales Department, The MIT Press, 55 Hayward Street, Cambridge, MA 02142.
- This book was set in Syntax and Times Roman by Toppan Best-set Premedia Limited. Printed and bound in the United States of America.
- Library of Congress Cataloging-in-Publication Data
- Shadmehr, Reza.
- Biological learning and control : how the brain builds representations, predicts events, and makes decisions / Reza Shadmehr and Sandro Mussa-Ivaldi.
- p. cm.—(Computational neuroscience)
- Includes bibliographical references and index.
- ISBN 978-0-262-01696-4 (hardcover : alk. paper)
- 1. Brain. 2. Neuropsychology. 3. Brain—Mathematical models. I. Mussa-Ivaldi, Sandro. II. Title.
- QP376.S4373 2012
- 10 9 8 7 6 5 4 3 2 1
- Series Foreword vii
- Introduction 1
- 1 Space in the Mammalian Brain 7
- 2 Building a Space Map 35
- 3 The Space Inside 67
- 4 Sensorimotor Integration and State Estimation 95
- 5 Bayesian Estimation and Inference 143
- 6 Learning to Make Accurate Predictions 177
- 7 Learning Faster 213
- 8 The Multiple Timescales of Memory 225
- 9 Building Generative Models: Structural Learning and Identification of the Learner 251
- 10 Costs and Rewards of Motor Commands 279
- 11 Cost of Time in Motor Control 307
- 12 Optimal Feedback Control 335
- Appendix 367
- Notes 371
- References 375
- Index 383
—Daniel Wolpert, University of Cambridge
—Konrad Körding, Associate Professor, Northwestern University; Lead Scientist, Rehabilitation Institute of Chicago, Center for Parkinson’s Disease
—Paul Cisek, Department of Physiology, University of Montréal