Bee foraging in uncertain environments using predictive hebbian learning

RECENT work has identified a neuron with widespread projections to odour processing regions of the honeybee brain whose activity represents the reward value of gustatory stimuli1,2. We have constructed a model of bee foraging in uncertain environments based on this type of neuron and a predictive form of hebbian synaptic plasticity. The model uses visual input from a simulated three-dimensional world and accounts for a wide range of experiments on bee learning during foraging, including risk aversion. The predictive model shows how neuromodulatory influences can be used to bias actions and control synaptic plasticity in a way that goes beyond standard correlational mechanisms. Although several behavioural models of conditioning in bees have been proposed3–7, this model is based on the neural substrate and was tested in a simulation of bee flight.

[1]  J. Konorski Conditioned reflexes and neuron organization. , 1948 .

[2]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[3]  D. Koshland,et al.  Quantitation of the sensory response in bacterial chemotaxis. , 1975, Proceedings of the National Academy of Sciences of the United States of America.

[4]  P. Taylor,et al.  Test of optimal sampling by foraging great tits , 1978 .

[5]  A G Barto,et al.  Toward a modern theory of adaptive networks: expectation and prediction. , 1981, Psychological review.

[6]  L. Real UNCERTAINTY AND POLLINATOR-PLANT INTERACTIONS: THE FORAGING BEHAVIOR OF BEES AND WASPS ON ARTIFICIAL FLOWERS' , 1981 .

[7]  Donald A. Berry,et al.  Bandit Problems: Sequential Allocation of Experiments. , 1986 .

[8]  M. Bitterman,et al.  Analysis of choice in honeybees , 1985 .

[9]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .

[10]  M. Bitterman,et al.  Performance of honeybees in reversal and ambiguous-cue problems: Tests of a choice model , 1986 .

[11]  L. Real,et al.  Why are Bumble Bees Risk Averse , 1987 .

[12]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[13]  M. Bitterman,et al.  Learning in honeybees as a function of amount of reward: Rejection of the equal-asymptote assumption , 1989 .

[14]  L. Real,et al.  Short-Term Energy Maximization and Risk-Aversion in Bumble Bees: A Reply to Possingham Et Al. , 1990 .

[15]  L A Real,et al.  Animal choice behavior and the evolution of cognitive architecture , 1991, Science.

[16]  A. C. Lewis,et al.  Insect Learning: Ecology and Evolutinary Perspectives , 1993 .

[17]  M. Hammer An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees , 1993, Nature.

[18]  W. Schultz,et al.  Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  M. Hammer,et al.  Functional Organization of Appetitive Learning and Memory in a Generalist Pollinator, the Honey Bee , 1993 .

[20]  T. Sejnowski,et al.  The predictive brain: temporal coincidence and temporal order in synaptic learning mechanisms. , 1994, Learning & memory.

[21]  M. Hammer,et al.  Learning and memory in the honeybee , 1995 .

[22]  R. Harris-Warrick,et al.  Dopamine modulation of transient potassium current evokes phase shifts in a central pattern generator network , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.