medigraphic.com

2012, Number 1

<< Back Next >>

Rev Mex Ing Biomed 2012; 33 (1)

Artificial neural network of the mesolimbic-cortical system that simulates the discrimination and inverse learning

Guevara MA, Hernández GM, Olvera CME, Robles AFA

Language: Spanish
References: 33
Page: 8-16
PDF size: 182.29 Kb.


ABSTRACT

The present study develops a connectionist neural network with unsupervised learning rules to simulate a discrimination task in a reduced number of time steps without previous training. The design of the network took into account some neurophysiological findings of dopaminergic mesolimbic system from structures like amygdala (AMG), orbitofrontal cortex (COF), ventral tegmental area (ATV) and nucleus accumbens (ACC). The proposed model generated similar responses to those from male rats during a discrimination and reversal learning tasks in a T maze, using sex as reward. In the activity of simulated structures different phenomena were found, like reinforcement preference and its reversal during reversal learning phase in ACC and ATV. It was also found an early encode in AMG, besides a retarded encoding and an increase in recruitment of neural nodes in COF during reversal learning. All output structures showed an expectancy activity before reinforcer delivery.


REFERENCES

  1. Enquist M, Ghirlanda S. Neural networks and animal behavior. Princenton University Press (New Jersey), 2005.

  2. Rolls ET, Romo RS. “Stochastic dynamics as a principle of brain function”. Progress in Neurobiology, 2009; 88: 1-16.

  3. Doya K. “What are the computations of the cerebellum, the basal ganglia and the cerebral cortex?”. Neural Networks, 1999; 12: 961-974.

  4. Grabenhorst F, Rolls ET. “Value, pleasure and choice in the ventral prefrontal cortex”. Trends in Cog. Sci., 2011; (2): 56-67.

  5. Anderson J, Rosenfeld E. Neurocompuntig. Foundations of Research. MIT Press (Cambridge), 1988.

  6. Deco G, Rolls ET, Albantakis L, Romo R. “Brain mechanisms for perceptual and reward-related decision-making”. Progress in Neurobiology, 2012; (en prensa).

  7. Schmajuk NA, Gray J, Lam Y. “Latent inhibition: A neural network approach”. J Exp Psychol Anim Behav Proc, 1996; 22(3): 321-349.

  8. Balkenius C, Morén J. “Emotional learning: A computational model of the amygdala”. Cybernetics and Systems, 2001; 32: 611-636.

  9. Zhou W, Coggings R. “Computational models of the amygdala and the orbitofrontal cortex: A hierarchical reinforcement learning system for robotic control”. In: McKey R, Slaney J, editors, AI: 2002: Advances in artificial intelligence, Springer-Verlag (Heidelberg), 2002: 419-430.

  10. Donahoe J, Burgos JE, Palmer D. “A selectionist approach to reinforcement”. J Exp Anal Behav 1993; 60(1): 17-40.

  11. Donahoe J, Palmer D. Learning and complex behavior. Allyn and Bacon (Boston), 1994.

  12. Armony J, Servan-Schreiber DJ, LeDoux J. “Computational modeling of emotion: explorations through the anatomy and physiology of fear conditioning”. Psychol Rev 1997; 81(3): 199-213.

  13. Deco G, Rolls ET. “Synaptic and spiking dynamics underlying reward reversal in the orbitofrontal cortex”. Cerebral Cortex, 2005; 15: 15-30.

  14. Rolls ET, Treeves A. Neural networks and brain function. Oxford University Press (Oxford), 2001.

  15. Rolls ET. Memory, attention and decision making. Oxford University Press (Oxford), 2008.

  16. Schoenbaum G, Chiba A, Gallagher M. “Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning”. J Neurosci 1999; 19(5): 1876-1884.

  17. Rolls ET. “The orbitofrontal cortex and reward”. Cerebral Cortex, 2000; 10: 284-294.

  18. Schoenbaum G, Chiba A, Gallagher M. “Changes in functional connectivity in orbitofrontal cortex and basolateral amygdala during learning and reversal training”. J Neurosci 2000; 20(13): 5179-5189.

  19. Schoenbaum G, Setlow B, Nugent S, Saddoris M, Gallagher M. “Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals”. Learn & Mem, 2003; 10: 129-140.

  20. Guevara MA, Robles-Aguirre FA, Quirarte GL, Hernández-González M. “Orbitofrontal cortex inactivation impairs early reversal learning in male rats during a sexually motivated task”, Int J Psychol & Psychol Ther 2009; 9(2): 141-160.

  21. Schoenbaum G, Saddoris M, Stalnaker T. “Reconciling the roles of orbitofrontal cortex in reversal learning and the encoding of outcome expectancies”. In: Schoenbaum G, Gottfried J, Murray E, Ramus S, editors, Linking affect to action, New York Academy of Science (Boston), 2007: 320-335.

  22. Saddoris M, Gallagher M, Schoenbaum G. “Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex. Neuron 2005; 46: 321-331.

  23. Fuster J. The prefrontal cortex. Raven Press (New York), 1989.

  24. Domesick V. “Neuroanatomical organization of dopamine neurons in the ventral tegmental area”. In: Kalivas P, Nemeroff Ch, editors, The mesocorticolibic system, New York Academy of Sciences (New York), 1988: 10-26.

  25. Öngur D, Price J. “The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans”. Cerebral Cortex, 2000; 10: 206-219.

  26. McDonald, AJ. “Cortical pathways to the mammalian amygdala”. Prog Neurobiol 1998; 55: 257-332.

  27. Pitkänen, A. “Connectivity of the rat amygdaloid complex”. In: Aggleton JP, editor. The amygdala, Oxford University Press (Oxford), 2000: 31-115.

  28. Schoenbaum G, Setlow B, Saddoris M, Gallagher M. “Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala”. Neuron 2003; 39: 855-867.

  29. Fernández-Espejo E. “¿Cómo funciona el nucleus accumbens?” Rev Neurol 2000; 30(9): 845-849.

  30. Parkinson JA, Olmsted MC, Burns L, Robbins TW, Everitt BJ. “Disassociation in effect of lesions of the nucleus accumbens core and shell on appetitive pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine”. J Neurosci 1999; 19: 2401-2411.

  31. Zald DH, Won-Kim S. “The orbitofrontal cortex”. In: Sallowey SP, editor. The frontal lobes and neuropsychiatry illness. American Psychiatric Publishing (New York), 2001: 33-69.

  32. Sokolowski JD, Salamone J. “The role of accumbens dopamine in lever pressing and response allocation: effects of 6-OHDA injected into core and dorsomedial shell”. Pharm Biochem Behav 1996; 59: 557-566.

  33. Hasselmo M. “A model of prefrontal cortical mechanisms for goal directed behavior”. J Cog Neurosci 2005; 17(7): 1115-1119.




2020     |     www.medigraphic.com