PHILADELPHIA – The human brain’s sensitivity to unexpected outcomes plays a fundamental role in the ability to adapt and learn new behaviors, according to a new study by a team of psychologists and neuroscientists from the University of Pennsylvania.
Using a computer-based card game and microelectrodes to observe neuronal activity of the brain, the Penn study, published this week in the journal Science, suggests that neurons in the human substantia nigra, or SN, play a central role in reward-based learning, modulating learning based on the discrepancy between the expected and the realized outcome.
“This is the first study to directly record neural activity underlying this learning process in humans, confirming the hypothesized role of the basal ganglia, which includes the SN, in models of reinforcement including learning, addiction and other disorders involving reward-seeking behavior,” said lead author Kareem Zaghloul, MD, PhD, postdoctoral fellow in neurosurgery at Penn. “By responding to unexpected financial rewards, these cells encode information that seems to help participants maximize reward in the probabilistic learning task.”
Learning, previously studied in animal models, seems to occur when dopaminergic neurons, which drive a larger basal ganglia circuit, are activated in response to unexpected rewards and depressed after the unexpected omission of reward. Put simply, a lucky win seems to be retained better than a probable loss.
“Similar to economic theory, where efficient markets respond to unexpected events and expected events have no effect, we found that the dopaminergic system of the human brain seems to be wired in a similar rational manner; tuned to learn whenever anything unexpected happens but not when things are predictable," said Michael J. Kahana, PhD, senior author and professor of psychology at Penn.
Dr. Zaghloul worked with Michael J. Kahana and Gordon Baltuch, MD, PhD, associate professor of neurosurgery, in a unique collaboration among Psychology, Neurosurgery, and Bioengineering researchers. They used microelectrode recordings obtained during deep brain stimulation surgery of Parkinson’s patients to study neuronal activity in the SN, the midbrain structure that plays an important role in movement, as well as reward and addiction. Patients with Parkinson’s disease show impaired learning from both positive and negative feedback in cognitive tasks due to the degenerative nature of their disease and the decreased number of dopaminergic neurons.
The recordings were analyzed to determine whether responses were affected by reward expectation. Participants were asked to choose between a red and blue deck of cards presented on a computer screen, one of which carried a higher probability of yielding a financial reward than the other. If the draw of a card yielded a reward, a stack of gold coins was displayed along with an audible ring of a cash register and a counter showing accumulated virtual earnings. If the draw did not yield a reward or if no choice was made, the screen turned blank and participants heard a buzz.
“This new way to measure dopaminergic neuron activity has helped us gain a greater understanding of fundamental cognitive activity," said Dr. Baltuch, director of the Penn Medicine Center for Functional and Restorative Neurosurgery.
The work is supported by grants from the National Institutes of Health, the Conte Center and the Dana Foundation.
###
PENN Medicine is a $3.6 billion enterprise dedicated to the related missions of medical education, biomedical research, and excellence in patient care. PENN Medicine consists of the University of Pennsylvania School of Medicine (founded in 1765 as the nation's first medical school) and the University of Pennsylvania Health System.
Penn's School of Medicine is currently ranked #4 in the nation in U.S.News & World Report's survey of top research-oriented medical schools; and, according to most recent data from the National Institutes of Health, received over $379 million in NIH research funds in the 2006 fiscal year. Supporting 1,700 fulltime faculty and 700 students, the School of Medicine is recognized worldwide for its superior education and training of the next generation of physician-scientists and leaders of academic medicine.
The University of Pennsylvania Health System (UPHS) includes its flagship hospital, the Hospital of the University of Pennsylvania, rated one of the nation’s top ten “Honor Roll” hospitals by U.S.News & World Report; Pennsylvania Hospital, the nation's first hospital; and Penn Presbyterian Medical Center. In addition UPHS includes a primary-care provider network; a faculty practice plan; home care, hospice, and nursing home; three multispecialty satellite facilities; as well as the Penn Medicine Rittenhouse campus, which offers comprehensive inpatient rehabilitation facilities and outpatient services in multiple specialties.
Penn Medicine is one of the world’s leading academic medical centers, dedicated to the related missions of medical education, biomedical research, excellence in patient care, and community service. The organization consists of the University of Pennsylvania Health System and Penn’s Raymond and Ruth Perelman School of Medicine, founded in 1765 as the nation’s first medical school.
The Perelman School of Medicine is consistently among the nation's top recipients of funding from the National Institutes of Health, with $550 million awarded in the 2022 fiscal year. Home to a proud history of “firsts” in medicine, Penn Medicine teams have pioneered discoveries and innovations that have shaped modern medicine, including recent breakthroughs such as CAR T cell therapy for cancer and the mRNA technology used in COVID-19 vaccines.
The University of Pennsylvania Health System’s patient care facilities stretch from the Susquehanna River in Pennsylvania to the New Jersey shore. These include the Hospital of the University of Pennsylvania, Penn Presbyterian Medical Center, Chester County Hospital, Lancaster General Health, Penn Medicine Princeton Health, and Pennsylvania Hospital—the nation’s first hospital, founded in 1751. Additional facilities and enterprises include Good Shepherd Penn Partners, Penn Medicine at Home, Lancaster Behavioral Health Hospital, and Princeton House Behavioral Health, among others.
Penn Medicine is an $11.1 billion enterprise powered by more than 49,000 talented faculty and staff.