Probabilistic choice: A simple invariance.
Repository Usage Stats
When subjects must choose repeatedly between two or more alternatives, each of which dispenses reward on a probabilistic basis (two-armed bandit ), their behavior is guided by the two possible outcomes, reward and nonreward. The simplest stochastic choice rule is that the probability of choosing an alternative increases following a reward and decreases following a nonreward (reward following ). We show experimentally and theoretically that animal subjects behave as if the absolute magnitudes of the changes in choice probability caused by reward and nonreward do not depend on the response which produced the reward or nonreward (source independence ), and that the effects of reward and nonreward are in constant ratio under fixed conditions (effect-ratio invariance )--properties that fit the definition of satisficing . Our experimental results are either not predicted by, or are inconsistent with, other theories of free-operant choice such as Bush-Mosteller, molar maximization, momentary maximizing, and melioration (matching).
Published Version (Please cite this version)10.1016/0376-6357(87)90034-9
Publication InfoHorner, JM; & Staddon, JE (1987). Probabilistic choice: A simple invariance. Behav Processes, 15(1). pp. 59-92. 10.1016/0376-6357(87)90034-9. Retrieved from https://hdl.handle.net/10161/3231.
This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.
More InfoShow full item record
James B. Duke Distinguished Professor Emeritus of Psychology and Neuroscience
Until my retirement in 2007, my laboratory did experimental research on learning and adaptive behavior, mostly with animals: pigeons, rats, fish, parakeets. We were particularly interested in timing and memory, feeding regulation, habituation and the ways in which pigeons and rats adapt to reward schedules. The aim is to arrive at simple models for learning that can help to identify the underlying neural mechanisms. I continue to do theoretical and historical work on the power law in