MULTIPLE REINFORCEMENT SCHEDULE

Multiple Reinforcement Schedule

Primary Disciplinary Field(s): Psychology (Behaviorism, Learning Theory, Experimental Analysis of Behavior)

1. Core Definition

The Multiple Reinforcement Schedule represents a complex arrangement in the field of operant conditioning, designed to study the precise control that external stimuli exert over learned behavior. At its core, a multiple reinforcement schedule involves the presentation of two or more independent, simple schedules of reinforcement (such as Fixed Ratio, Variable Interval, etc.) that alternate sequentially over time. Crucially, each simple schedule component is associated with a unique, discernible external cue, known as an exteroceptive stimulus or discriminative stimulus (S^D). The organism—the participant in the experiment, whether animal or human—must learn to differentiate between these stimuli, as each S^D signals the specific reinforcement contingencies currently in effect. The behavioral requirements necessary to obtain reinforcement change completely when the exteroceptive stimulus changes, compelling the subject to adjust its response rate accordingly.

Unlike concurrent schedules, where two schedules are available simultaneously and the subject can choose between them, the multiple schedule is characterized by its distinct, temporal segmentation. Only one schedule is active at any given moment, and the transition between these active components is strictly controlled by the experimenter. The purpose of this arrangement is twofold: first, to establish strong stimulus control over the behavior, ensuring that responding occurs primarily when the correct signal is present; and second, to facilitate the examination of interaction effects between the components, particularly phenomena like behavioral contrast. This rigorous experimental setup allows researchers to isolate the effects of specific environmental cues on the predictability and maintenance of an operant response, thereby emphasizing the effect of certain stimuli on participants when the results are compared against baseline or control conditions.

2. Theoretical Background: Schedules of Reinforcement

The understanding of the Multiple Reinforcement Schedule rests firmly on the foundational work of B.F. Skinner and the development of the schedules of reinforcement paradigm. Simple schedules—Fixed Ratio (FR), Variable Ratio (VR), Fixed Interval (FI), and Variable Interval (VI)—demonstrated that the frequency and pattern of reinforcement delivery are powerful determinants of the rate and persistence of operant behavior. For instance, ratio schedules produce higher response rates than interval schedules, and variable schedules produce more consistent responding than fixed schedules. However, simple schedules operate under a single, unchanging set of environmental conditions.

Complex schedules, including the multiple schedule, were developed to move beyond these basic findings and explore the nuances of stimulus control. The theoretical jump involves recognizing that behavior is not just controlled by the consequence (reinforcer) but also by the antecedent conditions (discriminative stimuli) present when the consequence occurs. By pairing a specific S^D (e.g., a green light) with one schedule (e.g., VR-10) and a different S^D (e.g., a red light) with another schedule (e.g., FI-60s), the multiple schedule effectively creates two distinct psychological environments within the same experimental session. This methodology permits researchers to investigate how an organism integrates information regarding timing, quantity, and effort requirements based solely on the immediate, observable environmental cues.

This approach is particularly valuable because it allows for the examination of behavior under one set of conditions (Schedule A) to be analyzed while the organism is simultaneously experiencing training under a fundamentally different set of conditions (Schedule B). Since the schedules are presented alternately but independently, changes introduced to Schedule A can be observed to exert subtle, indirect effects on the responding during Schedule B, even though Schedule B’s parameters remain constant. This interdependence, even when the schedules are temporally separated, highlights the systemic nature of learned behavior and the importance of contextual cues in maintaining behavioral equilibrium, forming a critical area of study in the experimental analysis of behavior.

3. Key Characteristics

The structure of the Multiple Reinforcement Schedule mandates several defining operational characteristics that distinguish it from other complex schedules, such as chained or tandem schedules. These characteristics ensure that the behavior observed is purely a function of the distinct stimulus control exerted by the accompanying environmental cues.

• Discrete, Alternating Components: The schedule consists of two or more simple schedules presented one after the other in a repeating sequence (e.g., A then B then A then B). Crucially, the simple schedules are entirely independent of one another; the response requirements in Component A do not affect the reinforcement availability in Component B, and vice versa.
• Unique Exteroceptive Stimuli (S^D): Each component schedule is consistently paired with a unique, external, and highly discernible stimulus. This stimulus acts as the signal (S^D) indicating which specific reinforcement contingency is currently active. For instance, a pigeon might peck a key only when the key is green (signaling a VI schedule) and suppress pecking when the key is red (signaling an extinction schedule).
• Independence of Reinforcement Delivery: Reinforcers earned during one component are delivered and counted entirely within that component. They do not carry over or influence the mechanics of the subsequent component, maintaining the purity of the experimental manipulation within each segment.
• Absence of Response Linkage: Unlike chained schedules, where the completion of one component’s requirement acts as the conditioned reinforcer for the next component, there is no response dependency between the segments of a multiple schedule. Behavior must be maintained independently in each signaled environment.

4. Operational Mechanics

Implementing a Multiple Reinforcement Schedule requires precise experimental control over time, stimuli, and consequences. The process typically begins with the establishment of strong baseline responding under each simple schedule individually, followed by the introduction of the alternating sequence once the discriminative stimuli are firmly paired with their respective contingencies.

In a typical experimental setting, perhaps utilizing a rat in a Skinner box, Component 1 might be associated with a steady tone (S^D1) and a Variable Interval (VI) 30-second schedule. Component 2 might be associated with a flashing light (S^D2) and a Fixed Ratio (FR) 10 schedule. The session would proceed by cycling through these components, often separated by a brief inter-component interval (ICI) or “time out” period where neither stimulus is present and no reinforcement is available. This ICI serves to accentuate the distinct boundaries between the scheduled segments, reinforcing the discriminatory power of the S^D.

The effectiveness of the multiple schedule hinges on the organism’s ability to develop stimulus control—that is, the differential responding required by the schedule. The subject must learn to produce the high, steady rates characteristic of the FR schedule only when the flashing light is present, and the moderate, consistent rates characteristic of the VI schedule only when the steady tone is present. If the subject responds similarly in both components, it indicates a failure to establish strong stimulus control or that the exteroceptive stimuli are not salient enough to act as effective S^Ds. Researchers monitor the differential response rates across components to determine the clarity and power of the stimulus control exerted by the environmental cues.

5. Experimental Significance

The primary experimental importance of the multiple reinforcement schedule lies in its capacity to rigorously test and demonstrate the phenomenon of behavioral contrast, a critical concept in the study of motivation and emotion in conditioning. Behavioral contrast occurs when a change in the schedule of reinforcement in one component produces an inverse change in the rate of response in the other component, despite the fact that the second component’s schedule remains entirely unchanged.

This phenomenon is often categorized into two types: positive contrast and negative contrast. Positive behavioral contrast occurs when the rate of reinforcement in Component A is reduced (e.g., changed from VI-30s to Extinction), leading to an increase in responding during Component B, even though Component B’s reinforcement parameters (e.g., VI-60s) are held constant. Conversely, negative behavioral contrast occurs if the rate of reinforcement in Component A is increased, resulting in a reduction of responding in the unchanged Component B. These results emphasize that the perceived value of the reinforcement in one context is relative to the reinforcement available in the immediately surrounding context. The organism is evaluating the schedule not in absolute terms, but in relation to the alternatives presented during the overall session.

Behavioral contrast provides compelling evidence that an organism’s behavior is often dictated by the historical context of reinforcement and the comparison between current and recent past conditions. By using the multiple schedule, researchers can isolate these contextual effects, demonstrating how environmental predictability (or lack thereof) influences effort and motivation. Furthermore, the schedule is essential for differentiating between pure stimulus discrimination and other processes, such as generalization. When strong stimulus control is established, the subject’s response pattern should immediately shift upon the presentation of the new S^D, indicating that the organism has effectively learned which stimulus predicts which outcome.

6. Applications in Applied Behavior Analysis (ABA)

While highly complex and often studied in laboratory settings, the principles derived from the multiple reinforcement schedule have significant applications in Applied Behavior Analysis (ABA), particularly in developing complex discrimination training and understanding problematic behaviors. In clinical and educational settings, the schedule’s structure is often mirrored when teaching individuals to differentiate between appropriate social cues or instructional settings.

For instance, a therapeutic setting may use a differential reinforcement strategy where a child is expected to produce a high-effort response (Component A) only when a specific adult is present (S^D1), and a low-effort response (Component B) when a different adult is present (S^D2). This mimics the multiple schedule’s requirement for behavior to be under the precise control of distinct exteroceptive stimuli. Understanding how behavioral contrast works also informs interventions. If a behavior specialist reduces attention (reinforcement) for a challenging behavior in one context (e.g., the classroom), the theory of behavioral contrast predicts that the challenging behavior might temporarily increase in an untreated context (e.g., the home), necessitating proactive measures to manage this spillover effect.

The structure of the multiple schedule is also conceptually similar to certain functional analysis procedures used to identify the maintaining variables for problem behavior. By cycling through different environmental conditions—each associated with a hypothesized function of the behavior (e.g., attention, escape, tangible)—and pairing these conditions with clear antecedent cues, analysts can determine which environmental stimuli trigger and maintain the problem response, thus creating a functionally relevant version of the multiple schedule to guide intervention planning.

7. Debates and Criticisms

Despite its utility in demonstrating stimulus control and behavioral contrast, the multiple reinforcement schedule is subject to several theoretical and methodological criticisms, primarily revolving around the generalizability of its findings and the complexity of interpretation.

One major debate centers on the exact mechanism underlying behavioral contrast. While the standard interpretation suggests that contrast is a motivational or emotional phenomenon resulting from the comparison of reinforcement rates, alternative explanations, such as the induction of emotional states or internal time-sharing processes, have been proposed. Furthermore, some critics argue that the highly artificial and controlled nature of the laboratory multiple schedule—with its fixed, clear component boundaries and non-overlapping stimuli—does not adequately reflect the complexity and ambiguity of natural environments, where stimuli often overlap and contingencies change subtly over time. Therefore, the applicability of phenomena like dramatic behavioral contrast to real-world learning scenarios may be limited.

Methodological challenges also arise, particularly the risk of sequencing effects. If the order of the schedules (A-B-A-B) is too predictable or consistent, the behavior observed in Component B might be influenced more by the preceding experience in Component A than by the S^D associated with B itself. This necessitates careful counterbalancing of the presentation order or the use of randomized sequences, adding layers of experimental complexity. Isolating the effects of the discriminative stimulus from other potential temporal cues or adventitious reinforcement remains a persistent challenge in research utilizing the multiple reinforcement schedule.

8. Further Reading

• Operant Conditioning and Schedules of Reinforcement
• B. F. Skinner: Theory and Research
• Studies of Behavioral Contrast in Reinforcement Schedules
• Introduction to Applied Behavior Analysis (ABA)