Behavioral Science Dictionary

Operant conditioning

Also known as: Instrumental conditioning

Cognition & Dual-Process

Behavior is shaped by its consequences — reinforcement strengthens it, punishment weakens it.

What it means

Operant conditioning is a form of learning in which the frequency of a voluntary behavior changes according to its consequences: reinforcement makes the behavior more likely to recur, while punishment makes it less likely. Building on Thorndike's law of effect, Skinner showed that consequences can be arranged as positive or negative reinforcement and positive or negative punishment, and that the timing and pattern of consequences — the schedule of reinforcement — matters enormously. Schedules are the key mechanism: continuous reinforcement establishes a behavior quickly but extinguishes quickly, whereas intermittent and especially variable-ratio schedules produce behavior that is highly persistent and resistant to extinction, which is exactly why slot machines and notification-driven apps are so compelling. Shaping, in which successive approximations to a target behavior are reinforced, allows complex behavior to be built up step by step. Operant principles differ from classical conditioning, which links stimuli to involuntary responses rather than tying voluntary actions to outcomes. It matters because schedules of reinforcement explain habit formation, addiction, gamification, and the design of incentive systems across education, work, and product design.

Examples

Slot machines hook players with unpredictable, variable-ratio payouts that keep the lever-pulling going long after losses mount.

A toddler learns that whining in the supermarket sometimes — not always — produces sweets. That unpredictable payoff makes the whining far harder to stamp out than if it had worked every single time.

A trainer rewards the puppy first for glancing at the mat, then for stepping on it, then for lying down. Complex behaviour gets built from crumbs, one approximation at a time.

First described in Thorndike's law of effect; B. F. Skinner.

← All 1001 terms