knowt logo

Advanced Operant Conditioning Procedures

  • Theories of Reinforcement

    • drive reduction theory: event is reinforcing to the extent that it is associated with reduction in physiological drive

      • hunger, thirst, homeostatic body temp, etc

      • we want to engage in behaviors that reduce tension

      • most theorists no longer believe that drive reduction theory is a comprehensive theory

    • incentive motivation: derived from property of reinforcer v internal drive state (getting paid, getting a grade, playing a video game for fun)

    • premack principle

      • emphasizes observable behavior patterns v hypothetical internal processes

      • more objective way to determine whether something can be used as a reinforcer

      • reinforcers viewed as behaviors rather than stimuli

        • behavior being reinforced

        • behavior reinforcer

      • high-probability behavior can be used to reinforce low-prob behavior

        • first you work, then you play

    • response deprivation hypothesis: behavior can serve as reinforcer when access to the behavior is restricted and frequency falls below preferred level of occurrence

      • can’t do X at all until you’ve done Y

    • behavioral bliss approach: organism w free access to multiple activities will distribute its behavior to maximize overall reinforcement

      • will never reach behavioral bliss point but will structure life around reaching it

  • shaping: gradual creation of new behavior through reinforcement of successive approximations

  • positive reinforcement: further distinctions

    • more immediate reinforcer ➝ stronger its effect on the behavior

    • primary / unconditioned reinforcer ➝ innately reinforcing (food, water)

    • secondary / conditioned reinforcer ➝ reinforcing event because associated with other reinforcer (nice clothes, good grades)

    • generalized / generalized second reinforcer ➝ reinforcing bc associated with several other reinforcers (ex: money)

  • intrinsic and extrinsic reinforcement

    • intrinsic reinforcement - provided by mere act of performing behavior

    • extrinsic reinforcement - provided by some external consequence

    • extrinsic rewards usually have little or no effect on intrinsic motivation

    • rewards can undermine intrinsic motivation when

      • reward is expected

      • reward is tangible

      • reward is given for performing the activity and not for how well its performed

  • natural and contrived rewards

    • natural reinforcers: typically provided for a certain behavior, expected consequence of the behavior within that setting

      • ex: money for working

    • contrived / artificial reinforcers: deliberately arranged to modify a behavior. not a typical consequence of the behavior within that setting

    • natural reinforcers are more efficient

Advanced Operant Conditioning Procedures

  • Theories of Reinforcement

    • drive reduction theory: event is reinforcing to the extent that it is associated with reduction in physiological drive

      • hunger, thirst, homeostatic body temp, etc

      • we want to engage in behaviors that reduce tension

      • most theorists no longer believe that drive reduction theory is a comprehensive theory

    • incentive motivation: derived from property of reinforcer v internal drive state (getting paid, getting a grade, playing a video game for fun)

    • premack principle

      • emphasizes observable behavior patterns v hypothetical internal processes

      • more objective way to determine whether something can be used as a reinforcer

      • reinforcers viewed as behaviors rather than stimuli

        • behavior being reinforced

        • behavior reinforcer

      • high-probability behavior can be used to reinforce low-prob behavior

        • first you work, then you play

    • response deprivation hypothesis: behavior can serve as reinforcer when access to the behavior is restricted and frequency falls below preferred level of occurrence

      • can’t do X at all until you’ve done Y

    • behavioral bliss approach: organism w free access to multiple activities will distribute its behavior to maximize overall reinforcement

      • will never reach behavioral bliss point but will structure life around reaching it

  • shaping: gradual creation of new behavior through reinforcement of successive approximations

  • positive reinforcement: further distinctions

    • more immediate reinforcer ➝ stronger its effect on the behavior

    • primary / unconditioned reinforcer ➝ innately reinforcing (food, water)

    • secondary / conditioned reinforcer ➝ reinforcing event because associated with other reinforcer (nice clothes, good grades)

    • generalized / generalized second reinforcer ➝ reinforcing bc associated with several other reinforcers (ex: money)

  • intrinsic and extrinsic reinforcement

    • intrinsic reinforcement - provided by mere act of performing behavior

    • extrinsic reinforcement - provided by some external consequence

    • extrinsic rewards usually have little or no effect on intrinsic motivation

    • rewards can undermine intrinsic motivation when

      • reward is expected

      • reward is tangible

      • reward is given for performing the activity and not for how well its performed

  • natural and contrived rewards

    • natural reinforcers: typically provided for a certain behavior, expected consequence of the behavior within that setting

      • ex: money for working

    • contrived / artificial reinforcers: deliberately arranged to modify a behavior. not a typical consequence of the behavior within that setting

    • natural reinforcers are more efficient

robot