Psychology
The Effects of Unisensory vs. Multisensory Stimuli on Memory for Specific Visual Details
Document Type
Oral Presentation
Location
Indianapolis, IN
Subject Area
Psychology
Start Date
11-4-2014 10:15 AM
End Date
11-4-2014 12:00 PM
Sponsor
Andrew Butler (Butler University)
Description
Our experiment explored how multisensory stimuli potentially modulate subsequent general and specific visual memory. Participants viewed unisensory and multisensory stimuli and later performed a recognition and free recall test. We hypothesized that multisensory audiovisual learning would modulate specific long-term recognition of relatively complex visual information. Previous research shows that multisensory learning can result in better recognition of simple visual information than unisensory information across relatively short spans of time (Murray et al., 2004) and can impact subsequent neural processing (Butler & James, 2011). We wanted to extend this work by testing the impact of audiovisual experience on long-term recognition of more complex stimuli. We created a two-phase, within subjects experiment. In the first phase participants were presented with visual stimuli paired with a congruent sound (AV Congruent), a simple tone (AV Control), or no sound at all (V). Shortly after, participants were given the second phase in which they were shown same, similar, and new items to those shown during encoding and responded with a same, similar, or new response (as in Kensinger, Garoff-Eaton, Schacter, 2006). We measured memory accuracy by response type, reaction time, and confidence. Participants were later given a final free recall test. We performed a Two-Way Repeated Measures ANOVA including the variables learning type (visual, audiovisual congruent, audiovisual control) and recognition type (specific, general). This analysis showed a main effect of modality type (F(2, 68) = 4.434, p = .015). Overall, learning audiovisual congruent stimuli enhanced memory over other types of learning. There was also a main effect of recognition type (F(1, 34) = 11.91, p = .002). This showed that general recognition was greater than specific recognition. There was not a significant interaction between these two factors. The results of the current study suggest that multisensory experience modulates long-term memory for relatively complex visual information.
The Effects of Unisensory vs. Multisensory Stimuli on Memory for Specific Visual Details
Indianapolis, IN
Our experiment explored how multisensory stimuli potentially modulate subsequent general and specific visual memory. Participants viewed unisensory and multisensory stimuli and later performed a recognition and free recall test. We hypothesized that multisensory audiovisual learning would modulate specific long-term recognition of relatively complex visual information. Previous research shows that multisensory learning can result in better recognition of simple visual information than unisensory information across relatively short spans of time (Murray et al., 2004) and can impact subsequent neural processing (Butler & James, 2011). We wanted to extend this work by testing the impact of audiovisual experience on long-term recognition of more complex stimuli. We created a two-phase, within subjects experiment. In the first phase participants were presented with visual stimuli paired with a congruent sound (AV Congruent), a simple tone (AV Control), or no sound at all (V). Shortly after, participants were given the second phase in which they were shown same, similar, and new items to those shown during encoding and responded with a same, similar, or new response (as in Kensinger, Garoff-Eaton, Schacter, 2006). We measured memory accuracy by response type, reaction time, and confidence. Participants were later given a final free recall test. We performed a Two-Way Repeated Measures ANOVA including the variables learning type (visual, audiovisual congruent, audiovisual control) and recognition type (specific, general). This analysis showed a main effect of modality type (F(2, 68) = 4.434, p = .015). Overall, learning audiovisual congruent stimuli enhanced memory over other types of learning. There was also a main effect of recognition type (F(1, 34) = 11.91, p = .002). This showed that general recognition was greater than specific recognition. There was not a significant interaction between these two factors. The results of the current study suggest that multisensory experience modulates long-term memory for relatively complex visual information.