Learning-related improvements in auditory detection sensitivities correlate with neural changes observable during active and passive sound processing Natalie J. Ball, Matthew G. Wisniewski, Alexandria C. Zakrzewski, Nandini Iyer, Brian D. Simpson, Amanda Seccia, Eric R. Thompson, and Nathan Spencer
Citation: Proc. Mtgs. Acoust. 30, 050012 (2017); doi: 10.1121/2.0000630 View online: https://doi.org/10.1121/2.0000630 View Table of Contents: http://asa.scitation.org/toc/pma/30/1 Published by the Acoustical Society of America
Articles you may be interested in Discussion of paper by Z. Zhang, C. Huang, R. A. Weiss, and Quan Chen, entitled ‘Association energy in strongly associative polymers’ Journal of Rheology 61, 1209 (2017); 10.1122/1.5008872 1.3 µm single-photon emission from strain-coupled bilayer of InAs/GaAs quantum dots at the temperature up to 120 K Applied Physics Letters 111, 182102 (2017); 10.1063/1.5010049 Learning-related improvements in auditory detection sensitivities correlate with changes in sensory- and decision-related components of the event-related potential The Journal of the Acoustical Society of America 141, 3899 (2017); 10.1121/1.4988768 Individual differences in cocktail party listening: The relative role of decision weights and internal noise Proceedings of Meetings on Acoustics 30, 050010 (2017); 10.1121/2.0000627
Volume 30
http://acousticalsociety.org/
Acoustics `17 Boston 173rd Meeting of Acoustical Society of America and 8th Forum Acusticum Boston, Massachusetts 25-29 June 2017
Psychological and Physiological Acoustics: Paper 4pPPc28
Learning-related improvements in auditory detection sensitivities correlate with neural changes observable during active and passive sound processing Natalie J. Ball
Psychology, University at Buffalo, The State University of New York, Buffalo, NY, 14260;
[email protected]
Matthew G. Wisniewski
U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, Dayton, OH;
[email protected]
Alexandria C. Zakrzewski
University of Richmond, Richmond, VA;
[email protected]
Nandini Iyer and Brian D. Simpson
U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, Dayton, OH;
[email protected],
[email protected]
Amanda Seccia
University at Buffalo, The State University of New York, Buffalo, NY, 14260;
[email protected]
Eric R. Thompson and Nathan Spencer
U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, Dayton, OH;
[email protected],
[email protected] Auditory detection can improve with training. Though the majority of theorists posit that such improvements relate to dynamics of selective attention, longer-term sensory plasticity may also play a role (e.g., increased cortical processing for trained sounds). Here, listeners were trained in a single session to detect either an 861-Hz or 1058-Hz tone (counterbalanced across participants) presented in a frozen white noise masker. On the following day, EEG was collected while listeners: 1) attempted to detect 861-Hz and 1058-Hz tones at an SNR of -21 dB, and 2) passively heard the same tones presented in quiet. Listeners were significantly better at detecting tones at their trained frequency. In addition, P3 amplitudes were larger for trained than for untrained tones during the active detection task. During passive exposure to the same tones, P2 amplitudes were similarly larger for trained than for untrained tones. The difference in P3 amplitudes suggests that training leads to more efficient post-sensory processing related to decision-making. Differences in P2 amplitudes may reflect training-induced sensory cortical plasticity. Further, since the P2 effect was obtained during passive exposure, training induced improvements in detection may not be solely related to attention.
Published by the Acoustical Society of America © 2017 Acoustical Society of America. https://doi.org/10.1121/2.0000630 Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
Page 1
N. J. Ball et al.
Learning-related improvements in auditory detection sensitivities correlate with neural changes
Introduction Experience can alter performances in a number of different listening tasks (for review, see Wright & Zhang1). For instance, practice can improve detection thresholds,2,3 increase sensitivities to differences between simple4 and complex sounds5, and alter spatial acuities (for review, see Wright & Zhang6). Given the variety of tasks that show this perceptual learning, it is perhaps unsurprising that the processes behind experience-related changes in perception have been hotly debated (for review, see Wisniewski, Radell, Church, & Mercado7). Explanations vary between selective attention views (i.e., learners determine the correct features to attend),8 and views that posit relatively long-term changes to sensory representations and their read-out connections.9-11 Explanations of experience-related changes in auditory detection have been weighted heavily towards the selective attention position. For instance, Zwislocki, Marie, Feldman, and Rubin2 ascribed reduced attention as a “fairly straightforward” (p. 256) reason for decrements in detection threshold, and motivation as key to improving it. Tanner and Norman12 had listeners detect a 1000-Hz tone in noise in a 4I-4AFC task for hundreds of trials in which listeners were approximately 65% correct. When the frequency of the tone was changed to 1300 Hz, performance was brought down to chance (~25% correct). Performance promptly rose after subjects were informed of the frequency change, presumably because they recalibrated their attention. In another classic study, Greenberg and Larkin13 setup expectation of a tone at 1100-Hz by presenting initial trials using tones at 1100 Hz. In the following experimental blocks, probe stimuli at different frequencies were presented on 23% of trials. The detection probability of tones in noise at 1100Hz was relatively high compared to the detection of tones higher (>1200-Hz) or lower ( .20. In contrast, there appeared to be an effect of training on the P2 amplitude, with trained frequencies evoking larger P2 amplitude than untrained frequencies. The mean amplitudes for P2 for trained and untrained frequencies were M = 0.77 μV (SD = 0.77) and M = 0.53 μV (SD = 0.62) respectively. The difference in P2 amplitudes did reach significance, p = .03.
Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
Page 5
N. J. Ball et al.
Learning-related improvements in auditory detection sensitivities correlate with neural changes
Figure 3. Passive ERP Results. (a) ERPs at the central and parietal electrode clusters during the passive portion of the experiment. N1 and P2 components are labeled. The dotted vertical line depicts tone onset (b) Scalp maps showing mean voltage within the designated N1 time window. (c) Scalp maps showing mean voltage within the designated P2 time window.
ERP Data – Active Figure 4a depicts ERPs in the active portion of the experiment. Components N1, P2, and P3 are labeled. Mean N1 amplitudes for the trained and untrained frequencies were M = -0.92 μV (SD = 1.12) and M = -0.83 μV (SD = 1.45) respectively. As in the passive portion of the experiment, the N1 showed no significant difference in amplitude between the trained and untrained frequencies, p > .20. The P2 was larger for the trained (M = 1.58 μV, SD = 1.49) than the untrained (M = 0.48 μV, SD = 1.15) frequency. This difference was significant, p = .01. In addition, the P3 was larger for the trained (M = 3.22 μV, SD = 2.23) compared to the untrained (M = 2.02 μV, SD = 2.13) frequency. This difference also reached significance, p < .001.
Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
Page 6
N. J. Ball et al.
Learning-related improvements in auditory detection sensitivities correlate with neural changes
*
**
Figure 4. Active ERP Results. (a) ERPs from the active part of the experiment at central and parietal electrode clusters for both the trained (solid lines) and untrained (dashed lines) frequencies. The dotted vertical line depicts tone onset. Scalp maps of N1 (b), P2 (c), and P3 (d) components are also shown.
Discussion In the present study, we compared ERPs for trained and untrained tone frequencies under active and passive listening protocols. During active listening, participants were tasked with detecting tones in noise at a previously trained or untrained frequency. These same tones were presented in silence under a passive protocol with no associated task other than to ignore sounds. Debate over why humans show frequency-specific learning effects for detection, spurred the use of these separate protocols. Selective attention explanations predict differences between trained and untrained tones during active listening, but not during passive exposure to the same sounds (i.e., when top-down selective attention is not being utilized). In contrast, explanations that are based in relatively long-term changes in stimulus processing, predict differences between trained and untrained frequencies under both active and passive listening protocols. Essentially, by comparing ERPs to trained and untrained tone frequencies in these two tasks, we were able to look at processing-related differences during attentive and non-attentive listening states. Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
Page 7
N. J. Ball et al.
Learning-related improvements in auditory detection sensitivities correlate with neural changes
Participants showed the expected detection advantage for the tone frequency they were trained with. There were paralleling effects in ERPs obtained during both active and passive portions of the experiment. For passive ERPs, the trained frequency elicited a larger P2 amplitude than the untrained frequency. For active ERPs, larger amplitude P2 and P3 components were observed for the trained frequency. The ERPs indicate effects of learning at multiple processing stages. Specifically, an exogenous (sensorial) component of the auditory ERP (the P2) and a later endogenous (cognitively generated) P3, are both enhanced for a trained relative to an untrained frequency. The effect observed for P2 further suggests that learning may not be exclusively related to selective attention, because effects of learning are observable even under a passive protocol. Studies of discrimination learning have similarly shown increased P2 amplitudes for trained stimuli under passive protocols.15,24 These learning effects found in P2 have been taken to indicate that P2 amplitude changes reflect changes in sensorial processing or the neural processes associated with acquisition.29 Tong and colleagues15 also suggest that P2 may regulate access to representations that would elicit P3 working memory processes during active tasks. For example, repeated exposure to target stimuli during training may increase their salience in working memory, increasing awareness to them in subsequent active tasks. While P2 may reflect perceptual discrimination accuracy, it has also been suggested to be an indicator of familiarity.30 Familiarity is essentially induced by learning, so this does not contradict our present findings. Though much of the P2 literature has been derived from discrimination work, to our knowledge we are the first to show parallel P2 effects with detection learning. As in the active detection portion of our study, increases in P3 have paralleled learning in discrimination studies.15,24 The P3 seems to be prominent in actively attending auditory tasks, going beyond initial sensory processing. With the detection of a change in stimuli (not restricted to audition), P3 may reflect context updating involving comparison of new stimuli with those previously experienced and stored in working memory.31 The P3 may represent the efficiency of post-perceptual processing related to decision-making,32 categorization,33,34 and certainty regarding the decision.35 Regardless, it reflects some higher than sensory cognitive process. Increases in P3 amplitude for trained tones demonstrate changes associated with learning outside the auditory system itself. That is to say, the trained tones elicit further processing, and while the specific kind of processing cannot be determined from this experiment, it is notable that the trained stimulus surpasses sensory processing alone. One important caveat to this work has to do with our assumption that selective attention was not being utilized in the passive protocol. Though participants were instructed to “ignore the sounds”, we cannot definitively say that participants avoided paying attention to the trained frequency. It is noteworthy that we observed no differences between trained and untrained frequencies for the N1. This is a component often associated with auditory selective attention.36,37 Even so, it may be more convincing if the same result holds when attention is diverted from the sounds. This could be accomplished by giving participants a distracting task of sufficient difficulty in future work (e.g., an attention-demanding visual search task). Conclusion This study suggests that there are ERP correlates of learning in auditory detection at several stages of processing. Effects on the P2 component suggests that learning produces stimulus processing changes that are not related to active selective attention. Learning correlates also exist in post-sensory processing (as indexed by the P3). Detection learning may not be solely attributed to selective attention, as some have suggested. Instead, learning likely relies on both long-term sensory processing changes and attentional biases. Future work should examine both mechanisms in order to understand the improvements in auditory detection.
Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
Page 8
N. J. Ball et al.
Learning-related improvements in auditory detection sensitivities correlate with neural changes
References Wright BA, & Zhang Y. Insights into human auditory processing gained from perceptual learning. In MS Gazzaniga, E Bizzi, LM Chalupa, ST Grafton, TF Heatherton, C Koch… BA Wandell (Eds.) The cognitive neurosciences, 4th ed (pp. 353-365). Cambridge, MA, US: Massachusetts Institute of Technology, 2009.
1
2
Zwislocki J, Marie F, Feldman AS, & Rubin H. On the effect of practice and motivation on the threshold of audibility. J Acoust Soc Am 1958;30(4):254-262.
3
Leek MR, & Watson CS. Learning to detect auditory pattern components. J Acoust Soc Am 1984;76(4):1037-1044.
4
Delhommeau K, Micheyl C, & Jouvent R. Generalization of frequency discrimination learning across frequencies and ears: Implications for underlying neural mechanisms in humans. J Assoc Res Otolaryngol 2005;6(2):171-179.
5
Wisniewski MG, Church BA, & Mercado E. Temporal dynamics of generalization and representational distortion. Psychon Bull Rev 2010;17(6): 809-814.
6
Wright BA, & Yuxuan ZA. Review of learning with normal and altered sound-localization cues in human adults. Int J Audiol 2006;45(S1):92-98.
7
Wisniewski MG, Radell ML, Church BA, & Mercado III E. Benefits of fading in perceptual learning are driven by more than dimensional attention. PLoS ONE 2017;12(7):e0180959.
8
Ahissar M, Nahum M, Nelken I, & Hochstein S. Reverse hierarchies and sensory learning. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 2009;364(1515):285-299.
9
Petrov AA, Dosher, BA, & Lu Z. The Dynamics of Perceptual Learning: An Incremental Reweighting Model. Psychol Rev 2005;112(4):715-743.
10
Weinberger NM. Associative representational plasticity in the auditory cortex: A synthesis of two disciplines. Learn Mem 2007;14(1-2):1-16.
11
Wisniewski MG. Predicting favorable and unfavorable consequences of perceptual learning: Worsening and the peak shift. Exp Brain Res 2017;235(4):1233-1245.
12
Tanner Jr. WP, & Norman RZ. The human use of information: II. Signal detection for the case of an unknown signal parameter. Trans. IRE Profess. Group Inform. Theory 1954;4:222226.
13
Greenberg GZ, & Larkin WD. Frequency-response characteristic of auditory observers detecting signals of a single frequency in noise: The probe-signal method. J Acoustic Soc Am 1968;44(6):1513-1523.
14
Choi I, Rajaram S, Varghese LA, & Shinn-Cunningham BG. Quantifying attentional modulation of auditory-evoked cortical responses from single-trial electroencephalography. Front Hum Neurosci 2013;7(115): 1-19.
15
Tong Y, Melara R, & Rao A. P2 enhancement from auditory discrimination training is associated with improved reaction times. Brain Res 2009;1297:80-88.
16
Polich J, & Bondurant T. P300 sequence effects, probability, and interstimulus interval. Physiol Behav 1996;61(6):843–849.
Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
Page 9
N. J. Ball et al.
Learning-related improvements in auditory detection sensitivities correlate with neural changes
17
Gherman S, & Philiastides MG. Neural representations of confidence emerge from the process of decision formation during perceptual choices. Neuroimage 2015;106:134-143.
18
Brattico E, Tervaniemi M, & Picton T. Effects of brief discrimination-training on the auditory N1 wave. NeuroReport. 2003;14(18):2489-2492.
19
Pantev C, Wollbrink A, Roberts LE, Engelien A, & Lütkenhöner B. Short-term plasticity the human auditory cortex. Brain Res 1999;842(1):192-199.
20
Recanzone GH, Schreiner CE, & Merzenich MM. Plasticity in the frequency representation of primary auditory cortex following discrimination training in adult owl monkeys. Journal of Neurosci 1993;13(1):87–103.
21
Guo F, Intskirveli I, Blake DT, & Metherate R. Tone-detection training enhances spectral integration mediated by intracortical pathways in primary auditory cortex. Neurobiol Learning Mem 2013;101:75-84.
22
Edeline JM, & Weinberger NM. (1993). Receptive field plasticity in the auditory cortex during frequency discrimination training: Selective retuning independent of task difficulty. Behav Neurosci 1993;107(1):82-103.
23
Jenness D. Auditory evoked-response differentiation with discrimination learning in humans. J Comp Physiol Psychol 1972;80(1):75-90.
24
Orduña I, Liu E, Church B, Eddins A, & Mercado E. Evoked-potential changes following discrimination learning involving complex sounds. Clin Neurophysiol 2012;123(4):711719.
25
Luck SJ. Neurophysiology of selective attention. In H. Pashler, H. Pashler (Eds.), Attention (pp. 257-295). Hove, England: Psychology Press/Erlbaum (UK) Taylor & Francis, 1998.
26
Delorme A, & Makeig S. EEGLAB: An open source toolbox for analysis of single trial EEG dynamics including independent component analysis. J Neurosci Methods 2004;134(1):921.
27
Wisniewski MG, Mercado III E, Church BA, Gramann K, & Makeig S. Brain dynamics that correlate with effects of learning on auditory distance perception. Front Neurosci 2014;8(396):1-15.
28
Luck SJ. An Introduction to the Event-related Potential Technique. Cambridge, MA: MIT Press, 2005.
29
Tremblay KL, Ross B, Inoue K, McClannahan K, & Collet G. Is the auditory evoked P2 response a biomarker of learning? Front Syst Neurosci 2014;8(28):1-13.
30
Sheenan KA, McArthur GM, & Bishop DV. Is discrimination training necessary to cause changes in the P2 auditory event-related brain potential to speech sounds? Cogn Brain Res 2005;25(2):547 – 553.
31
Polich J. Detection of change: Event-related potential and fMRI findings. Dordrecht, Netherlands: Kluwer Academic Publishers, 2003.
32
Johnson R, & Donchin E. Sequential expectancies and decision-making in a changing environment: An electrophysiological approach. Psychophysiology 1982;19(2):183–200.
Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
of
Page 10
N. J. Ball et al.
Learning-related improvements in auditory detection sensitivities correlate with neural changes
33
Mecklinger A, & Ullsperger P. P3 varies with stimulus categorization rather than probability. Electroencephalogr Clin Neurophysiol 1993;86(6):395–407.
34
Azizian A, Freitas AL, Watson TD, & Squires NK. Electrophysiological correlates of categorization: P300 amplitude as an index of target similarity. Biol Psychol 2006;71(3):278–88.
35
Sutton S, Braren M, Zubin J, & John E. Evoked potential correlates of stimulus uncertainty. Science 1965;150(3700):1187–8.
36
Hillyard SA, Hink RF, Schwent VL, & Picton TW. Electrical signs of selective attention in the human brain. Science. 1973;182(4108):177-180.
37
Näätänen R. Processing negativity: An evoked-potential reflection of selective attention. Psychol Bull 1982;92(3):605-640.
Proceedings of Meetings on Acoustics, Vol. 30, 050012 (2017)
Page 11