White-Matter Pathways for Statistical Learning of Temporal ... - eNeuro

2 downloads 0 Views 3MB Size Report
Jun 29, 2018 - analytic tools, Wrote the paper; Andrew Welchman: Designed research ...... Simmons A, David AS, Kapur S, Pariante CM, Murray RM, Dazzan P ...
This Accepted Manuscript has not been copyedited and formatted. The final version may differ from this version.

Research Article: New Research | Sensory and Motor Systems

White-Matter Pathways for Statistical Learning of Temporal Structures 1

1,2

Vasilis M Karlaftis , Rui Wang

, Yuan Shen

3,4

4

5

1

, Peter Tino , Guy Williams , Andrew Welchman and Zoe

1

Kourtzi 1

Department of Psychology, University of Cambridge, Cambridge United Kingdom

2

Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing China

3

Department of Mathematical Sciences, Xi'an Jiaotong-Liverpool University, Suzhou China

4

School of Computer Science, University of Birmingham, Birmingham United Kingdom

5

Wolfson Brain Imaging Centre, University of Cambridge, Cambridge United Kingdom

DOI: 10.1523/ENEURO.0382-17.2018 Received: 10 November 2017 Revised: 21 April 2018 Accepted: 23 April 2018 Published: 29 June 2018

Author Contributions: Vasilis M Karlaftis: Performed research, Contributed analytic tools, Analyzed data, Wrote the paper; Rui Wang: Performed research, Contributed analytic tools, Analyzed data, Wrote the paper; Yuan Shen: Contributed analytic tools, Analyzed data, Wrote the paper; Peter Tino: Designed research, Contributed analytic tools, Wrote the paper; Guy Williams: Contributed analytic tools, Wrote the paper; Andrew Welchman: Designed research, Wrote the paper; Zoe Kourtzi: Designed research, Wrote the paper. Funding: http://doi.org/10.13039/501100000268Biotechnology and Biological Sciences Research Council (BBSRC) H012508 Funding: http://doi.org/10.13039/501100000275Leverhulme Trust RF-2011-378 Funding: http://doi.org/10.13039/501100004963EC | Seventh Framework Programme (FP7) PITN-GA-2011-290011 PITN-GA-2012-316746 Funding: http://doi.org/10.13039/100010269Wellcome 095183/Z/10/Z Funding: http://doi.org/10.13039/501100000266Engineering and Physical Sciences Research Council (EPSRC) EP/L000296/1 The authors declare no competing financial interests. This work was supported by grants to ZK from the Biotechnology and Biological Sciences Research Council (H012508), the Leverhulme Trust (RF-2011-378) and the [European Community's] Seventh Framework Programme [FP7/2007-2013] under agreement PITN-GA-2011-290011, AEW from the Wellcome Trust (095183/ Z/10/Z) and the [European Community's] Seventh Framework Programme [FP7/2007-2013] under agreement PITN-GA-2012-316746, PT from Engineering and Physical Sciences Research Council (EP/L000296/1). Correspondence should be addressed to Zoe Kourtzi, Department of Psychology, University of Cambridge, Cambridge, UK. Email: [email protected] Cite as: eNeuro 2018; 10.1523/ENEURO.0382-17.2018

Accepted manuscripts are peer-reviewed but have not been through the copyediting, formatting, or proofreading process. Copyright © 2018 Karlaftis et al. This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International license, which permits unrestricted use, distribution and reproduction in any medium provided that the original work is properly attributed.

Alerts: Sign up at eneuro.org/alerts to receive customized email alerts when the fully formatted version of this article is published.

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49

1. Title: White-matter pathways for statistical learning of temporal structures 2. Abbreviated Title: White-matter connectivity for statistical learning 3. Authors and Affiliations Vasilis M Karlaftis1, Rui Wang1,2, Yuan Shen3,4, Peter Tino4, Guy Williams5, Andrew Welchman1, Zoe Kourtzi1 1 Department of Psychology, University of Cambridge, Cambridge, United Kingdom 2 Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China 3 Department of Mathematical Sciences, Xi'an Jiaotong-Liverpool University, Suzhou, China 4 School of Computer Science, University of Birmingham, Birmingham, United Kingdom 5 Wolfson Brain Imaging Centre, University of Cambridge, Cambridge, United Kingdom 4. Author Contributions: Vasilis M Karlaftis: Performed research, Contributed analytic tools, Analyzed data, Wrote the paper; Rui Wang: Performed research, Contributed analytic tools, Analyzed data, Wrote the paper; Yuan Shen: Contributed analytic tools, Analyzed data, Wrote the paper; Peter Tino: Designed research, Contributed analytic tools, Wrote the paper; Guy Williams: Contributed analytic tools, Wrote the paper; Andrew Welchman: Designed research, Wrote the paper; Zoe Kourtzi: Designed research, Wrote the paper 5. Correspondence should be addressed to Zoe Kourtzi Department of Psychology, University of Cambridge Cambridge, UK Email: [email protected] 6. Number of Figures: five (5) 7. Number of Tables :three (3) 8. Number of Multimedia: 0 9. Number of words for Abstract: 225 10. Number of words for Significance Statement: 112 11. Number of words for Introduction: 686 12. Number of words for Discussion: 1718 13. Acknowledgements: We would like to thank Caroline di Bernardi Luft for helping with data collection; the CamGrid team; Morten L. Kringelbach, Henrique M. Fernandes and Tim J. Van Hartevelt for help with DTI analyses; Heidi Johansen-Berg for help with optimizing the DTI sequences and helpful discussions. 14. Conflict of Interest: The authors declare no competing financial interests. 15. Funding sources: This work was supported by grants to ZK from the Biotechnology and Biological Sciences Research Council (H012508), the Leverhulme Trust (RF-2011-378) and the [European Community's] Seventh Framework Programme [FP7/2007-2013] under agreement PITNGA-2011-290011, AEW from the Wellcome Trust (095183/Z/10/Z) and the [European Community's] Seventh Framework Programme [FP7/2007-2013] under agreement PITN-GA-2012-316746, PT from Engineering and Physical Sciences Research Council (EP/L000296/1).

1

50

Title: White-matter pathways for statistical learning of temporal structures

51

Abstract: Extracting the statistics of event streams in natural environments is critical for interpreting

52

current events and predicting future ones. The brain is known to rapidly find structure and meaning in

53

unfamiliar streams of sensory experience, often by mere exposure to the environment (i.e. without

54

explicit feedback). Yet, we know little about the brain pathways that support this type of statistical

55

learning. Here, we test whether changes in white-matter connectivity due to training relate to our

56

ability to extract temporal regularities. By combining behavioral training and Diffusion Tensor

57

Imaging (DTI), we demonstrate that humans adapt to the environment’s statistics as they change over

58

time from simple repetition to probabilistic combinations. In particular, we show that learning relates

59

to the decision strategy that individuals adopt when extracting temporal statistics. We next test for

60

learning-dependent changes in white-matter connectivity and ask whether they relate to individual

61

variability in decision strategy. Our DTI results provide evidence for dissociable white-matter

62

pathways that relate to individual strategy: extracting the exact sequence statistics (i.e. matching)

63

relates to connectivity changes between caudate and hippocampus, while selecting the most probable

64

outcomes in a given context (i.e. maximizing) relates to connectivity changes between prefrontal,

65

cingulate and basal ganglia (caudate, putamen) regions. Thus, our findings provide evidence for

66

distinct cortico-striatal circuits that show learning-dependent changes of white-matter connectivity

67

and support individual ability to learn behaviorally-relevant statistics.

68

Significance statement: Training is known to improve performance in a range of sensory-motor tasks

69

and alter white-matter connectivity, as measured by Diffusion Tensor imaging (DTI). Yet, learning to

70

extract the statistics of event streams in natural environments is thought to often occur without explicit

71

feedback (i.e. by mere exposure to the environment). Here, we demonstrate that this type of statistical

72

learning of temporal structures without trial-by-trial feedback relates to changes in white-matter

73

connectivity in the human brain. Our findings provide evidence for distinct cortico-striatal circuits that

74

support individual ability to learn behaviorally-relevant statistics. In particular, individuals engage

75

dissociable structural brain networks depending on their decision strategy, suggesting alternate brain

76

routes to learning predictive structures. 2

77

Key words: vision, brain plasticity, brain imaging, Diffusion Tensor Imaging, statistical learning.

3

78

Introduction

79

Interacting successfully in dynamic environments entails that we extract meaningful structure from

80

initially incomprehensible streams of events. This ability to extract spatial and temporal regularities

81

from the environment, often without explicit feedback, is known as statistical learning (Perruchet and

82

Pacton, 2006; Aslin and Newport, 2012). In particular, observers report that stimuli (shapes, tones, or

83

syllables) that co-occur spatially or follow in a temporal sequence appear familiar (Saffran et al.,

84

1996, 1999; Chun, 2000; Fiser and Aslin, 2002; Turk-Browne et al., 2005). Typically, regularities in

85

the natural environment are probabilistic; for instance, combinations of sounds or syllables appear at

86

different frequencies in the context of music or language. Learning such sequences entails extracting

87

the probabilistic statistics that govern the temporal structure of events. Previous work has highlighted

88

the role of strategies in probabilistic learning (Shanks et al., 2002; Erev and Barron, 2005) and

89

perceptual decision-making (Eckstein et al., 2013; Acerbi et al., 2014; Murray et al., 2015). That is,

90

observers are shown to match their choices stochastically according to the underlying input statistics

91

or maximize their success by selecting the most probable outcomes. Despite the fundamental

92

importance of statistical learning for making perceptual decisions, we know surprisingly little about

93

the brain pathways that support individual ability and strategies for learning temporal regularities.

94

Here, we combine behavioral measurements and multi-session DTI (before and after training)

95

to investigate the structural (i.e. white-matter) pathways that engage in statistical learning of temporal

96

structures. Recent advances in Diffusion Tensor Imaging (DTI) allow us to reliably measure brain

97

connectivity as indexed by local water molecule diffusion (Basser and Pierpaoli, 1996; Le Bihan et

98

al., 2001) or long-distance brain connections (Basser et al., 2000). DTI work provides accumulating

99

evidence for learning-dependent changes in white-matter connectivity (Zatorre et al., 2012) due to

100

training in a range of tasks including motor learning (Scholz et al., 2009; Taubert et al., 2010;

101

Sampaio-Baptista et al., 2013), spatial navigation (Sagi et al., 2012; Hofstetter et al., 2013), working

102

memory (Takeuchi et al., 2010), artificial grammar learning (Flöel et al., 2009) and language

103

(Schlegel et al., 2012; Hofstetter et al., 2016). Here, we ask whether mere exposure to streams of

104

information (i.e. without trial-by-trial feedback) changes white-matter connectivity in pathways that 4

105

support our ability to extract statistical regularities. Further, we test whether these learning-dependent

106

changes in white-matter connectivity relate to individual decision strategies when learning temporal

107

structures.

108

In particular, to investigate the brain pathways involved in learning temporal structures

109

unencumbered by past experience, we generated temporal sequences based on Markov models of

110

different orders (i.e. context lengths of 0, 1 or 2 previous items) (Figure 1). To simulate event

111

structures in the natural environment that typically contain regularities at different scales, from simple

112

repetition to probabilistic combinations, we exposed participants to sequences of unfamiliar symbols

113

and varied the sequence structure unbeknownst to the participants by increasing the context length.

114

We presented participants first with sequences determined by frequency statistics (i.e. occurrence

115

probability per symbol), followed by sequences determined by context-based statistics that increased

116

in context length (i.e. the probability of a given symbol appearing depends on the n preceding

117

symbols). Participants performed a prediction task, indicating which symbol they expected to appear

118

next in the sequence. Following previous statistical learning paradigms, participants were exposed to

119

the sequences without trial-by-trial feedback.

120

Our behavioral results show that individuals adapt to the environment’s statistics; that is they

121

are able to extract predictive structures that change over time. Further, we show that individual

122

learning of structures relates to decision strategy. In particular, learning context-based statistics relates

123

to selecting the most probable outcomes in a given context (i.e. maximizing) rather than the exact

124

sequence statistics (i.e. matching). Our DTI results demonstrate that individual strategies for learning

125

behaviorally-relevant statistics engage distinct cortico-striatal circuits. In particular, learning-

126

dependent changes in white-matter connectivity relate to individual variability in decision strategy:

127

matching relates to connectivity changes between caudate and hippocampus, while maximizing relates

128

to connectivity changes between prefrontal, cingulate and basal ganglia (caudate, putamen). Thus, our

129

findings provide evidence for learning-dependent changes of white-matter connectivity in distinct

130

cortico-striatal circuits that support our ability to extract behaviorally-relevant statistics in variable

131

environments. 5

Figure 1

132 133

Methods

134

Observers: Forty-four healthy volunteers (15 female, 29 male) participated in the experiment; half

135

participated in the training group and the rest in the no-training control group. The data from one

136

participant per group were excluded from the study due to excessive head movement, resulting in

137

twenty-one participants per group (training group: mean age 21.56 years, standard deviation 1.84

138

years; no-training group: mean age 25.53 years, standard deviation 2.60 years). All participants were

139

naive to the study, had normal or corrected-to-normal vision and signed an informed consent. Human

140

subjects were recruited at a location which will be identified if the article is published. All

141

experiments were approved by [Author University] Ethics Committees.

142

Stimuli: Stimuli comprised four symbols chosen from Ndjuká syllabary (Figure 1a). These symbols

143

were highly discriminable from each other and were unfamiliar to the participants. Each symbol

144

subtended 8.5o of visual angle and was presented in black on a mid-grey background. Experiments

145

were controlled using Matlab and the Psychophysics toolbox 3 (Brainard, 1997; Pelli, 1997). For the

146

behavioral training sessions, stimuli were presented on a 21-inch CRT monitor (ViewSonic P225f

147

1280 x 1024 pixel, 85 Hz frame rate) at a distance of 45 cm. For the test sessions, stimuli were

148

presented inside the MRI scanner using a projector and a mirror set-up (1280 x 1024 pixel, 60 Hz

149

frame rate) at a viewing distance of 67.5 cm. The physical size of the stimuli was adjusted so that the

150

angular size was constant during training and test sessions.

151

Sequence design: We generated probabilistic sequences by using a temporal Markov model and

152

varying the memory length (i.e. context length) of the sequence (Anonymous, 2017). The model

153

consists of a series of symbols, where the symbol at time i is determined probabilistically by the

154

previous ‘k’ symbols. We refer to the symbol presented at time i, s(i), as the target and to the

155

preceding k-tuple of symbols (s(i-1), s(i-2), … , s(i-k)) as the context. The value of ‘k’ is the order or

156

level of the sequence:

157

P (s(i) | s(i-1), s(i-2), … , s(1)) = P (s(i) | s(i-1), s(i-2), … , s(i-k)), k