24 neurotypical adults performed a gender (n=12) or expression (n=12) categorization task while their EEG activity was recorded. Gosselin & Schyns (2001) ...
Information reception and processing during visual recognition Laurent Caplette, Karim Jerbi & Frédéric Gosselin Department of psychology, Université de Montréal
Information processing and information reception When recognizing an object, the brain processes the received sensory information through time
Time
Recognition
g… sin s e oc Pr Reception
Retina
V1
IT
Processing level
Information processing and information reception When recognizing an object, the brain processes the received sensory information through time
Time Reception
Reception
Importantly, this information is also received through time • Eyes will typically fixate an object for > 200 ms
Reception
Retina
Processing…
g… essin c o r P g… sin s e oc Pr
V1
IT
Processing level
Hence, the brain simultaneously processes information received at different moments, probably at different processing stages
Different processing for different reception moments Information received at different moments should be processed differently, even when the retinal input does not vary
Different processing for different reception moments Information received at different moments should be processed differently, even when the retinal input does not vary • Retention of information received earlier
Recognition Time
Processing…
Reception ing… Process
Reception … ssing Proce
Reception Retina
V1
IT
Processing level
Different processing for different reception moments Information received at different moments should be processed differently, even when the retinal input does not vary • Retention of information received earlier
Recognition Time
Processing… Reception … Processing
• Attention, visual routines
Reception ssing… Proce
Reception Retina
V1
IT
Processing level
Goal Most studies examine the processing of a stimulus as if it existed as one point in time Here, we decompose processing according to the moment of reception of visual information Our goal is to investigate whether processing is modulated by this reception moment
Methods 24 neurotypical adults performed a gender (n=12) or expression (n=12) categorization task while their EEG activity was recorded
Gosselin & Schyns (2001) Vision Research
Methods 24 neurotypical adults performed a gender (n=12) or expression (n=12) categorization task while their EEG activity was recorded
Vinette et al. (2004) Cognitive Science
Methods 24 neurotypical adults performed a gender (n=12) or expression (n=12) categorization task while their EEG activity was recorded
Analyses: Behavior Spatiotemporal samples
Response accuracies +
L. eye
Mouth
Trial Z
Trial X
0 -1
Trial Y
1
Trial Z
0 -1
R. eye
-
...
0 ms
200 ms
...
Trial Y
Visibility
R. eye
...
Trial X
Presentation time Presentation moment (ms)
...
Use of information received at specific moments for the task +
Correlation with accuracy
Left eye Right eye Mouth 0
50
100
150
200
Presentation moment Presentation time (ms)(ms)
-
Analyses: Behavior Spatiotemporal samples
Response accuracies +
L. eye
Mouth
Trial Z
Trial X
0 -1
Trial Y
1
Trial Z
0 -1
R. eye
-
...
0 ms
200 ms
...
Trial Y
Visibility
R. eye
...
Trial X
Presentation time Presentation moment (ms)
...
Use of information received at specific moments for the task +
Correlation with accuracy
Left eye Right eye Mouth 0
50
100
150
200
Presentation moment Presentation time (ms)(ms)
-
Analyses: Behavior Spatiotemporal samples
Response accuracies +
L. eye
Mouth
Trial Z
Trial X
0 -1
Trial Y
1
Trial Z
-1 0
R. eye
-
...
0 ms
200 ms
...
Trial Y
Visibility
R. eye
...
Trial X
Presentation time Presentation moment (ms)
...
Use of information received at specific moments for the task +
Correlation with accuracy
Left eye Right eye Mouth 0
50
100
150
200
Presentation moment (ms) Presentation time (ms)
-
Behavior Happy vs Neutral
Presentation moment (ms)
Presentation moment (ms)
Regression coeff. (a.u.)
Man vs Woman
Gosselin & Schyns (2001) Journal of Vision *p < .05, two-tailed (maximum statistic method, pixel level)
Dupuis-Roy et al. (2009) Journal of Vision Schyns et al. (2002) Psychological Science
Analyses: EEG Spatiotemporal samples
EEG activity +
L. eye
Trial X Trial Y
Visibility
R. eye Mouth
...
Trial Z
Trial X Trial Y Trial Z
200 ms
Presentation time Presentation moment (ms)
0
100
200
... Left eye presented at 0 ms 8 ms
...
17 ms
Right eye presented at 0 ms
...
8 ms
300
400
500
Time from face onset (ms)
Processing of information received at specific moments
...
...
0 ms
600
Analyses: EEG Spatiotemporal samples
EEG activity +
L. eye
Trial X Trial Y
Visibility
R. eye Mouth
...
Trial Z
Trial X Trial Y Trial Z
200 ms
Presentation time Presentation moment (ms)
0
100
200
... Left eye presented at 0 ms 8 ms
...
17 ms
Right eye presented at 0 ms
...
8 ms
300
400
500
Time from face onset (ms)
Processing of information received at specific moments
...
...
0 ms
600
Analyses: EEG Spatiotemporal samples
EEG activity +
L. eye
Trial X Trial Y
Visibility
R. eye Mouth
...
Trial Z
Trial X Trial Y Trial Z
200 ms
Presentation time Presentation moment (ms)
0
100
200
... Left eye presented at 0 ms 8 ms
...
17 ms
Right eye presented at 0 ms
...
8 ms
300
400
500
Time from face onset (ms)
Processing of information received at specific moments
...
...
0 ms
600
Analyses: EEG Spatiotemporal samples +
L. eye
Trial X
EEG activity
Trial Y
Trial X Trial Y Trial Z
Visibility
R. eye Mouth
...
Trial Z -
...
0 ms
0
200 ms
100
200
300
400
500
Time from face onset (ms)
Presentation time
Presentation moment (ms)
... Presentation time (ms)
Presentation moment (ms)
right ROI, gender, leye
200 200
+
0.02
Left eye presented at 0 ms 150 150 8 ms
0
...
-0.01
50 50
...
...
0.01
100 10017 ms
Right eye presented at 0 ms 0 0 8 ms 0 0
Regression coeff. (a.u.)
Null hypothesis: No differences across reception moments
Presentation time (ms)
Processing of feature F on electrode E inmoments task T Processing of information received at specific
-0.02
100 100
200 200
300300
400400
Time from face onset (ms)
TimeTime from face (ms) from faceonset onset (ms)
500500
600600
-
600
Reception time x processing time
eft ROI
Right ROI
Gender -
Presentation momenttime (ms) Presentation time (ms) Presentation (ms)
200 200
300
f
right rightROI, ROI,gender, gender,reye leye 0.02 0.02
150 150 100 100
400
50 50
00 m face onset (ms)
Whole
Whole
Sampled 500 00
00
Sampled
-0.01 -0.01
600
0 100 100
200 200
100
200
300
Time Timefrom fromface faceonset onset(ms) (ms)
156 ms
216 ms
*p < .05, two-tailed (maximum statistic method, pixel and cluster levels)
400
500
Time from face onset (ms)600 300 400 500 300 400 500 600
Time from face onset (ms) 92 ms
0.01 0.01
0.1
600 -0.02 -0.02
Regression coeff. (a.u.)
0
Right Occipital
Null model example
C
Reception time x processing time Right Occipital
Null model example
eft ROI
Gender –
300
Presentation moment (ms) Presentation time (ms)
200
400
150 100 50
0.02
Whole Sampled 500
600
0
m face onset (ms)
0
f
right ROI, gender, leye
100
200
300
0.01
Sampled
0
500
0
100
200
300
400
500
Time from face onset (ms) 216 ms 156 ms
*p < .05, two-tailed (maximum statistic method, pixel and cluster levels)
0.1
-0.01
600
-0.02
Time from face onset (ms) Time from face onset (ms)
92 ms
400
Whole
600
Regression coeff. (a.u.)
0
Right ROI
C
Different processing across reception moments Time
p
