Video: reflected screen brightness on the face or clothes of the subjects (split second). â« Experiment 2: â« Event data: did not work because reading stark was ...
Synchronisation of eye tracker data with other data Egon Werlen COST Action E-READ meeting at the SWAET in Turku - 22.06.2016
HS16/17
The Experiment n Research Questions n What’s the influence of cognitive load and emotional reactions on reading performance? n How works our measuring system (feasibility)?
n Subjects n 103 college students (Fachmittelschule; access to universities of applied sciences) n Average years: 17.8 (1.2); range: 16-21 n 87% women
n Instruments n Cognitive load: Eye Tracker SMI RED500, Single Items n Emotional reaction: FaceReader 6.1 (Noldus), E4 Empatica, Single Items, Questionnaires
n Conditions n Screen size: small (smartphone) – middle (tablet) – large (laptop); randomized n Text difficulty / readability: ‘easy’ – ‘difficult’; randomized n Emotional content: neutral – negative – positive
2016
2
3
The Design 1. Welcome and informed consent 2. Preparation 3. Questionnaire (biography, reading practice, mood, empathy)
4
5
6
4. Phase 1 1.
Text 1 (neutral)
2.
Retelling 1
3.
Single questions (valence-arousal, difficulty, knowledge)
5. Phase 2 1.
Text 2 (negative)
2.
Retelling 2
3.
Single questions (valence-arousal, difficulty, knowledge)
6. Phase 3 1.
Text 3 (positive)
2.
Retelling 3
3.
Single questions (valence-arousal, difficulty, knowledge) + Questionnaire (mood)
7. Images faces (anger, contempt, disgust, fear, happiness, sadness, surprise) 7 8 9
8. Images nature (landscapes, snakes, spiders) 9. Single questions (valence-arousal, liking landscapes, snakes, spiders) 10. Discharge
2016
3
The Problem
Questionnaire
Text 1
0’
11:15’
0’
11:00’
Text 2 18:30’
17:30’
Text 3
Images3
25:45’
35:15’
24:30’
32:45’
40:00’
37:45’
BeGaze (software to visualize eye tracker data of SMI) cuts out loading times and times when the eye tracker does not measure
2016
4
Our Solutions n Experiment 1 (cognitive task; not shown before): n Event data did not work because (even if video duration and last event correspond well) n Video: reflected screen brightness on the face or clothes of the subjects (split second)
n Experiment 2: n Event data: did not work because reading stark was different (questions to experimenter, orientation behaviour, …) n BeGaze: Timeline of first (and last) fixation on text: did not work n Video: reflected screen brightness on the face or clothes of the subjects ¨
Texts and retelling: to the split second (Quick Player 10, VLC)
¨
Images (faces, nature): frame (Quick Player 7)
¨
With the help of BeGaze data and a second (not synchronized) video showing back of subject and screen
2016
5
Your Solutions? n Do you have problems synchronizing eye tracker date with other data? n What are your solutions to synchronize eye tracker data to other data? (FaceReader, physiological data) n Are there some simple or automated solutions?
2016
6
Thank you
2016
7
