SI3 – Master ISI : IHM02 2006/2007. 1. Input / Output devices, technologies and
techniques. Diane Lingrand
Today's topic
Input / Output devices, technologies and techniques
Diane Lingrand
[email protected] http://www.polytech.unice.fr/~lingrand
SI3 – Master ISI : IHM02 2006/2007
Input / output devices
1
mouse, keyboard, etc.
Taxonomies
Evaluation
Next time:
displays
About 3D space and more
SI3 – Master ISI : IHM02 2006/2007
Inputs / outputs
Text entry
Input
Handwritten
text (keyboard, handwritten)
totally free
position (mouse, GPS, ...)
constrained
audio (speech recognition)
visual (image, video: tracking, recognition)
Output
audio (precomputed, speech synthesis)
visual (precomputed, synthetic image)
tactil (force feedback, vibration, ...)
SI3 – Master ISI : IHM02 2006/2007
2
3
Keyboards
hardware / software
mobility (wearable computer, mobile phone, PDAs, ...)
handicap
SI3 – Master ISI : IHM02 2006/2007
4
Graffiti, Calligrapher 8.3, xscribble
Keyboard's layout
AZERTY, QWERTY, ..., Dvorak (1936).
uni-stroke alphabet SI3 – Master ISI : IHM02 2006/2007
5
Ergonomic keyboards
SI3 – Master ISI : IHM02 2006/2007
6
Logical keyboard Mackenzie and Zhang, CHI'99 Hunter, Zhai and Smith, CHI 2000
SI3 – Master ISI : IHM02 2006/2007
7
SI3 – Master ISI : IHM02 2006/2007
8
Games
Wearable computer
SI3 – Master ISI : IHM02 2006/2007
9
SI3 – Master ISI : IHM02 2006/2007
10
Mobility 2005
Twiddler
WristPC
http://www.redwoodhouse.com/wearable/index.php?module=pagemaster& AGE_user_op=view_page&PAGE_id=7&MMN_position=16:7 SI3 – Master ISI : IHM02 2006/2007
11
SI3 – Master ISI : IHM02 2006/2007
12
Chord Keyboard: Microwriter (1980)
SI3 – Master ISI : IHM02 2006/2007
Another Chord Keyboards
13
BAT keyboard (Infogrip)
CyKey (Bellaire Electronics)
SI3 – Master ISI : IHM02 2006/2007
Keyboards for PDA
Mobile phone
SI3 – Master ISI : IHM02 2006/2007
14
15
Example: Glyph
SI3 – Master ISI : IHM02 2006/2007
(F. Poirier, Univ. Bretagne Sud)
16
Glyph alphabet
SI3 – Master ISI : IHM02 2006/2007
Motor handicap
graphic tablet, touchscreen, optical pen
mouse, joystick, trackball
direct / indirect
Control to Display Ratio
touchscreen, optical pen
graphic tablet, mouse, joystick, trackball
SI3 – Master ISI : IHM02 2006/2007
logical keyboard
Ex: KeyGlasses (M. Raynal, Univ. Toulouse)
18
Mouse
absolute / relative
limiting displacements
SI3 – Master ISI : IHM02 2006/2007
17
Pointing devices
19
invented in 1967 by Douglas Engelbart and co.
« any device that is capable of producing cursor motion » ?
SI3 – Master ISI : IHM02 2006/2007
20
Evaluation of pointing task: Fitt's law (1954)
Alternative pointing devices
A W
trackball
touchpad
where :
pointing stick
foot mouse
SI3 – Master ISI : IHM02 2006/2007 touchscreen, camera mouse, eye mouse ...21
a and b are empirical constants, and can be determined by fitting a straight line to measured data.
A is the distance from the starting point to the center of the target or amplitude of movement.
W is the width of the target measured along the axis of motion. W can also be thought of as the allowed error tolerance in the final position, since the final point of the motion must fall within ± W/2 of the target's centre.
22
Joystick
Extension to 2D space
Special case of path = straight tunnel of constant width W
SI3 – Master ISI : IHM02 2006/2007
MT is the average time taken to complete the movement.
SI3 – Master ISI : IHM02 2006/2007
Accot and Zhai Steering law (1997)
23
Axes (absolute value)
Buttons (up/down)
Hats (discrete value: up, right, ...)
Trackballs (relative 2D value)
SI3 – Master ISI : IHM02 2006/2007
24
Other ....
Mouth joystick
Gaming
« as a » joystick
Joypad, ....
Jouse2 (Infogrip) SI3 – Master ISI : IHM02 2006/2007
25
SI3 – Master ISI : IHM02 2006/2007
Eye - tracking
Positionning
Method:
GPS
Image Processing
Wifi
Cornea reflexion
RFID
Magnetic system
Camera tracking: eye, head, hand, body, ...
...
Mobile (on user head) / fixed (computer)
2D / 3D (?)
SI3 – Master ISI : IHM02 2006/2007
26
27
SI3 – Master ISI : IHM02 2006/2007
28
Use your imagination !
Taxonomies
An exhaustive list is unusable
GKS: logical device
Laval Virtuel, 2006
1974-84 :Foley
Gestaction 3D
SI3 – Master ISI : IHM02 2006/2007
29
1984: Foley
SI3 – Master ISI : IHM02 2006/2007
Locator, Stroke, Valuator, Choice, Pick, String Select, Position, Orient, Ink, Text, Value
1983: Buxton
1991: Card, Mackinlay and Robertson
SI3 – Master ISI : IHM02 2006/2007
30
1983: Buxton's Taxonomy
31
SI3 – Master ISI : IHM02 2006/2007
32
Card, MacKinlay and Robertson (1997)
Mackinlay's radio VolumeKnob = = Rz : [0o, 270o] [0o, 270o] Volume = < InputDomain: [0, 25] decibels>
Connection composition: Connect (VolumeKnob, Volume, f( deg) = Cv * decibels) VolumeKnob Volume
Layout composition: VolumeKnobT1(x)SelectionKnobT2(x)StationKnobT3(x)
SI3 – Master ISI : IHM02 2006/2007
33
Merge composition: GenericTablet = Generic1DTabletx X Generic1DTablety
xy 2006/2007 SI3 – Master ISI : IHM02
Limitations 2D event (x;y)
Ouputs
2D event (x;y)
Audio
Visual
1D sensor
1D sensor
1D sensor X
34
screen / monitor
glasses
retinal
Touch / Force
1D sensor Y
equivalent ??? SI3 – Master ISI : IHM02 2006/2007
35
SI3 – Master ISI : IHM02 2006/2007
36
BCI: Brain Computer Interfaces
Non-invasive / Invasive
Paralysed people
Tools and libraries
control of a robotic arm, ...
Using different input devices:
drivers
libraries:
Blind people
camera + electrodes in the visual cortex
Speech synthesis (TTS=text-to-speech)
2001 SI3 – Master ISI : IHM02 2006/2007
http://en.wikipedia.org/wiki/Speech_synthesis
Handwritten recognition Gestures recognition
– Master ISI : IHM02 2006/2007 SI3
CHI at the Movie Theater
1968
SDL (www.libsdl.org): Simple DirectMedia Layer
Speech recognition
37
VRPN : Virtual Reality Peripheral Network
SI3 – Master ISI : IHM02 2006/2007
38
Bibliography
Ken Hinckley « The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications » , chapter 7, 2003, J.A. Jacko and A. Sears editors.
J. Accot and Sh. Zhai « More than dotting the i's Foundations for crossing-based interfaces » CHI 2002
Bill Buxton: http://www.billbuxton.com
2003
2002 39
SI3 – Master ISI : IHM02 2006/2007
40
