History of Pen and Gesture Computing: Annotated ...

02.11.13

(1999..2000) History of Pen and Gesture Computing

History of Pen and Gesture Computing: Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers References from the approximate years 1999 to 2000. This compilation and all annotations are copyright © Jean Renard Ward, 1993, 2004, 2011. Permission is granted to use this information in publication, including confidential reports, provided that accompanying text clearly makes reference to the URL for this page, along with the statement: Source:Annotated Bibliography in On-line Character Recognition, Pen Computing, Gesture User Interfaces and Tablet and Touch Computers Copyright Jean Renard Ward

These are items in my personal collection, either as physical items or (sometimes) as PDF files. I can be contacted at [email protected]. Copyright © Thu Oct 24 22:10:56 EDT 2013 . Mirrors of this page can be found at: http://users.erols.com/rwservices/pens/biblio00.html http://216.15.114.196:81/pens/biblio00.html http://rwservices.no-ip.info:81/pens/biblio00.html (Generally most up-to-date)

Main Reference Page [AllInAccess00a] (*)AllInAccess.com "All in Access", allinacces.com/happ, 2010 Web site with archived files for DOS and other screen readers and users.erols.com/rwservices/pens/biblio00.html

1/50

02.11.13


accessibility software: include Hal Lite, ScreenPower, ASAP, Tinytalk, Proxy 7, Vocal Eyes. Also Speech synthesizers such as Dectalk. Contact addresses (?) [email protected], or David Holladay [email protected]

[AllportDE00a] (*)Allport, David E. "System for Dual-Display Interaction with Integrated Television and Internet Content", United States Patent 6,097,441, August 1, 2000 Touchscreen TV remote control also accessing internet, data encoded in television signal. Videoconferencing, connection to telephone lines.

[AlphaPad00] (*)American Tel-A-Systems Inc. "About AlphaPad -AlphaPad technical information", www.alphapad.com Full-alphabet recognition using 12-key keypad, alternative to Mosaic zonebased handwriting recognition for PDAs by the same group

[ArnstGJ00a] (*)Arnst, G. Jeffrey "Schumer v. Laboratory for Computer Systems", July 6, 2000 Report Shumer patent on virtual tablets

[Arvo00] (*)Arvo, James and Novins, Kevin "Fluid Sketches: Continuous Recognition and Morphing of Simple Hand-Drawn Shapes", Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, San Diego, California, November 2000 Pretty-fying of electronic ink and sketches by least-squares fit to a clean shape or line, before the pen/stylus is lifted Does not cite it, but appears similar to spline fitting of electronic ink done by Slate / GO Corporation in the PenPoint operating system: The Slate/Go process was invoked only after the pen was lifted Relies on some simple recognition of which strokes are characters, and which are sketching: also similar to Slate/GO Says that providing initial recognition results while input is still being drawn (with sketches, not characters) allows lower-quality recognition to be used, because the user can stop as soon as the correct result is displayed

[Arvo00a] (*)Arvo, James and Novins, Kevin "SmartText: A Synthesis of Recognition and Morphing", AAAI Spring Symposium on Smart Graphics, Standford California, March 2000, pages 140-147 Shows a UI for handwriting where handwritten characters are gradually replaced by font recognition results, and pretty-fied / normalized in position

[AshdownMSD00a] (*)Ashdown, Mark S.D. "Large-Format Computer Interfaces", Ph.D. First Year Report and Research Proposal, Univ. of Cambridge Computer Lab., UK, July 2000 Bimanual two-handed input user interface. Polhemus multi-stylus (multiusers.erols.com/rwservices/pens/biblio00.html

2/50

02.11.13


touch) hardware, Wacom multi-stylus Into tablet, Mimio by Virtual Ink (note: not the display company).

[BalakrishnanR99a] (*)Balakrishnan, Ravin and Hinckley, Ken "The Role of Kinesthetic Reference Frames in Two Handed Input Performance", Proc UIST 99, Asheville, NC, pp. 171-178 Study of asymmetric two-handed / two-pointer user interface using Wacom two-puck digitizing tablet: multi-touch.

[BalakrishnanR99b] (*)Balakrishnan, Ravin; Fitzmaurice, George; Kurtenbach, Gordon; and Buxton, William "Digital Tape Drawing", Proc UIST 99, Asheville, NC, pp. 161-169 Simulate laying flexible tape in two-handed graphical drawing user interface, to model behavior of tape drawing in automobile body design to get smooth curves. Prototype did not use multi-touch touchscreen, used Ascension Flock-of-Birds electromagnetic trackers.

[Barnett99] (*)Barnett, Shawn "Jeff Hawkins: The man who almost single-handledly revived the handheld computer industry", Pen Computing Magazine, 1999. Archive at www.pencomputing.com/palm/Pen323/hawkins1.html Interview with Jeff Hawkins: GridPad, Handspring, Palm, Zoomer, Newton, Graffiti

[BartlettJF00a] (*)Bartlett, Joel F. "Rock 'n Scroll is Here to Stay", IEEE CGA, May/June 2000WRL Report 2000/3, Compaq Western Research Laboratory, Palo Alto Embodied user interface: Hand-held device with accelerometer in a display: user input is by gestures moving device: pitch, roll, slosh, snapping, tapping, fanning. Device automatically changed from portrait to landscape mode based on how it was held: compare with iPhone accellerometer. Cites to earlier work on accelerometers, graspable user interfaces.

[BartlettJF00b] (*)Bartlett, Joel F.; Brakmo, Lawrence S.; Farkas, Keith I; Hamburgen, William R.; Mann, Timothy; Viredaz, Marc A.; Waldspurger, Carl A.; Wallach, Deborah A. "The Itsy Pocket Computer", WRL Research Report 2000/6, Compaq Western Research Laboratory, October 2000 Hand-held/palm computer running Linux and X-Windows, touchscreen. Fanning gestures to review photo albums, tilt-and-scroll using built-in accellerometer. Pictures and be shown in either landscape or portrait mode. Long section on power management, clock rate. users.erols.com/rwservices/pens/biblio00.html

3/50

02.11.13


[BenderGT99a] (*)Bender, Gregory T. "Touch Screen Performance as a Function of the Duration of Auditory Feedback and Target Size", Ph. D. Thesis, Wichita State University, Spring 1999 touchscreen targetting accuracy improved -- especially for small targets -with an auditory tone between 50 and 400 ms, not longer or shorter. Shape of target/button has less effect. Mentions that resistive overlay touchscreens may transmit only as little as 55% of light, problems of visual parallax. Touch/tap and long-hold gestures for single and double-click emulation. No references to haptic feedback. Stylus more accurate than finger (but no discussion of specific stylus problems or uses)

[BeriS00a] (*)Beri, Sanjay and Slivka, Benjamin W. "Method and system for displaying hypertext documents with visual effects", United States Patent 6,141,018, October 31, 2000 Animated rolling/moving marquee of thumbnails of HTML documents or images, either circular cycle at end, or bounce at end of marquee

[BierEA99] (*)Bier, Eric A. "Customizable User Interfaces for Programmed Computer Systems", United States Patent 5,862,395, January 19, 1999 Customizable buttons Bbackground describes Apple's Hypercard system; describeds creating pop-up buttons, multi-state buttons, and radio buttons; providing feedback to show selected menu entry. Mentions GUIDE hypertext system. says "the actions performed by the buttons can refer to the contents or appearance of the button itself, and hence to any properties that the document editor supports. Thus buttons can be used to modify their own appearance or to transfer their properties to other objects in the same document editor."

[BissetSJ99a] (*)Bisset, Stephen J.; Kasser, Bernard; Joss, Berni; Tareyev, Aleksey "Touch Sensing Method and Apparatus", United States Patent 5,920,309, July 6, 1999 Capacitive matrix touch-screen sensor for simultaneous proximity of one or more fingers: multi-touch. Also refers to transcapacitance / mutual capacitance in a grid being well known in the field.

[Blickenstorfer00] (*)Blickenstorfer, Conrad "PenLab: A much faster, extensively reworked pen tablet", Pen computing magazine, June 2000. Available at www.pencomputing.com Fujitsu 3400 PenLab portable/docking pen computer, Windows 95 with Microsoft pen extensions. Mentioned design change to avoid rear-mounted electromagnetic digitizer, in favor of front-mounted resistive film digitizer. users.erols.com/rwservices/pens/biblio00.html

4/50

02.11.13


Optical plate to reduce visual parallax.

[Bloomberg99] (*)Bloomberg News "Microsoft, others sued over pen patent", CNETNews.com, April 29, 1999 Mitchell Forcier patent lawsuit against Microsoft, claims that technology missappropriated by Aha! Software and licensed to Microsoft

[BlouinF99a] (*)Blouin, Francois "Touch Pad Panel with Tactile Feedback", United States Patent 5,977,867, November 2, 1999 Adding a haptic vibrator for tactile feedback to any kind of touch input: tablet, keypad, keyboard, etc. Tactile feedback is in acoustic range: 100 to 5000 Hz.

[Bohan99] (*)Boha, Michael; Phipps, Chad A.; Chaparro, Alex; and Halcomb, Charles G. "A Psychophysical Comparison of Two StylusDriven Soft Keyboards", Proceedings of Graphics Interface GI'99 Comparison of QWERTY and "T9" (TegicCommunication) simulated keyboard layouts: QWERTY wins, because users can find the keys more easily. References to papers comparing performance and usability of handwriting recognizers

[BrodersenRW99a] (*)Brodersen, Robert W. "InfoPad - past, present and futuer", ACM SIGMOBILE Mobile Computing and Communications, Vol 3 No 1, January 1999, pp. 1..7 Prototype low-power portable multimedia terminal (slate format) with pen input, speech recognition, video

[BrownCM99a] (*)Brown, C. Marlin "Human-Computer Interface Design Guidelines", intellect, Exeter England 1999 Compendium of user-interface guidlines and principles from many reference. Sections 8.4 refers to accidental touch activation with a touchscreen: 1985 reference on switch?

[BrownH99a] (*)Brown, Heather and Robinson, Peter "Integrating Paper and Digital Documents", in section 'Intelligent Paper' of "Electronic Documents, Artistic Imaging, and Digital Typography", Roger D. Hersch, Editor. Available at http://www.cl.cam.ac.uk/~pr/publications/dmf99/dmf99.pdf Review of various work on intelligent paper -- Cites to Wellner and DataGlyphs: compare with Anoto (not cited?). Mentions TEI Text Encoding Initiative for encoding data in printed documents, dataglyphs, electronic ink on paper. Xlibris Active Reading Machine and Dynomite appear similar to Slate DayTimer Notebook product of approximately 1992 (not cited?). users.erols.com/rwservices/pens/biblio00.html

5/50

02.11.13


Dataglyphs make paper function as a touchscreen.

[BrowneH00a] (*)Browne, Hilary; Bederson, Ben; Druin, Allison; Sherman, Lisa; and Westerman, Wayne "Designing a Collaborative Finger Painting Application for Children", Univ. of Maryland Technical report HCIL-2000-17, CS-TR-4184, UMAICS-TR-2000-66, September 2000 Multi-touch finger-painting educational prototype using keyboard-sized Multi-Touch Surface (MTS). For children, gestures are too complicated, suggest template of menus / control areas along with drawing: Compare with Doster and Oed? Mentions Fingerworks multi-touch hardware in 2000, Lee/Buxton papers from 1980s, Nakatani 1991.

[Bull00a] (*)Bull Electronics Angers, France "AIX Command Reference Vol. 6, X to zcat", Bull Electronics Angers, France, Order Reference 86 A2 43JX 02, April 2000 AIX Windowing system command reference: drag-and-drop, X11 color database for color management in windows.

[BurgessD00a] (*)Burgess, David; Felsenstein, Lee; Saunders, Steven E. "Personal Object Detector", Personal Object Detector Stereo object detector / navigation aid for the visually impaired: mounted in eyeglass frames. Two sonar devices, using continuous swept-frequency, measures frequency difference (caused by phase shift from time delay) between reflected signal and internal signal. Output is generated to provide audible psychoacoustic location in user's hearing. Can be one sonar transmitter and two separated receivers, or two transmitter/receiver pairs.

[Buxton99] (*)Buxton, William "Case Study 1: Touch Tablets; Chapter 5 of "Haptic Input", Draft Document", www.billbuxton.com Short overview of touch tablets: refers to "dual pressure" sensing and infrared sensing proximity (but not touch) to simulated proximity sensing. States that touch tablets do not actually send signal that stylus is not pressing on tablet, but instead this must be infered from timing of touch tablet data (tablet stops sending) (Was he sure on this?).

[BuxtonWAS00a] (*)Buxton, William Arthur Stewart and Bell, Jeffery Allen "System for maintaining orientation of a user interface as a display changes orientation", United States Patent 6,115,025, September 5, 2000 Keep user interface elements in display at constant orientation for the user, as the display itself is rotated in a multi-user system As flat display rotates, re-draw image so that image does not appear to users.erols.com/rwservices/pens/biblio00.html

6/50

02.11.13


rotate to the user: useful in spinning-display 3D display?

[BuxtonWAS00b] (*)Buxton, William A.S. and Kurtenbach, Gordon P. "Graphical keyboard", United States Patent 6,094,197, July 25, 2000 Simulated keyboard on a display: however, typing action is gesture-like: tap on key for lower case, drag upwards from key for upper case, drag right for control-c, drag right-up for control-C. Diagonal stroke used for whitespace/backspace/return/delete. Describes pendown/pendrag/penstill/penup events (press-and-hold), not just mouse button up/down. See also http://www.billbuxton.com

[BuxtonW00c] (*)Buxton, William; Fitzmaurice, George; Balakrishnan, Ravin; and Kurtenbach, Gordon "Large Displays in Automotive Design", IEEE Computer Graphics and Application, July/August 2000, pp. 68-75 Review of uses of Large displays (with touchscreen or tablet or pointing input) like Active Desk/Whiteboard to design styling of autombiles: also ImmersaDesk Virtual Reality VR with two datagloves for hand input and stereo headtracking imager. Laser pointer instead of touchscreen, multiple display walls create a "cave".

[BuxtonWAS00d] (*)Buxton; William A.S.; Harrison; Beverly L., Vicente; Kim J "Graphical user interface with optimal transparency thresholds for maximizing user performance and system efficiency", United States Patent 6,118,427, September 12, 2000 Transparent user interface tools on touchscreen user interface: e.g. keypad menu

[CappsS00x49] (*)Capps, Stephen et al "System and method for organizing recognized and unrecognized objects on a computer display", United States Patent 6,021,218 Stephen Capps is listed in over 50 patents for pen-computing userinterface features, mostly from the Apple Newton. Patents cite little or no prior art before 1990. Compare to van Raamsdonk, Pencept, and CIC?

[CarrollDW00a] (*)Carroll, David W.; Carroll, James L.; and Case, Steven V. "Touch Screen Systems and Methods", United States Patent 6,121,960, September 19, 2000 Display semi-transparent virtual/software keyboard over application image in a touchscren display ("variable-pixel control"), for example in a wearable or hand-held computer. Overlaying may be by blending images, seethrough transparency, or dotted-lines for key/keyboard image. Switches users.erols.com/rwservices/pens/biblio00.html

7/50

02.11.13


between keyboard mode and cursor (drawing) mode based on continuous touching for a period of time (dwell?). Zoom gesture requires multiple fingers. multi-tap (multi-touch) gestures. Dwell/press-and-hold.

[Casio00a] (*)Casio Inc. "Mobile Datenerfassung: Hand-PC mit TouchPanel und Belegdrucker IT-2000", CASIO Computer Deutschland, D22848 Norderstedt, Germany, Dec 12 2000 Product information on IT-2000, hand-held touchscreen/pen computer for data collection.

[Casio00b] (*)Casio Inc. "IT-2000 Data Collector User's Guide, 2000", CASIO Computer Deutschland, D-22848 Norderstedt, Germany, Dec 12 2000 Product information on IT-2000, hand-held touchscreen/pen computer for data collection. Refers to stroke keys (physical buttons) and touch keys (virtual buttons): virtual buttons can show multiple user-selectable keyboard layouts.

[CERT00] (*)CERT Cordination Center "Results of the Security In ActiveX Workshop", Security in ActiveX Workshop, Pittsburgh, Pennsylvania USA, August 22-23, 2000. Published at the CERT Coordination Center, Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA 15213, December 21, 2000 Review of ActiveX security problems and measures

[ChambersP00a] (*)Chambers, Peter and Wehunt, Omer Lem Jr. "Cache based scan matrix keyboard controller", United States Patent 6,040,788, March 21, 2000 Scan matrix keyboard that allows multiple keys to be pressed simultaneously an recognized (chord input). Rows are pulse signalled sequentially, column conductors sense when signals are detected from that particular column, thus scanning entire grid matrix. Key switch technology can be mechanical, electrical, or capacitive. Compare to Kaplow multitouch programmable keyboard/input device.

[ChanCF99a] (*)Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Touchpad Pen-Input and Mouse Controller", United States Patent 5,995,084, November 30, 1999 Tap, drag, tap-and-drag gestures on touchpad digitizer, with check for moving out of working area. Note: press-and-hold: tap-and-drag does *not* have a hold. Switches between pen-input and mouse-input mode. Refers to light pen. users.erols.com/rwservices/pens/biblio00.html

8/50

02.11.13


[ChanCF99b] (*)Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Touchpad Pen-Input Controller", United States Patent 5,883,622, March 16, 1999 Force/pressure sensing touchpad digitizer tablet using resistive film: compare with Elographics

[ChanCF99c] (*)Chan, Chow Fong; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Automatic Cursor Motion Control for a Touchpad Mouse", United States Patent 5,880,717, March 9, 1999 simulated velocity/momentum when scrolling when object moves outside/into work area boundary: compare with artificial reality project?

[ChanCF00a] (*)Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Touchpad Mouse Controller", United States Patent 6,057,830, May 2, 2000 Tap, drag, tap-and-drag gestures on touchpad digitizer, with check for moving out of working area. Note: press-and-hold: tap-and-drag does *not* have a hold.

[ChanCF00b] (*)Chan, Chow Fong; Maisy, Mun Lan Ng; Ong, Eng Yue; Geng, Xia; Lim, Swee Hock Alvin "Command Set for Touchpad PenInput Mouse", United States Patent 6,061,051, May 9, 2000 tap/click, move, press and drag gestures on touchpad/touchscreen digitizer. Uses two distance thresholds, time threshold also for establishing contact in press-and-hold gesture.

[ChewCH99a] (*)Chew, Chee Heng; Konzen, Neil; Guzak, Christopher J.; Laney, Stuart T.; Pitt, George H. III; Ellison-Taylor, Ian M. and Gery, Ron O. "System Provided Child Window Controls", United States Patent 5,889,522, March 30, 1999 UI Window controls: image lists, hot keys, hot key configuration. Specification includes verbatim excerpts from Microsoft documentation for Header Controls

[CHI00a] (*)CHI 2000 "Touchscreen Toggle Design - Slider", CHI posting, dated 2000/2001 Digitization of 1992 CHI demonstration Video of "Touchscreen Toggle Design"?

[Cirque99a] (*)Cirque Technology "GlidePoint: Advanced PCCompatible Features", www.cirque.com, 3 October 1999 Touchpad gestures: can move past edge by moving to edge, touchpad firmware holds position for three seconds to allow user to scroll/drag users.erols.com/rwservices/pens/biblio00.html

9/50

02.11.13


farther by stroking pad again.

[ComputingUnplugged99a] (*)Computing Unplugged "A first look at the Palm VII", Computing Unplugged, June 1, 1999 Palm VII PDA/cell/smartphone with touchscreen user interface: includes wireless web browsing

[CortopassiM99a] (*)Cortopassi, Michael; Gladwin, Christopher; and Voegeli, Derick W. "Resume on pen contact", United States Patent 5,974,558, October 26, 1999 Low-power mode on portable pen computer, passive stylus: monitors for stylus contact on touchscreen to wake device up from hibernation. Larger system has movable virtual on-screen keyboard, other GUI. Compare with PenPoint, Wang Freestyle?

[DAmicoVE99a] (*)D'Amico, Vincent E.; Gehrig, Jay J.; Surprenant, Joseph E.; and Robsky, Steven R. "Touchscreen Controller with Pen and/or Finger Inputs", United States Patent 5,956,020, September 21, 1999 Dual mode digitizer for finger input or stylus/pen input. Says "finger and pen", but only reports one, with pen/stylue getting priority. Includes built-in calibration for active area by touching two corner locations via controller commands. Capacitive film digitizer technology (refers to 4,198,539 for sensor details). Looks like MicroTouch TouchPen.

[DammCH00a] (*)Damm, Christan Heide; Hansen, Klaus Marius; and Thomsen, Michael "Tool Support for Cooperative Object-Oriented Design: Gesture Based Modeling on an Electronic Whiteboard", Proc. CHI 2000, April 2000, pp. 518-525 Knight tool: Gesture-based multi-user whiteboard user interface. Says unfortunately no multi-touch (single users must take turns) on prototype hardware (Smart Board), unlike Xerox Liveboard (Tivoli). Gestures include sketch recognition, e.g. UML rectangle objects. Context-dependent pie menus (marking menus) for large surface. "Radar window" shows small image of entire workspace drawing. Notes that Xerox Liveboard could accept multiple pen touches at the same time.

[DavisTR99] (*)Davis, Tom R. "Bibliography on Handwriting, natural, taught styles, copy-books", University of Birmingham, U.K. Shorthand, taught handwriting styles by education, single-stroke writing, Pittman

[DeFreitasSC99a] users.erols.com/rwservices/pens/biblio00.html

(*)DeFreitas,

Scott C. "Filling of graphical regions", 10/50

02.11.13


United States Patent 5,870,100, February 9, 1999 Rapid algorithm for flood fill of a region of same color (or other same attribute) of a pixel in the regiou.

[deIpina00] (*)de Ipina, Diego Lopez "Building Components for a Distributed Sentient Framework with Python and CORBA", Unknown conference proceedings, date approximate The title is odd, but the paper makes substantial references to 2D circular barcode (ringcode) tags, and inferring the approximate location, orientation, and identifier of the tags using optical scanning / visual processing. Compare with Sekendur.

[deJudicibusD99a] (*)de Judicibus, Dario and Albano, Gherardo "System and Method for Arranging Windows Displayed by a Graphical User Interface", United States Patent 5,874,962, February 23, 1999 Automatic placment of windows in graphical user interface, most important window largest in center with other windows radially around. Orientation / rotation?

[DitzikRJ99a] (*)Ditzik, Richard J. "Modular notebook and PDA computer systems for personal computing and wireless communications", United States Patent 5,983,073, November 9, 1999 Electronic notebook/PDA/smartphone, stylus/touchscreen, clamshell/convertible/detachable display, wireless networking, video

[DrobneS99] (*)Drobne, Samo "Prenosno in Terenski Racunalnistvo", Master's Thesis in spatial planning, University of Ljubljana, Faculty of Civil and Geodetic Engineering, 1999 Contains examples of gestures: spiral, dash/flick, square. Example of circle/lasso gestures from Handwriter for Windows by CIC Communication Intelligence Corporation, Pen Windows / Pen Extensions, Windows CE, Fujitsu 2300 pen computer

[DruinJ00a] (*)Druin et al "KidPad: A collaborative storytelling environment for children (Video demonstration)", Univ. of Maryland Human-Computer Interaction Lab, 2000 Video demonstration of KidPad: See other references.

[DuSS99a] (*)Du, Sterling S. and Lee, Yung-Yu Joe "Touch-pad Digital Computer Pointing Device", United States Patent 5,856,822, January 4, 1999 Touchscreen/touchpad device using multiple finger contacts: second finger contact is in a separate sensing area. When user moves finger rapidly users.erols.com/rwservices/pens/biblio00.html

11/50

02.11.13


above a speed hreshold, ouchpad sends idfferent data (e.g. it scrolls faster, or enters a power-scroll mode) to compensate for some of the limitations of a small touchscreen on a portablet device. When nothing is touching, device automatically adjusts to ambient environment.

[DulbergM99a] (*)Dulberg, Martin S.; St. Amant, Robert; and Zettlemoyer, Luke S. "An Imprecise Mouse Gesture for the Fast Activation of Controls", Proc. INTERACT '99, eight pages Mouse click and drag-and-drop gestures with mouse flick gestures: minimum number of pixels movement to distinguish mouse clicks from flicks, velocity threshold for flick and drag: mentions that with stylus selection should be on touch-down, contrasted to mouse on mouse-up event. Note: press-and-hold: threshhold, equivalent to tap threshhold, velocity to other threshhold.

[Dynapro99a] (*)Dynapro Systems Inc. "Dynapro SC4 Touch Screen Controller User's Guide", Dynapro Systems Inc, Copyright 199. www.dynapro.com Electrostatic/capacitive touchscreen digitizer with eigh-wire resistive touch screen, silver ink as conductor at sides, to overcome resistance changes and drift due to aging and wear, ratio-metric conversion ofr A/D converter output.

[Dynapro00a] (*)Dynapro Systems Inc. "Dynapro NFI Near Field Imaging Touch Screen System", Dynapro Systems Inc, Copyright 2000. www.dynapro.com Electrostatic/capacitive touchscreen digitizer with patterned conductive sensor (grid matrix?)

[Elbaum99] (*)Elbaum, Sebasian and Munson, John C. "Intrusion Detection through Dynamic Software Measurement", USENIX Workshop on Intrusion Detection and Network Monitoring, April 1999, pp 41-50 Disallowed Operational Anomaly system: dynamic modeling of program behavior using execution path patterns, deny operation when program behavior diverges from learned patterns. Technical reference for Cylant.com, intrusion detection contrasted to signatures for files or SNORT network patterns

[Em00a] 2000

(*)Em,

Davic "Fujitsu Stylistic 3400", byte.com, August 18,

Pen tablet computer: not Tablet PC, uses CIC PenX handwritingrecognition software (trainable), with on-screen soft keyboard. Runs modified Windows 9X / Windows98 OS users.erols.com/rwservices/pens/biblio00.html

12/50

02.11.13


[Em00b] (*)Em, Davic "Invasions of the Pen Computers, Part I", byte.com, August 18, 2000 Pen tablet computers: not Tablet PC, mostly Windows 95 / Windows98. Aqcess Technologies QBE tablet computer.

[FingerWorks00a] (*)Fingerworks Inc. "FingerWorks - Inventor and Developer of MultiTouch Technology", Fingerworks.com, fetched Aug 17, 2000 Image of multitouch input of hand from FingerWorks input tablet Additional information in paper file

[Fishkin00] (*)Fishkin, Kenneth P.; Goldberg, David; Gujar, Anuj Uday; Harrison, Beverly L.; Mynatt, Elizabeth D; Stone, Maureen C; and Want, Roy "Zoomorphic Computer User Interface", United States Patent 6,160,540, December 12, 2000 Electronic teddy bear with various computer interactive technologies: specifically mentions tablet computer and gestures (e.g. shake) European patent also on file: same Goldberg of Unistroke

[FitzmauriceGW99a] (*)Fitzmaurice, George W.; Balakrishnan, Ravin; Kurtenbach, Gordon; and Buxton, Bill "An Exploration into Supporting Artwork Orientation in the User Interface", Proc. CHI 99, May 1999, pp 167-174 For drawing/sketching, permit user to turn or rotate touchscreen or pencomputer display, automagically rotate orientation of menus, pop-ups, and UI to keep correction orientation to user.

[FitzmauriceG99b] (*)Fitzmaurice, G. and Buxton, W. "Temporal data control system", United States Patent 5,973,669, Oct. 26, 1999 "Scrubwheel": mouse with a rotational control, so that it can both be positioned (to select something, such as which video clip) and rotated (as a knob to control speed of rendering) See also http://www.billbuxton.com

[FleckDC00a] (*)Fleck, David C. "Digitizer system with cursor shape changing as a function of pointer", United States Patent 6,160,539, December 12, 2000 Change cursor on display depending on which area of a menu strip on separate tablet a stylus is hovering over in proximity.

[Fonix99] (*)Fonix Corporation "Fonix and Lucent Technologies Inferno Software Solutions To Offer Fonix Handwriting Recongition Software to Information Appliance Market", Lucent Technologies Shows graffitt-like unistroke character recognition, including unistroke "X" users.erols.com/rwservices/pens/biblio00.html

13/50

02.11.13


and German "Sharp-S". Mentions Inferno Operatin System

[Forcier99] (*)Forcier, Mitchell D. "Script Character Processing Method and System with Bit-Mapped Document Editing", United States Patent 5,953,735, September 14, 1999 Editing of handwriting/electronic ink without recognition of characters Editing of electronic ink: word-wrap, inserting spaces, editing of handwritten lines of text. Compare with van Raamsdonk? Press reports from 1999 of Forcier accusing Microsoft of patent infringement for electronic ink editing

[ForestDK99a] (*)Forest, Donald K. "User interface method and appraratus", United States Patent 6,005,549, December 21, 1999 Perimeter menus for entering ideographcs on a touchscreen (or other pointing device, mouse, head-mouse for handicapped, etc.) for entering Chinese or other ideographic characters, or for speech generator input for motor handicapped. Items may be selected by a dwell time (press-andhold), then move to sub-menu (which may be displayed). Show a visual indicator (brightness) in menu item on screen of how much dwell time is remaining. Discontinuous dwell time (aggregate dwell) for users who have hand tremors. Also different dwell time thresholds for different keys. Compare with marking menus. Numerous references to dwell time (press-and-hold) in computer accessibility (e.g. HeadMouse), in addition to touchscreens.

[ForestDK00a] (*)Forest, Donald K. "Dwell Time Indication Method and Apparatus", United States Patent 6,160,536, December 12, 2000 Perimeter menus for entering ideographcs on a touchscreen (or other pointing device, mouse, head-mouse for handicapped, etc.) for entering Chinese or other ideographic characters, or for speech generator input for motor handicapped. Items may be selected by a dwell time (press-andhold), then move to sub-menu (which may be displayed). Show a visual indicator (brightness) in menu item on screen of how much dwell time is remaining. Discontinuous dwell time (aggregate dwell) for users who have hand tremors. Also different dwell time thresholds for different keys. Compare with marking menus.

[ForresterJE00a] (*)Forrester, Justin E. and Miller, Barton P. "An Empirical Study of the Robustness of Windows NT Applications Using Random Testing", Proc. 4th USENIX Windows System Symposium, August 2000, Seattle Washington Fuzz-testing (random keyboard and mouse inputs) crashes or causes to fail most Windows NT application. Continuation of similar work done on Unix in users.erols.com/rwservices/pens/biblio00.html

14/50

02.11.13


the 1990s, that few programmers write software that check input for plausibility, so unanticipated inputs cause failure.

[FranczekEJ99a] (*)Franczek, Edward J; Bretscher, John Thomas; and Bennett, Ramond Walden III "Computer Virus Screening Methods and Systems", United States Patent 5,987,610, November 16, 1999 Scan data sent between two parties on telephone lines for a virus and block part of the data from being transmitted. Executing program that would be transmitted in a model of the receiving computer to detect virus before transmitting data.

[FreeSoftwareFoundation00a] (*)Free Software Founcation "Drag Start Distance", http://140.116.2.3/Linux/CLE/CLE/devel/andrew/redhat/BUILD/kdei18n/eo/messages/kdebase/kcminput.po Documentation of Drag Start Distance in open-source software. press-andhold-and-drag distance. File contains additional discussion references to Drag Start Distance in KDE and other open-source software related to Linux O.S.

[Freund99] (*)Freund, Gregor "System and Methodology for Managing Internet Access on a Per Application Basis for Client Computers Connected to the Internet", United States Patent 5,987,611, November 16 1999 Zone Labs: per-application firewall. Mentions intercepting process loading (via kernel hooks?) and checking application details, such as components, version, checksum. Not adaptvie, rule-based.

[FrinkL99a] (*)Frink, Lloyd and Bishop, Bryon Dean "Method and System for Data Entry of Handwritten Symbols", United States Patent 5,946,406, August 31, 1999 Pen Windows emulation of keyboard input by placing invisible transparent handwriting input window pen-palette over text-entry field, user perception is that writing is directly into the underlying text-entry field. Mouse-hook function detected stylus touch (WM_LBUTTONDOWN) in text field to start. Note: Feature appeared to be less prevalent in later versions of Pen Windows.

[FuruhataT99a] (*)Furuhata, Tomotake; Hirano, Toshiki; and Sawada, Chihiro "Touch panel double-touch input method and detection apparatus", United States Patent 5,943,043, August 24, 1999 Detect multi-touch (double-touch gesture by two fingers) on resistive or other digitizer by noting shift in position from tap by second finger, then users.erols.com/rwservices/pens/biblio00.html

15/50

02.11.13


position of first finger returning after 2nd finger's tap.

[Gadgeteer99a] (*)The Gadgeteer "Palm VII Review", The Gadgeteer, August 29, 1999. Available at the-gadgeteer.com, 2013 Review of Palm Pilot VII pen/stylus handheld PDA. Includes wireless antenna communications for access to portions of internet via "Web Clipping", wireless email.

[GastonKR99a] (*)Gaston, Kerry R. "Electronic Book System", United States patent 6,956,048, September 21, 1999 Electronic book, with docking/charging station for downloading books. Touch input screen for making notes on displayed text or in margin, copy/digital-rights-management protection. Includes video.

[GeigerFJ00a] (*)Geiger, Fred J.; Wood, William K.; and Tandon, Sonjaya T. "Automated Post Office Based Rule Analysis of E-Mail Messages and Other Data Objects for Controlled Distribution in Network Environments", United States patent 6,073,142, June 6, 2000 Spam filtering using distributed post offices / mail servers/gateways, which may apply different business/filtering rules.

[GelsingerPP99a] (*)Icras, Inc. "Method for assisting window selection in a graphical user interface", United States Patent 5,892,511, April 6, 1999 Translucent windows in GUI so that you can see what is underneath.

[GeneralMagic00a] (*)Icras, Inc. "Using Magic Cap: Magic Cap 3.1. The User's Guide for the DataRover 840", General Magic, 2000 Full user guide for DataRover 840 stylus-input PDA, using resistive touchscreen digitizer and stylus. Pop-up virtual keyboard. Electronic ink data annotations and drawing, no handwriting recognition. Numerous screen shots of user interface shows simulated office rooms and objects: compare with Windows "Bob"?

[GeneralMagic00b] (*)Icras, Inc. "Magic Cap 3.1 User Interface Specification", General Magic/Icras, 2000 General Magic UI and operating system for tablet/pen computers: Includes flip orientation to rotate screen 180 degrees for left-handed users.

[GeneralMagic00d] (*)Icras, Inc. "Design and Magic Cap: Magic Cap SDK for Windows", General Magic/Icras, 2000 General Magic desktop is picture of desktop with office object: filing cabinet, rollodex, printer, fax, calendar, etc. Compare with Microsoft "Bob".

[GeneralMagic00e] users.erols.com/rwservices/pens/biblio00.html

(*)Icras,

Inc. "MagicSDK Package Dev Guide, 16/50

02.11.13


version 3.1 "Rosemary"", General Magic/Icras, 2000 General Magic development: views are rotatable and flippable in 8 orientations.

[GeneralMagic00f] (*)Icras, Inc. "MagicSDK Tutorial for Microsoft Windows - Simulator", General Magic/Icras, 2000 General Magic development: SDK/IDE with windows-based simulator for General Magic pen PDAs

[GerpheideGE99a] (*)Gerpheide, George E. "Method and Apparatus for Data Input", United States Patent 5,861,875, January 19, 1999 Capacitive digitizer using X/Y matrix grid, interpolation between lines.

[GersheneldN99a] (*)Gershendel, Neil; Zimmerman, Thomas; Allport, David "Non-contact System for Sensing and Signalling by Externally Induced intra-body currents", United States Patent 5,914,701 June 22, 1999 Capacitive/electrostatic (quasi-electrostatic) signalling through human body. Transmission of signals from devices of one user to devices of another user then shaking hands/in contact. Multiple devices/transmitters can share by using different spread-spectrum pseudo-random codes for signalling. One hand and two-hand (multi-touch) gestures, detect X/Y or 3D position of hands from signals received by receivers on edges of display. If transmitter also display, user touches transmitter with one hand, points/gestures with other.

[Gladstone99] (*)Gladstone, Kat, and Haber, Andrew S. "Licensing opportunity for technology which may be of interest", [email protected] Discussion List, Sep 29, 1999 posting of information on US Patent 5,018,208, "Input Device for Dynamic Signature Verification". Mentions use as a biometric automobile lock, with the benefit that neuromotor effects on handwriting variability would prevent drunk drivers from using their car. Contact information is Kate Gladstone Handwriting Repair, Albany, NY

[GillespieD99a] (*)Gillespie, David; Allen, Timothy P.; and Ferrucci, Aaron T. "Pressure Sensitive Scrollbar Feature", United States Patent 5,889,236, March 30, 1999 Capacitive touchscreen using X/Y grid, compute centroid (interpolation) of object in proximity or touching the touchscreen. Has particular algorithm for detecting tap and drag gestures. Refers briefly to multi-finger gestures because entire grid is measured, (and multiple centroids could be detected?) Scrolling speed faster if more pressure (force). users.erols.com/rwservices/pens/biblio00.html

17/50

02.11.13


[Goff99] (*)Goff, Leslie "The S/360 Learning Process", ComputerWorld, Lineline News, 4/19/99, http://careers.computerworld.com/home/news.nsf/all/9904191964 Lists members of the GRAIL project at the RAND Corporation: Bill Sibley, Tom Ellis, Gabe Groner (Groener?), Mal Davis Describes deficiencies of IBM S/360 interrupt processing, and TCBs / Task Control Blocks, to capture electronic ink in real time

[GoughML00a] (*)Gough, Michael L.; MacDougald, Joseph J.; Venolia, Daniel S.; Gilley, Thomas S.; Robbins, Greg M.; Hansen, Daniel J. Jr.; and Oswal, Abhay "Method and apparatus for providing translucent images on a computer display", United States Patent 6,072,489, January 6, 2000 Updating a translucent/semi-transparent window

[GreggLE99a] (*)Gregg, Leon Edward; Haugh, Julianne France; and Jaaskelainen, William Jr. "Hardware-selectable Mouse Movement", United States Patent 5,963,195, October 5, 1999 Mouse pointer with two rotary wheel adjusters built-in to set X and Y scale/gain for mouse motion/accelleration, separate from whether OS or application allows for adjusting any mouse-movement parameters

[HarrisDR99a] (*)Harris, Daryl R.; Williams, Daniel L.; and Walczak, Thomas J. "Hand-held radiotelephone having a detachable display", United States Patent 6,009,336, December 28, 1999 Smartphone/radiotelephone with video camera and display: display is detachable so that usr can speak privately with rest of the phone.

[HeinerJM99a] (*)Heiner, Jeremy M.; Hudson, Scott E.; and Tanaka, Kenichiro "Linking and Messaging from Real Paper in the Paper PDA", Proc. UIST '99, Asheville, NC. pp.179-186 Paper PDA: paper can be used as PDA for information management by scanning in pages of paper, archiving/indexing/processing electronically, and printing out new copy. StickerLink: on-paper hyperlinking using paper stickers with URLs. Paper includes circular registration/identification marks: Compare with Sekendur. Email by scanning, doing handwriting recognition on address field. Compare with Anoto note-taking applications, Slate PenScheduler Daytimer application.

[HinckleyK99a] (*)Hinckley, Ken and Sinclair, Mike "Touch-Sensing Input Devices", Proc. CHI '99 Touch Trackball, Scrolling Touchmouse: used to change UI depending on what user is doing with devices. Mentions tap-and-hold / press-and-hold. users.erols.com/rwservices/pens/biblio00.html

18/50

02.11.13


[HinckleyK00a] (*)Hinckley, Ken; Pierce, Jeff; Sinclair, Mike, and Horvitz, Eric "Sensing Techniques for Mobile Interaction", Proc. UIST '00, San Diego, CA, pp. 91-100 Add capacitive touchscreen sensor to Cassiopeia E105 Palm-sized PC, and second touch sensor for bezel. User can touch bezel for full-screen display.

[Hong00] (*)Hong, Jason I. and Landay, James A. "SATIN: A Toolkit for Informal Ink-based Applications", Proc. ACM UIST 2000, San Diego California Also mentions DENIM, sketch-based web site design tool using pen input. Makes comparisons with NewtonOS, Windows for Pen Computing, PenPoint. Describes sketch editing, and stroke simplification, examples are all the straightening of free-hand line segments in sketches and in characters. Discusses press-and-hold (tap and hold) in Newton for select. (hold-and-select)

[HorvitzEJ00a] (*)Horvitz, Eric J.; Markley, Michael E.; and Sonntag, Martin L. "Method and system for transforming the geometrical shape of a display window for a computer system", United States Patent 6,016,145, January 18, 2000 User interface GUI for displaying non-main windows in 3D perspective on the sides, as if they were walls in a room. One advantage is more windows can be seen by user for context. Trapezoidal projection simulating rotation out of the plane of the display. Cursor also resized to simulate distance.

[HorvitzEJ00b] (*)Horvitz, Eric J.; Markley, Michael E.; and Sonntag, Martin L. "System and method for resizing an input position indicator for a user interface of a computer system", United States Patent 6,023,275, February 8, 2000 User interface GUI for displaying non-main windows in 3D perspective on the sides, as if they were walls in a room. Also shows circular cycloramastyle wall, rather than room-type walls. Also projection of windows to the "floor". Trapezoidal projection simulating rotation out of the plane of the display. Cursor also resized to simulate distance.

[Hu00??] (*)Hu, Jianying, Brown, Michael K., and Turin, William "Use of Segmental Features in HMM Based Handwriting Recognition", (reference not known: conference proceedings?) Stochastic pattern recognizer, Hidden Markov Model (HMM) URL as of 5/9/2002: http://www.research.avayalabs.com/user/jianhu/index.html users.erols.com/rwservices/pens/biblio00.html

19/50

02.11.13


States that using a sliding window in a recognizer reduces error rate by 50%, but does not give the point of comparison, or the description of how the error was computed (false positive, false negative, etc.)

[HUSAT00] (*)HUSAT "HUSAT: Background to the Institute", Presentation at Human Factors 2000 Symposium: Human Sciences and Advanced Technology at Loughborough University, U.K. HUSAT presentation human factors in user-interface technologies: history to Dimond Styalator and RAND Tablet: speech and handwriting seem natural to humans, but may not be most natural for humans interacting with machines States that using a sliding window in a recognizer reduces error rate by 50%, but does not give the point of comparison, or the description of how the error was computed (false positive, false negative, etc.) URL as of 2002: www.lboro.ac.uk/research/husat/news/proj/jn_presentation.html

[iDial00a] (*)iDial Networks, Inc. "iDial Announces First Wireless Phone to Phone Access Service for Palm VII", Business Wire, March 27, 2000 VOIP internet network phone service on Palm VII using NetPhoneCard

[IDEO99a] (*)Ideo, Inc. "IDEO Eye Module User's Manual for Palm Pilot", Ideo, Inc. 1999 Third-party camera hardware module for Palm PDAs, plugs into expansion slot, PDA becomes a hand-held camera with display screen.

[IgarashiT99a] (*)Igarashi, Takeo; Matsuoka, Satoshi; and Tanaka, Hidehiko "Teddy: A sketching interface for 3d freeform design", Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, pages 409-416, August 1999 Sketch recognition, drawing program converts rough lines to splined/mesh during drawing, for sketching 3D three dimensional images such as cartoons. Cites to Zeleznik, Landay. Cited in Arvo00

[IgarashiT99b] (*)Igarashi, Takeo "Freeform User Interfaces for Graphical Computing", Doctoral dissertation, Graduate School of Information Engineering, University of Tokyo, December 1999 Sketch-based editing of freehand drawing: dragging and pulling operations on lines and line segments: stroke-based architecture for electronic whiteboards. Refers to "predictive drawing" for sketch editing/editor. Cites Unistroke character recognition, Cirrin and Quickwriting zone-based menu picking, mentions learning problem for gestures (see Greanias?)

[Immersion00a] users.erols.com/rwservices/pens/biblio00.html

(*)Immersion

Inc. "MicroScribe 3D Desktop Digitizing 20/50

02.11.13


Systems: User's Guide and Set-up Instructions", Immersion Corporation, San Jose, CA, 2000 Pantographic/mechanical 3D digitizer system. Primarily used for digitizing solid objects, medical modeling: no force feedback/haptic output

[Intermec00a] (*)Intermec Technologies Corporation "6642 Pen Computer Technical Reference", Intermec Technologies Corporation, Cedar Rapids Indiana, 2000 Pen computer using Windows 95 for Pen Computing / PenWindows 2.0: Pen Services 2.0, running on Windows 98 (later than Windows 95). "Lens" field for enabling text buttons in input fields. Adjustable area/distance for double-tap distance. Pen Recognition services include also CIC PenX Recognition. Shows gesture macro editor for assigning macros to PenWindows (1.0?) circle gestures consisting of circled letters: compare to Recognition macros of Pencept PenPad series. Toolbar option for right mouse click: compare to Wang "Guide". PenX include Recognition Tuner to allow user to select which supported shapes appear in user's writing style, but not to train recognizer. Compare to recognizer in PalmOS for selection of shape prototypes. ActiveX Pen Controls, PenWindows 2.0 pop-up virtual keyboard from Start/Programs/Pen Services. Document is in two portions.

[Intermec00b] (*)Intermec Technologies Corporation "PenKey 6200 6300 Hand-Held Computer Programmer's Reference Guide", Intermec Technologies Corporation, Cedar Rapids Indiana, 2000 Pen computer using Windows 95 for Pen Computing / PenWindows 2.0. Includes definitions of SYSTEM.INI and WINDOWS.INI for Windows 3.1 to enable Windows for Pen Computing: pkrotate.drv

[JaegerS99a] (*)Jaeger, Stefan "Recovering Dynamic Information from Static, Handwritten Word Images", Abstract only: PhD Thesis, http://isl.ira.uka.de/ISL.publications.html#phd Describes attempt to re-construct dynamic information of on-line handwriting recognition from off-line static images: mentions Traveling Salesman Problem as part of algorithm. Abstract says this would allow merging of recognition methods between offline and on-line algorithms, but does not mention any results Full text of thesis (at end) says they do not deal with pen-lifts or segmentation, assume one character at a time

[JaegerS00a] (*)Jaeger, S., Manke, S, and Waibel, A. "NPEN++: An On-Line Handwriting Recognition System", 7th International Workshop on Frontiers in Handwriting Recongition, Amsterdam 2000, page 249users.erols.com/rwservices/pens/biblio00.html

21/50

02.11.13


260 handwriting recognition: Mentions normalizing size, inclination, and rotation; computing baselines; also refers to general problem of resampling to make points equidistant in space, and Bezier interpolation of "missing" points; Note: removes delayed strokes (e.g. crossing of a "T"). Compare with elastic matching by Tappert?

[JaegerS00b] (*)Jaeger, S., Manke, S, Reichert, J., and Waibel, A. "On-Line Handwriting Recognition: The NPen++ Recognizer", International Journal on Document Analysis and Recognition, IJDAR'00, volume 3 No 3, p. 169-180, 2000 Handwriting recognition using very large word dictionary: claims 91.2% recognition rate using 50000 word dictionary: tree-pruning to avoid exhaustive search

[JensenD99a] (*)Jenasen, Del "Textured tile Rotation System and Method", United States Patent 5,956,043, September 21, 1999 Altorithm for rotating (tiled) texture patern when an object is rotated, so that there are no breaks in the texture when you try to do it with horizontal tiling of a supertile in the rotated image/object.

[KamelHM00a] (*)Kamel, Hesham M. and Landay, James A. "A Study of Blind Drawing Practice: Creating Graphical Information Without the Visual Channel", Proc. ASSETS 2000, Arlington VA pp. 34-41 Visual impaired / low vision / blind can draw, but need tactile feedback to do it in a computer user interface. Grid-based model to provide audio (speech) feedback on position and features.

[KangBH99a] (*)Kang, Beng Hong; Yeung, Chun Wun; Tedja, Eswin; and Tan, Jin-Meng "Dual Orientation display Handheld Computer Devices", United States Patent 5,949,408, September 7, 1999 HP OmniGo HP95a: Screen image rotation (portrait/landscape orientation) in a handheld PDA by interchanging row and column lines.

[KangBHA00a] (*)Kang, Beng Hong Alex; and Chung, Sun-Woo "Method for providing a cue in a computer system", United States Patent 6,160,555, December 12, 2000 Handwriting recognition user interface: show different cursors (alpha/num/upper-case/etc.) in text entry before user writes, so that user only need to look at one place to see both mode and text cursor position. Note: separate writing and text area, not direct text input / direct manipulation. users.erols.com/rwservices/pens/biblio00.html

22/50

02.11.13


[KanoS99a] (*)Kano, Shigeru; Nakada, Yasuhiro; and Usuda, Yutaka "Automated recognition of and distinction among graphics input text input and editing commands in a pen based computer", United States Patent 6,913,221, June 15, 1999 Gesture/sketch/text pen-computer user interface on graphics tablet, automatically classify recognition based on priorities of recognizers. Compare with W4PC?

[KatsurahiraY99a] (*)Katsurahira, Yuji and Sekizawa, Yasushi "Position Detecting Apparatus and Method for Detecting Position Pointing Device", United States Patent 6,005,555, December 21, 1999 Electromagnetic grid digitizer tablet, signal from tablet causes multiple pens or objects to resonate ad different prequences, simultaneous detection of distinct pointing devices (multi-touch)

[KavehC99a] (*)Kaveh, Chris "Fujitsu Pen Developer's Guide for Windows", Fujitsu Personal Systems Inc., May 1999 Programming guide for Pen computing on Windows platforms: post-PenWindows. PenRight! controls, Visual Basic 4.0 and 5.0, PowerSoft Powerbuilder, VBX Pen Edit controls, (16-bit and 32-bit), 32-Bit Pen API, Pen-aware and pen-unaware applications, CIC InkTools for handwriting recognition for Windows. Microsoft Pen Extensions 1.0 for Windows 3.1, Microsoft Pen Services 2.0 for Windows95, CIC PenX for Windows NT.

[KawakamiM99a] (*)Kawakami, Masahiko; Mamiya, Masaru; Nishiki, Tomonori; Tsuii, Yoshitaka; Okamoto, Akito; Fuita, Toshihiro "A New Concept Touch-Sensitive Display Enabling Vibro-Tactile Feedback", Proc. HCI '98 on People and Computers XIII, pp. 303-312 Vibration Touch: tactile haptic feedback, both click and vibration. Different vibration patterns for different operations (vibrate, one-shot click, pull-down slow click) via solenoid mount in touchscreen.

[KayA00] (*)Kay, Alan "Character recognition", Posting to SQUEAK Mailing List November 5 2005, archived at http://lists.squeakfoundation.org Commentary on Goldberg Unistroke patent case: asserts that much of handwriting recognition technology prior art was done in 1960's, not known to U.S. Patent Office. Cites GRAIL system by Groner as Unistroke recognition: mentions QuikWriting and Ledeen recognizer

[KentJ99a] (*)Kent, Joel "Acoustic condition sensor employing a plurality of mutually non-orthogonal waves", United States Patent users.erols.com/rwservices/pens/biblio00.html

23/50

02.11.13


5,986,224, November 16, 1999 Acoustic surface (shear?) wave touchscreen, waves are sent diagonally or along non-orthogonal axes, e.g. three 60-degree axes. May use angled reflectors in edge transducers or sensors. Thus can discriminate multipletouches both for ambiguity, or reliable multi-touch input.

[KimH99a] (*)Kim, H.; Gilmore, C.M.; Pique, A.; Horwitz, J.S.; Mattoussi, H.; Murata, H.; Kafafi, Z.H.; and Chrisey, D.B. "Electrical, optical, and structural properties of indium-tin-oxide (ITO) thin films for organic light-emitting devices", Journal of Applied Physics, Vol 86, No 11, 1 Dec. 1999, pp. 6451-6461 ITO deposited on glass by vapor deposition, controlling for electrical and optical properties: optical transmission, reflectance, refractive index, band gap (color/tint).

[Kinrot00] (*)Kinrot, Opher; Kinrot, Uri "Interferometry: Encoder measures motion through interferometry", Laser Focus World, March 2000 Optical Translation Measurement, motion detection, basis for OTM Technologies optical digitizer pen, development by GOU Lite Ltd for coherent encodeds for one-two- or three-dimensional motion (stepper motor? servomotor? See Teledyne/TAC file)

[KnowltonKC99a] (*)Knowlton, Kenneth Charles and Miliefsky, Gary Steven "System for the Capture and Indexing of Graphical Representations of Files, Information Sources and the Like", United States Patent 5,973,692, October 26, 1999 User-interface linking of graphical areas on one display to graphical areas in another display

[KobayashiF99a] (*)Kobayashi, Fumiyuki "Alteration of the orientation of data on a display / Portable terminal device capable of controlling direction of screen display on display", GB Patent GB2331204A, Australian Patent Application AU 199891322B2, 1999 Handheld device with touchscreen or smartphone rotates display landscape/portrait based on pressure sensors indicating how it is being held in the hand.

[KoikeH00a] (*)Koike, Hideki; Sato, Yoichi; Kobayashi, Yshinori; Tobia, Hiroaki; Kobayashi, Motoki "Interactive Textbook and Interactive Venn Diagram: Natural and Intuitive Interfaces on Augmented Desk System", Proc. CHI '2000, Den Haag, Amsterdam, pp. 121-128 Optical tablet sensing for digital desk: describes template matching for users.erols.com/rwservices/pens/biblio00.html

24/50

02.11.13


detecting multiple fingertips and hand for multitouch.

[KortuemG99a] (*)Kortuem, Gerd; Bauer, Martin; and Segall, Zary "NETMAN: The design of a collaborative wearable computer system", Mobile Networks and Applications, Vol 4, pp. 49-58, 1999 Wearable computer with video conference communication between field technicians, with speaker phone, or field technician and remote advistor/expert.

[KrivopalB99a] (*)Krivopal, Boris "Pressure Sensitive Ink Means and Methods of User", United States Patent 5,989,700, November 23, 1999 Pressure-sensitive conductive rubber: semiconductor particles in elastic, organic polymer binder: assigned to Tekscan

[KrugerJ99] (*)Kruger, Justin "Unskilled and Unaware of It: How Difficulties in Recognizing One's Own Incompetence Lead to Inflated Self-Assessments", Journal of Personality and Social Psychology, December 1999 Vol. 77 No 6, pp 1121-1134 Self-evaluation of success/skill: subjects who know more or are more skilled, recognize their own performance more conservatively than lowskilled subjects. To paraphrase: a real expert will be more cautious in claiming to know exactly what is going on, because the real expert knows about the additional factors that may come into play, and what complex interactions can happen. Whereas a person who knows less will be more likely think they have it all figured out, because that person does not know about the other things they should include in their thinking, or that there might be additional ways they could interact.

[Kurtenbach99a] (*)Kurtenbach, Gordon P. "Display and Control of Menus with Radial and Linear Portions", United States Patent 5,926,179, July 20, 1999 Marking menus: pen-still (press-and-hold) gesture brings up menu. Flick gesture involves command without pop-up menu. Detects press-and-hold with movement and time-out thresholds.

[Kurtenbach99b] (*)Kurtenbach, Gordon; Fitzmaurice, George W.; Owen, Russel N.; Baudel, Thomas "The Hotbox: Efficient Access to a large Number of Menu-items", Proc. CHI '97, Pittsburgh USA, pp 231239 Large menus by combining menubar, accelerator keys, modal dialog, popup menus, radial/pie marking menus, and menubars

[LaGrangeGW99a] users.erols.com/rwservices/pens/biblio00.html

(*)La

Grange, George W.; Gerpheide, George E.; 25/50

02.11.13


Woolley, Richard D.; Donohue, Tom; and Layton, Mike "Computer input stylus method and apparatus", United States Patent 5,914,708, June 22, 1999 Passive stylus for capacitive touchscreen using transcapacitance: conductive foam on tip of stylus increases capacitive effect by deforming to cover more area.

[Lallican00] (*)Lallican, P.M.; Viard-Gaudin, C.; and Knerr, S. "From Off-Line to On-Line HandWriting Recognition", International Workshop on Frontiers in Handwriting Recognition, IWFHR2000, September 2000, Amsterdam, Netherlands, pp 303-312 On-line works better than off-line, so simulate stroke order (and direction of strokes?) to recover time-order of the handwriting. See also VisionObjects commercial development.

[LambertB00a] (*)Lambert, Brian "System and Method for changing the rotational orientation of display data", International Patent Application WO 00/68766, November 16, 2000 On laptop or touchscreen computer, rotate windows of a given application for landscape/portrait orientation, but other applications can stay in the orientation best suited for that particular application.

[LandonP00a] (*)Landon, P.; Keates, S.; Clarkson, P.J.; and Robinson, P. "Using haptic feedback to enhance computer interaction for motionimpaired users", Proc. 3rd Intl Conf. Disability, Virtual Reality & Assoc. Tech., Alghero, Italy 2000, pp. 25-32 For motion-handicapped users (cerebral palsy), vibrotactile/vibrating haptic feedback not helpful, but force-feedback feedback is. Feedback prototypes use Immersion Technologies and SenseAble Technologies devices.

[Lang99] (*)Lang "GO Alumni Directory", www.apocalypse.org (no longer available) List of Alumni from GO Corporation: partial copy, original list no longer available

[LCS/Telegraphics00] (*)LCS/Telegraphics "Wintab Advanced Pointing Device Management for Windowed Environments", LCS/Telegraphics, Cambridge Massachusetts, July 28, 2000 Background information on WinTab specification, originated at 1991 Autodesk conference to define vendor-neutral device driver specification for digitizing tablets

[LeganchukA99a] users.erols.com/rwservices/pens/biblio00.html

(*)Leganchuck,

Andrea; Zhai, Shumin; and Buxton, 26/50

02.11.13


William "Manual and Cognitive Benefits of Two-Handed Input: An Experimental Study", ACM Trans. on Computer-Human Interaction, Vol 5, No 4, December, 1998, pp. 326-359 Multiple-hand / multiple-touch user interface study: using two hands allows simultanous manipulation of scale and zoom and position, versus one hand with menu/tool selection. WACOM two-stylus (puck and stylus) tablet used in study prototype.

[LewisJR99a] (*)Lewis, James R.; Allard, David J.; and Hudson, Harold D. "Predictive Keyboard Design Study: Effects of Word Populations, Number of Displayed Letters, and Number of Transitional Probability Tables", Proc. of Human Factors and Ergonomics Society 43rd Anuual Meeting, 1999, pp 429-432 Study of virtual predicive keyboard of IBM Simon marketed by BellSouth: text used for vocabulary/probability tables should be adaptive, or at least should reflect vocabulaor of user application.

[LewisC99a] (*)Lewis, Chris "Cisco TCP/IP Routing Professional Reference, Second Edition", McGraw-Hill, 1999 TCP/IP reference for Cisco products. Includes internetworking with IPv6

[LewisJR99b] (*)Lewis, James R. "Input Rates and User Preference for Three Small-screen Input Methods: Standard Keyboard, Predictive Keyboard, and Handwriting", Proc. of Human Factors and Ergonomics Society 43rd Anuual Meeting, 1999, pp 425-428 Study of virtual predicive keyboard of IBM Simon marketed by BellSouth: showed that standard keyboard, even small, was faster than either predictive keyboard or handwriting. Cites that fast handwriting is about 25 wpm words per minute. Did not study graffiti/unistrokes or other later methods, but disadvantages were attributed to congnitive load of unfamiliar/unpracticed data input skill compared to standard keyboard.

[LiY00a] (*)Li, Yang; Guan, Zhiwei; Chen, Youdi; Dai, Guozhong "Penbuilder: Platform for the Development of Pen-Based User Interface", Proc. ICMI 00 Third Int'. Conf. on Advances in Multimodal Interfaces, pp 534..541 Pen-Book-Page-Paper stylus UI system for mobile systems, with universal gestures: research prototype in China. Cites Wintab. Partial copy

[LifchitzA00] (*)Lifchitz, Alain and Maire, Frederic "A Fast Lexically Constrained Viterbi Algorithm for On-line Handwriting Recognition", 7th International Workshop on Frontiers in Handwriting Recongition, users.erols.com/rwservices/pens/biblio00.html

27/50

02.11.13


Amsterdam 2000, page 313-322 Lexical constraint / dictionary for handwriting recognition context: uses directed acyclic word graph DAWG instead of trie tree-structure

[LinJ99a] (*)Lin, James; Newman, Mark; Hong, Jason I; Landay, James A. "DENIM: Finding a Tight Fit Between Tools and Practice for Web Site Design", UC Berkeley Technical Report UCB//CSD-99-1065, September 1999 Sketch editing with limited gestures, uses barrel button on stylus to change mode/function: compare to Recognition Macros of Pencept with AutoCad and other applications

[LongAC99a] (*)Long, Allan Christian Jr.; Landay, James A.; and Rowe, Lawrence A. "Implications For a Gesture Design Tool", Proc. CHI '99, Pittsburgh PA USA, pp. 40-47 Study of satisfaction of PDA users (Apple Newton, PalmPilot) on gestures: users preferred gestures as user interface on touch screen, want to define own gestures by example, not tolerant of recognition errors. Test recognizer uses Rubine algorithm.

[Louderback99a] (*)Louderback, Jim "Fujitsu PenCentra 130", ZDNet Publications: www.zdnet.com/zdtv/freshgear, May 21, 1999 Fujitsu rubberized/ruggedized pen computer running WindowsCE. Mentions pen tablets (portable handwriting computers) running Windows NT.

[Louderback99b] (*)Louderback, Jim "Qubit", ZDNet Publications: www.zdnet.com/zdtv/freshgear, March 26, 1999 Internet Access Device stand-alone touchscren/tablet computer for accessing the internet.

[Machrone00] (*)Machrone, Bill "Wacom's LCD Pen Tablet: Nearly Perfect, Pricey", PC Magazine, November 1, 2000 Integrated tablet and display touchscreen from Wacom PL500, pressure sensitive (actually force-sensitive) stylus, mis-called pressure sensitive tablet, price about $3000

[MackenzieIS99a] (*)Mackenzie, I. Scott and Chang, Larry "A performance comparision of two handwriting recognizers", Proc. Interacting with Computers 11, 1999 32-subject comparision of Microsoft (Pen Windows 2.0?) and CIC Handwriter 3.3 handwriting recognizers. Also mentions Unistroke, Graffiti (original, not CIC) and T-Cube unistroke handwriting recognition: T-Cube users.erols.com/rwservices/pens/biblio00.html

28/50

02.11.13


from Apple uses pie menus. Zhao incremental recognition. Interface characteristics (subsetting, context) have significant effect on performance.

[MackenzieIS99b] (*)Mackenzie, I. Scott and Zhang, Shawn X. "The Design and Evaluation of a High-Performance Soft Keyboard", Proc. CHI 99, Pittsburgh PA USA, 15-20 May 1999, pp. 25-31 Study of soft/virtual keyboard layout: QWERTY keyboard better than "optimal" keyboard layout at first (familiariy?), optimal keyboard only slightly better over time. Testing on Windows for Pen Computing / Pen Windows, WACOM integrated touchscreen and display. Also mentions Unistroke, Graffiti (original, not CIC) and T-Cube unistroke handwriting recognition: TCube from Apple uses pie menus. Zhao incremental recognition. Interface characteristics (subsetting, context) have significant effect on performance.

[MacLeanKE99a] (*)MakLean, Karon E. and Roderick, Jayne B. "Smart Tangible Displays in the Everyday World: A Haptic Door Knob", Proc. IEEE/ASME Intl. Conf. on Advanced Intelligent Mechatronics AIM'99, Atlanta, Sep. 1999, 6 pages Haptic feedback in doorknob (everday object): force, motion, heat/temperature, sound. Speculative uses include gestore motion on doorknob as an input password, whether inside lights are on/off, whether someone is/has been in room.

[Manke00??] (*)Manke, Stefan and Bodenhausen, Ulrich "A Connectionist Recognizer for On-line Cursive Handwriting Recognition", (reference not known: conference proceedings?) Dynamic time warping / Time Delay Neural Network for single-character recognition, using a 3x3 or 20x30 bitmap local image Claims 99.5% recogition writer-dependent, between 91.5% and 99.5% on writer-indepdenent: expansion to larger writer-independent database gives about 75%

[MarianettiR99a] (*)Marianetti, Ronald II and Haitani, Robert Yuji "Method and apparatus for immediate response handwriting recognition system that handles multiple character sets ", United States Patent 6,889,888, March 30, 1999 Palm Pilot user interface: separate handwriting areas for alphabetic and for numeric/arithmetic character recognition, or other multiple character sets.

[MartinD00] (*)Martin, David A. "Projection Display System with Touch Sensing on Screen, Computer Assisted Alignment Correction and Network Conferecing", United States Patent 6,141,000 Whiteboard system using a projection display with a touch-screen digitizer. users.erols.com/rwservices/pens/biblio00.html

29/50

02.11.13


Multiple pens/stylus, eraser.

[MartinelliHK99a] (*)Martinelli, John K.; Martinelli, Robert M; Pickett, Mark C.; Ritchey, Wendell W.; and Yaniger, Stuart J. "Force Sensing Semiconductive Touchpad", United States Patent 5,943,044, August 24, 1999 Tap, Tap-Drag and other gestures for emulating mouse button gesture (click-and-drag, etc.). Touchpad using two sheets and a resistancechanging material between. Critiques indirect measure of force/pressure (capacitive area) vs. direct measuremens of force in a digitizer/touchpad for pressure/force input for scrolling and acceleration.

[MartinezEA00a] (*)Martinez, Anthony Edward and Martinez, Sarka "Method and apparatus for altering a display in response to changes in attitude relative to a plane", United States Patent 6,137,468, October 24, 2000 Automatically rotate all windows and objects in a portable computer screen when computer is rotated, including particually rotated. Uses accelerometer or level sensor. Includes rotation of all windows.

[Masson99] (*)Masson, Terrence "History of Computer Graphics (CG)", www.visualfx.com/milestones.htm Ken Knowlton 1950s. Primarily generation of computer graphics, mentions SketchPad with light pen, but not Styalator or Rand Tablet. Computer animation and CGI.

[MasuiT99a] (*)Masui, Toshiyuki "Text input device and method", United States Patent 6,002,390, December 14, 1999 Predictive keyboard: predicted words for auto completion are taken frmo a dictionary and displays.

[MatsushitaN00a] (*)Matsushita, Nbuyuki; Ayatsuka, Yuji; and Rekimoto, Jun "Dual Touch: A Two-Handed Interface for Pen-Based PDAs", Proc. UIST '00, San Francisco, pp. 211-212 Resistive/capacitive touchscreen detecting multi-touches by shift in position. First touch (thumb) is fixed, sets one point, other touch (stylus) is other point and can be moved, for rotation and other gestures.

[McCartyB99a] 1999

(*)McCarty,

Bill "Learning Red Hat Linux", O'Reilly,

Red Hat Linux command line, user interface user guide

[McCrickard99] (*)McCrickard, D. Scott and Catrambone, Richard "Beyond the Scrollbar: An Evolution and valuation of Alternative List users.erols.com/rwservices/pens/biblio00.html

30/50

02.11.13


Navigation Techniques", IEEE Symposium on Visual Language, 1999, pp. 270-ff mural bar and pile bar: information about entries in lists are encoded with highlighting marks into trough/slider of a scrollbar, compare with Russian patent by Gorvunov

[McGeeMR99a] (*)McGee, Marilyn Rose "A haptically enhanced scrollbar: force feedback as a means of reducing the problems associated with scrolling", Proceedings for the First PHANToM Users Research Symposium (PURS'99), Heidelberg, Germany, pp. 17-20. Study of force feedback in cursor control / scrollbar: hardware was PHANToM by SensAlbe Technologies, mechanical actuators to pen-like or thimble-lik user input device.

[McKielFA00a] (*)McKiel, Frank Albert Jr. "Method and system for enabling blind or visually impaired computer users to graphically select displayed elements", United States Patent 6,046,722, April 4, 2000 Accessibility for visually impaired/blind for touchscreen or mouse: auditory feedback of position, and graphical elements in quadrants of a specified radius around the cursor. Uses stereo/binaural sound.

[Microsoft99a] (*)Microsoft Corporation "Description of Windows for Pen Computing Pens", Microsoft Knowledge Base, 10/13/1999, KB85663 Pen/tablet drivers use special interface for higher data rate than mouse driver, special display driver for displaying electronic ink

[Microsoft99b] (*)Microsoft Corporation "Microsoft Computer Dictionary, Fourth Edition", Microsoft Press, 1999 General Reference

[Microsoft99c] (*)Microsoft "penwin.h Pen Windows functions, types, and definitions Version 2.0", Microsoft Corporation, 1999 #include definitions file for Windows for Pen Computing Version 2.0 -1996. CompactPenData tablet data information includes pressure (force), height (proximity), angle x/Y, angle Z, barrel rotation, compress or uncompressed. Gestures include select, clip (cut/copy/paste), whitespace (space, tab, return), edit/autocorrect, upper and lower case circle: different definitions for Japan. Further gestures select first/left/right/last, clear, help, insert context menu ("M"), undo ("U"), cut/copy/paste ("x","c","p", circle a-z and circle A-Z gesture See also penwin.h for version 2.0

[Microsoft99d]

(*)Microsoft

users.erols.com/rwservices/pens/biblio00.html

"Microsoft Windows CE User Interface 31/50

02.11.13


Services Guide: The ultimate reference and toolkit for Windows CE", Microsoft Corporation, 1999 Windows CE programming and user interface guide.

[MicroTouch99a] (*)MicroTouch Systems Inc. "TouchWare for Windows User's Guide", MicroTouch Systems, Inc. Methuen Mass First copyright is 1997

[MicroTouch00a] (*)MicroTouch Systems Inc. "MicroTouch ThruGlass Projected Capacitance Touchscreens", MicroTouch Systems, 2000 Electrostatic/capacitive touchscreen: states accuracy as "97%" (??), 190 points/second data rate.

[MillerJ99] (*)Miller, James R.; Bonura, Thomas; Nardi, Bonnie; and Wright, David "System and Method for Performing an Action on a Structure in Computer-Generated Data", United States Patent 5,946,647, August 31, 1999 Scan displayed text with pattern matching to find phone numbers, addresses, etc., to highlight them and turn them into active links or buttons, clickable with a stylus

[MondenA00a] (*)Monden, Akito; Iida, Hajimu; Matsumoto, Ken-ichi; Inoue, Katsuro; and Torri, Koji "A Practical Method for Watermarking Java Programs", 24th Comp. Softw and App. Conf. (compsac2000), Taipai Taiwan, Oct 2000 Watermarking / hidden signature in Java code by addind a dummy method, and recoding opcodes for arithmetic operations to represent the signature data. Cites to code obfuscators, method is robust when obfuscated.

[MoranTP99a] (*)Moran, Thomas P.; Pedersen, Elin R.; McCall, Michael K; and Halasz, Frank G. "Time-Space Object Containment for Grpahical User Interface", United States Patent 5,404,439, April 4, 1995 When selecting objects with a drag rectangle, take into account temporal/time when objects were created by user -- user mostly likely wants to select objects created together in time. Uses threshold time to determine direction of reversing motion in a "wipe" (swipe?) gesture.

[MunichME00a] (*)Munich, Mario Enrique "Visual Input for Pen-Based Computers", Ph.D. Thesis, California Institute of Technology, January 21, 2000 Optical/Vision based pen-computing tablet, pen tracking by watching position of pointed stylus, pen/stylus up/down detection by checking for ink on paper, and for coincidence of shadow with object. Signature verification. Disambiguation of stylus tip from finger based on sharpness of end. users.erols.com/rwservices/pens/biblio00.html

32/50

02.11.13


Electronic file includes powerpoint slide of thesis defense

[MyersB00] (*)Myers, Brad; Hudson, Scott E.; and Pausch, Randy "Past, Present and Future of User Interface Software Tools", ACM Trans. on Computer-Human Interaction, Vol 7 No 1, March 2000, pp 328 Future UIs will employ recognition-based UIs (gestures?); dissimilary of mouse-based vs. stylus vs. gesture UIs not equivalent

[NagasakiK99a] (*)Nagasaki, Katsuhiko; Shimada, Kazutoshi; Tatsumi, Eisaku; Suzuki, Norikyuki; and Sunakawa, Shinichi "Information Processor", United States Patent 5,936,619, August 10, 1999 Portable computer (with touchscreen and stylus): rotate layout of screen as device is rotated, for landscape/portrait. Shows layout being re-generated automatically (text flow). Physical orientation determined from how display is connected.

[Netscape99] (*)University of North Texas "Netscape Navigator 4.x and the UNT Home Page", University of North Texas, fetched from www.unt.edu/training/UNTHomePage/UNTHomePage.PDF Description of Netscape 4.x user interface, including back icon with press gesture: press-and-hold.

[NicholsRK99a] (*)Nichols, Randall K. "ICSA Guide to Cryptography", ICSA International Computer Security Association, 1999 General reference on cryptography/PKI practice

[Nokia99a] (*)Nokia "Nokia 9110 User's Manual: Nokia 9110 Communicator", Nokia, 1999 Nokia 9110 Communicator smartphone: cellphone in outer cover, opens landscape-clamshell to show keyboard and display. Calendar, Document editing, Fax, Contact address book, Email, WWW browser. No mouse/touchscreen, keyboard navigation only.

[OkamotoM00a] (*)Okamoto, Masayoshi; Ieda, Kazuhiro; and Horii, Hiroshi "Handwritten character input device allowing input of handwritten characters to arbitrary application program", United States Patent 6,088,481, July 11, 2000 Keyboard handwritting input to abritrary programs, using transparent overlay window for input. Cites to Wang "Guide", Slate PenApps. Compare with transparent overlay inking window in Pen Windows?

[OmniVision00a] (*)OmniVision Technologies "OV7620 single chip video camera specificiations", OmniVision Products Specifications, 2000 OmniVision OV7620 Single-Chip CMOS VGA color digital camera, OV6620 users.erols.com/rwservices/pens/biblio00.html

33/50

02.11.13


OV6120 CIF color and B/W digital video cameras Includes lens?

[OsawaN00a] (*)Osawa, Noritaka; Asai, Kikuo; and Sigimoto, Yuji Y. "Immersive graph navigation using direct manipulation and gestures", Proc. Virtual Reality Software and Technology VRST 2000, Seoul Koera pp. 147-152 Virtual reality 3-D gestures including zoom (with two fingers of one hand), spotlight (using zoom), lock and unlock gestures. Using a gesture for unlock?

[Palm99a] 1999

(*)3Com

"3Com PalmVx PDA (physical device)", 3Com,

Functional device: 3Com Palm Vx PDA running General Magic / MagicCap OS 3.1. Touchscreen: No separate keyboard. Includes CDs.

[Palm00a] (*)Palm Pilot / 3Com Corporation "Handbook for the Palm VII Handheld", 3com Corporation, 2000 (fetched 2005) Resistive-film PDA with wireless email via Palm.Net wireless service (presmartphone). Web browsing support via webclipping.

[Palm00b] (*)Palm Pilot / 3Com Corporation "Getting Started with the the Palm VII Handheld", 3com Corporation, 2000 (fetched 2005) Resistive-film PDA with wireless email via Palm.Net wireless service (presmartphone). Web browsing support via webclipping.

[Palm00c] (*)Palm Pilot / 3Com Corporation "Palm m500 Handheld Series User Manual", 3com Corporation, 2000 User manual for Palm PDA with resistive-film touchscreen. Graffiti handwriting recognition, User selects character subset (numeric, alphabetic, etc.), pop-up virtual keyboard, electronic ink notes. Wireless network connectivity for email?

[PanagrossiJ00a] (*)Panagrossi, Jerry "Data Entry Device and Method", United States Patent 6,104,317, August 15, 2000 Stroke keyboard UI: touch in center of button (e.g. phone button), stroke in different directions to get different characters. Compare with marking menus keyboard of Buxton, Kurtenbach, etc.

[PanditMS99a] (*)Pandit, Milind S. "Recognition Of and Operation On Text Data", United States Patent 5,849,636, January 12, 1999 Recognize text (phone numbers, dates) in text, then perform operations on those pattern instances detected: e.g. pop-up menu for Send Mail / Add to Address Book. Highlighting of text by patterns, then clickable? users.erols.com/rwservices/pens/biblio00.html

34/50

02.11.13


[ParadisoJA00a] (*)Paradiso, J.A.; Hsiao, K.; Strickon, J.; Lifton, J.; and Adler, A. "Sensor systems for interactive surfaces", IBM Systems Journal, Vol 39, Nos 3 and 4, 2000, pp. 892-914 Touchscreen/touch sensors for large surfaces: laser scanning rangefinder to track muletipl hands; acoustic tap detection using differential time-ofarrival; piezoelectric wre to detet location and pressure (force), RFID tag reader for flock-of-birds of multiple tags in 3D three-dimensional coordinates. Gesture Wall with capactively-coupled sensor to signal in body. Cites to Softboard for tracking multiple targets, computer vision for hand-tracking. Mentions conductive plastic as alternative to ITO for transparent touchscreen digitizers. Mentions Fingerworks multi-touch and and glidepoint

[ParadisoJA00b] (*)Paradiso, Joseph A.; Hsiao, Kai-Yuh; Strickon, Joshua; and Rice, Peter "New Sensor and Music Systems for Large Interactive Surfaces", Proc. of the Int'l Computer Music Conf. 2000 (ICMC 2000), Berlin, Germany, August 2000, pp. 277-280 phase-measuring laser rangefinder to create large multitouch (multiple hand tracking) touchscreen on large wall. Multimedia demonstrations

[PenComputing99a] (*)Pen Computing Magazine "Pen Lab: Symbol Technologies SPT 1700: Ruggedized Palm III with laser scanner and integrated LAN radio", Pen Computing Magazine, June 1999, Page 44 Palm Pilot III device with wireless LAN radio. File contains additional documentation.

[PenComputing99b] (*)Pen Computing Magazine "Palm VII", Pen Computing Magazine, 1999 Palm VII device with wireless LAN radio.

[Perlin00] (*)Perlin, Kenneth "Method and Apparatus for Writing", United States Patent 6,031,525, Febuary 29, 2000 QuikWriting: refers specifically to it as using zones, ergo zone-based recognition, but the "writing" is not normal characters, it is a circular menu, no stylus-lift. See also press announcement "Look Ma, One Hand!" from Microsoft

[PerryTS00a] (*)Perry, Theresa Sue and Dillard, Pamela Ann "Wireless communication device adapted to generate a plurality of distinctive tactile alert patterns", United States Patent 6,160,498, December 12, 2000 Assign vibrating alert patterns (haptic vibration) to particular calls or numbers in a cell phone users.erols.com/rwservices/pens/biblio00.html

35/50

02.11.13


[PersidskyA00a] (*)Persidsky, Andre "Self-contained pen computer with built-in display", United States Patent 6,130,66, October 10, 2000 Pen computer with no tablet: senses position by a "motion sensor" without special writing surface (Compare Anoto?), shows text (recognized?) on small display in housing of (thick) pen. Display flips orientation (rotate 180 degrees) for left-hand and right-hand usage. Compare with Anoto pen?

[PetzoldC99a] (*)Petzold, Charles "Programming Windows: Fifth Edition", Microsoft Press, 1999 Reference manual on Windows "C" Win32 API circa 1999. Described two and three-button mouse, WM_LBUTTON, WM_MBUTTON, WM_RBUTTON messages (p 275), Synchronous nature of messages in event que (p 329), system message queue

[PlamondonR00a] (*)Plamondon, Rejean and Srihari, Sargur N. "Online and Off-line Handwriting Recognition: A Comprehensive Survey", IEEE Trans. on Pattern Analysis and Machine Intelligence PAMI, January 2000, pp 63-84 Compare with Tappert/Suen survey articles on state-of-the-art in handwriting recognition for 1980 and 1990. Mentions Writer Identification (signature verification and identification), language models for incorporating grammar and dictionary models.

[PocketPCLife99a] (*)Windows CE Power Magazine (Clifford Brooks) "Calligrapher 5.3 handwriting Windows CE: Improve handwriting recognition with Calligrapher 5.3", www.pocketpclife.com/tocs/issue199212.html Produce reveiw of Paragraph Calligrapher 5.3 handwriting recognition: full sentence run-on connected writing, not trainable, include pop-up keyboard for corrections and "special characters". Mentions confusion of singlestroke "1" and "I" (compare with Shillman?)

[PorrasLN00a] (*)Porras, Luis Narvaez and Goldberg, Isaac Rudomin "Embodied Modelling Tools in a 3D Environment", 8th Int'l. Conf. in Central Europe on Computer Graphics, Visualization and Interactive Digital Media'2000, Feb. 7-10, 2000, pp. 92-99 3D three-dimensional graphical editing using 2D touchscreen or mouse input user interface. To maximize viewing of 3D image on display, tools can be iconized, toolbars are transparent.

[PowellDE00a] (*)Powell, Dennis E. "Practical KDE", QUE, Division of Macmillan Compute Publishing, 2000 users.erols.com/rwservices/pens/biblio00.html

36/50

02.11.13


Guide for KDE Desktop Environment/window manager for Linux/Unix

[PrestiP99a] (*)Presti, Peter "The Haptic Lens - A Tactile Sensor", Proc. IEEE/ASME Intl. Conf. on Advanced Intelligent Mechanis, Sep. 1923, Atlanta, 1999, p. 787-ff Partial copy. Presssure-sensing 3D surface digitizer, translucent elastomer layer on clear rigid faceplate, flexible white layer on top. Pressing on surface is visible from underneath where translucent elastomer is compressed thinner. Capable of multi-touch?

[Psion99a] 1998

(*)Psion,

Inc. "Psion MX Series 5 Users Guide", Psion, Inc.,

Psion clamshell Palm-top (a bit large) with half-sized touchscreen and fullsize abbreviated keyboard. Sketch drawing program, images can be inserted into Word documents. Voice note audio recording.

[Qualcomm99a] (*)Qualcomm Incorporated "pdQ Applications Handbook", Qualcomm Incorporated, 1999 Handbook for applications on Qualcomm pdQ PALM/OS smartphone: address book, calculator, call history, dialer, email, expenses, modem emulation, browser . Calibration of digitizer / touchscreen (refers to "digitizer"). Gestures using upper-case alphabetics. One-touch dialing gesture. Refers to handwriting (write) input.

[Qualcomm99b] (*)Qualcomm Incorporated "pdQ Basics Handbook", Qualcomm Incorporated, 1999 User manual for Qualcomm pdQ PALM/OS smartphone: address book, calculator, call history, dialer, email, expenses, modem emulation, browser . Calibration of digitizer / touchscreen (refers to "digitizer"). Gestures using upper-case alphabetics. One-touch dialing gesture. Refers to handwriting (write) input.

[RadleyPE99a] (*)Radley, Petr Ernest "Hand-held radiotelephone having two-part construction", United States Patent 5,966,643, October 12, 1999 Radiotelephone/smartphone with separate earpiece/headphone and microphone. Include video camera and video display, infra-red link.

[RakijasM99a] (*)Rakijas, Michael and Archer, Benedict G. "Scientific Computing with Octave: Octave, GNUPlut and Other Tools", Southern California User Group, September 18, 1999 Introduction to Octave: MATLAB clone

[RekimotoJ99a] users.erols.com/rwservices/pens/biblio00.html

(*)Rekimoto,

Jun and Saitoh, Masanori "Augmented 37/50

02.11.13


Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments", Proc. CHI '99, Pittsburgh, Penn. User interfaces for seamless integration of displays/computers via hyperdragging: integrate portable/small computer (pen computer, etc.) with larger display (virtually/physically adjacent) by dragging to edge of small computer, appears then in larger display. Larger display can be InfoWall Wellner-like desktop for integration with physical objects, or extension from desktop to InfoWall display. Used to link electronic files (e.g. annotations) to recognized physical object (e.g. book). Prototype uses 2D barcode marker/tags on physical objects for identification/targetting on Wellner desktop. Windows can be moved from laptop to InfoWall or InfoTable via hypderdragging off the original device onto the other.

[RekimotoJ99b] (*)Rekimoto, Junichi "Three-dimensional virtual reality space sharing method and system, an information recording medium and method, an information transmission medium and method, an information processing method, a client terminal, and a shared server terminal", United States Patent 5,956,038, September 21, 1999 3D virtual reality system over a network, similar in style to Second Life or MOOGs.

[RekimotoJ00a] (*)Rekimoto, Jun and Sciammarella, Eduardo "ToolStone: Effective use of the physical manipulation vocabularies of input devices", Proc. UIST '00, pp. 109-117 ToolStone: Small cube with 6 DOF 3D digitizer inside, used to simulate multiple (multi-use) input devices depending on which side is touched "down": french curve, eraser, etc. Bi-manual multi-touch input combined with stylus of Wacom tablet,

[RheingoldH00] (*)Rheingold, Howard "Tools for Thought, Chapter Eleven: The Birth of the Fantasy Amplifier", M.I.T. Press, 2000 History and interview with Alan Kay on Dynabook. Refers to Sketchpad electronic ink (?) graphics editing. Lengthy discussion of Dynabook, but all references are to mouse (not stylus/tablet) and keyboard, no mention of handwriting recognition.

[Rocha00] (*)Rocha, Manuel Antonio "Handwriting Template System", United States Patent 6,142,783, November 7, 2000 Physical/mechanical guide template, like those used for drfting lettering, as a guide to the correct writing of cursive script. Compare to restricted templates for doing Unistroke characters within a small mechanical box users.erols.com/rwservices/pens/biblio00.html

38/50

02.11.13


[RojasR00a] (*)Rojas, Raul; Knipping, Lars; Raffel, Ulrich; and Friedland, Gerald; "Elektronische Kreide: Eine Java-Multimedia-Tafel für den Präsenz- und Fernunterricht", Technical Report B-17/2000, Freie Universit&aumo;t Berlin, Institut für Informatik, October 2000. Available at www.match.tu-berlin.de Research group investigating various whiteboard systems for university instruction and remote education, using commercial products. Real-time participation in class using web browser, including interactive audio and video streams.

[RosenbergLB00a] (*)Rosenberg, Louis B.; Schena, Bruce M.; Brave, Scott B. "Method and apparatus for tracking the position and orientation of a stylus and for digitizing a 3-D object", United States Patent 6,078,876, June 20, 2000 Pantographic 3-D stylus digitizer, including menu input by pantographic stylus, menu in work area.

[SchediwyRR99a] (*)Schediwy, Richard R.; Pritchard, Jeffre O.; Kao, Ting; Allen, Timothy P.; and Platt, John C. "Object Position Detector", United States Patent 5,861,583, January 19, 1999 Capacitive grid tablet digitizer, senses capacitance changes at intersections in grid. Measures entire area of contact from multiple intersection nodes simultaneously (multi-touch). Produces profile of finger contact, multi-finger gestures. Infers pressure from outline of contact.

[SchmidtA99a] (*)Schmidt, Albrecht; Beigl, Michael; and Gellersen, Hans-Werner "Sensor-based adaptive mobile user interfaces", Proc. HCI '99, pp. 251-255 Smartphone, PDA other devices adapt UI user interface to context of environment or user action: sensor for orientation change orientation of display (orientation-aware), ambient light for contrast, etc. Shows screen orientation of Apple Newton, but notes that it was not much used by users. Has picture of landscape/portrait on Newton.

[SchneidermanR99a] (*)Schneiderman, Ron "A Manager's Guide to Wireless Communications", American Management Association Press, 1999 Review of Wireless/smartphone communication circa 1999, including wireless internet access, wireless teleconferencing including web browser by DEC Mobile Computing and Communications Appliance, and Deutsch Telekom. Front cover: stylus/pen smartphone -- IBM Simon? Video: p. 126 and front cover users.erols.com/rwservices/pens/biblio00.html

39/50

02.11.13


[SciammarellaE00a] (*)Sciammarella, Eduardo "Interactive control of audio outputs on a display screen", United States Patent 6,081,266, June 27, 2000 Touchscreen user interface for audio outputs: make icon larger for louder, move graphical object to change balance. Compare with Buxton audio control panel?

[Scribens99] (*)Scribens Research Laboratory of Ecole Polytechnique Montreal "Bibliography of publications", Available at http://www.scribens.polymtl.ca/publications.html Lists publications and patents by Plamondon, Privitera, Guerfali, Djezire, Nouboud, Barriere, Parizeau, Clergeau-de-Tournemire, Leclerc, Sabourin, Beaumier, Brault, Yergeau, Suen, Chouinard, Lorette, Clement, Stelmach, Schomaker, Baron, Beauregard, Gagne, Robillard, Poussart, etc. Signature verification, electronic ink data compression formats, Human recognition accuracy, Fuzzy syntax for script recognition, normalization of handwritten characters, more

[Selker99] (*)Selker, Ted "Style and Function of Graphic Tools", Graphics Interface GI'99 Online Papers: www.graphicsinterface.org Essay reviewing graphical user interfaces, including position input, no mention of gestures or handwriting recognition

[SensorySoftware99a] (*)Sensory Software Inc. "HandsOff: on-screen keyboard", Sensor Software, 1999 On-screen keyboard, rectangular grid display, intended for severely handicapped users. Any pointing device may be used -- e.g. head-mounted pointer, does select on "dwell" gestures as substitute for touch or mouse click.

[ServanSchreiberF99a] (*)Servan-Schreiber, Franklin "Display of multiple images based on a temporal relationship among them with various operations available to a user as a function of each displayed image size", United States Patent 5,973,691, October 26, 1999 User interface for photographs, more recent images are larger and in front. User can tap/select images. Larger images have more options available for labeling and editing. Mouse input.

[ShneidermanB00a] (*)Shneiderman, Ben; Kang, Hunmo "Direct Annotation: A Drag-and-Drop Strategy for Labeling Photos", Proc. IV '00, Intl. Conf. on Information Visualisation, Wash. DC 2000 IEEE Computer Society Annotate/label personal photo collections by drag/drop of names onto users.erols.com/rwservices/pens/biblio00.html

40/50

02.11.13


correct part of image, and into list boxes on sides, etc. Mouse or touch screen (direct manipulation), text values only ever entered first time of use via keyboard.

[SieverE99a] (*)Siever, Ellen "Linux in a Nutshell: A Desktop Quick Reference, 2nd Edition", O'Reilly and Associates, 1999 Linux command and user interface user guide

[SiioI99a] (*)Siio, Iitiro; Masui, Toshiyuki; and Fukuchi, Kentaro "Realworld Interaction using the FieldMouse", Proc. UIST '99, Ashevill NC, pp. 113-119 FieldMouse: pen-mouse combined with bar-code reader. Determines position from known location of bar-code ID, then determines absolution position by extrapolation from mouse-sensed relative movement. Example is active book, childrens book with barcode tags in pictures (infra-red ink?). Compare with Anoto.

[SinghM00a] (*)Singh, Mona "Apparatus and Method of Formatting a List for Display on a Touchscreen", United States Patent 6,157,379, December 5, 2000 Automatic layout in user interface of a pick/menu list for touch screen input, with appropriate spacing for targeting.

[SinghM00b] (*)Singh, Mona "Device Having Adjustable Touch-based Display of Data", United States Patent 6,154,194, November 28, 2000 Scrolling and window re-size areas in user interface window for touchscreen

[Sklarew99a] (*)Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 6,002,799 assigned to AST Research, Inc., Irvine, California, December 14, 1999 Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer" Very long list of prior art

[Sklarew99b] (*)Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 5,933,526, assigned to AST Research, Inc., Irvine, California, August 3, 1999 Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer" users.erols.com/rwservices/pens/biblio00.html

41/50

02.11.13


Specific to learning mode where adaptive recognition must be taught from initial state

[Sklarew00] (*)Sklarew, Ralph "Handwritten Keyboardless Entry Computer System", United States Patent 6,064,766, May 16, 2000 Abstract refers to transparent sensing surface over display, electronik ink, character recognition, and learning mode Abstract reads almost identically to Sklarew patent 4,972,496: this one refers to "terminal disclaimer" actions are confirmed specifically by reverse-video of the field operated upon

[SmailagicA99a] (*)Smailagic, Asim; Siewiorek, Dan; Iannucci, Bob; Dahbura, Anton, and Bass, Len "MoCCA: A Mobile Communication and Computing Architecture", Mobile Computing and Communications Review, Vol 3, No 4, 1999, pp. 39-45 Early smartphone/communicator prototype, included web server and servles, pcAnywhere, Phone dialer (OTS software), browser for wireless communications. Display video, touchscreen interface.

[SmailagicA99b] (*)Smailagic, Asim "An evaluation of audio-centric CMU wearable computers", Mobile Networks and Applications, Vol 4, 1999, pp. 59-68 CMU Carnegie Mellon Wearable Computers: wireless phone (smartphone) with full-motion video.

[SmithJR99a] (*)Smith, Joshua Reynolds "Electric Field Imaging", Ph.D. Thesis, M.I.T. School of Architecture and Planning, February 1999 Electric field/capacitive sensing/imaging, sections on synchronous detection methods, spread spectrum,signal processing. Not really about tablets or digitizer, examples of capacitive field sensing for hand and body parts in various applications. LaZmouse: 3D locator/pointing device not requiring user to hold the mouse. See also FishFace (general electric field proximity/position sensor.)

[SmithJ99b] (*)Smith, Josh "Electric Field Imaging: "Seeing" by Inverse Electrostatics -- Overview of Electric Field Sensing", MIT Media Lab, web.media.mit.edu/~jrs, 1999 (date approximate) Electric field/capacitive sensing/imaging. Review of touchpad and proximity capacitive sensing projects: LazyFish sensing board, School of Fish, NEC Passenger Sensing product Active Seat (airline), 3D/6DOF FieldMouse shows interpolating positions of two hands. FishFace touch/display device, Active Table, users.erols.com/rwservices/pens/biblio00.html

42/50

02.11.13


[SmithiesS99] (*)Smithies, Steve, Novins, Kevin, and Arvo, James "A handwriting-based equation editor", Proceedings of Graphics Interface '99, pages 84-91, Kingston, Ontario, June 1999 Two-dimensional input with handwriting recognition for mathematics: features include showing parsing in real-time, with an eight stroke delay, showing bounding boxes on all characters/groupings as an aid to user understanding parsing. User can edit strokes, select alternate recognition results, and edit grouping/parsing of strokes.

[Sony00a] (*)Sony Corp. "Sony DataRover 840 PDA (physical device)", Sony Corp., 2000 Functional device: Sony DataRover 840 PDA running General Magic / MagicCap OS 3.1. Touchscreen: No separate keyboard. Includes CD.

[Spiegel99a] (*)Der Spiegel "Der Palm VII - der erste "Online Palm"", Der Spiegel, 17 Nov. 1999 Review of early 1999 release of Palm VII, with live internet connections: email, multimedia, WAP-handy (cellphone)

[SpitzerMB00a] (*)Spitzer, Mark B. "Eyeglass Interface System", United States Patent 6,091,546, July 18, 2000 Video camera, display, microphone in eyeglasses. One use us is handsfree cellphone. Compare with Google Glasses.

[StewartJ99a] (*)Stewart, Jason; Bederson, Benajamin B.; and Drui, Allison "Single Display Groupware: A Model for Co-present Collaboration", Proc. ACM CHI'99 Conf., May 15-20, 1999, pp. 286-293 Multiple users sharing single display (whiteboard), but from separate workstations/PDAs with touchscreen. Asks question about accessibility using audio output for the blind/visually impaired for groupware/whiteboard.

[StreitzNA99a] (*)Streitz, Norbert A.; Geissler, Joerg; Holmer, Torsten; Konomi, Shin'ichi; Mueller-Tomfelde, Christian; Reischl, Wolfgang; Rexroth, Petra; Seitz, Peter; Steinmetz, Ralf "i-LAND: An interactive Landscape for Creativity and Innovation", Proc. CHI '99, May 15-20, 1999, Pittsburgh, pp. 120-127 i-LAND/BEACH: InteracTable touchscreen table (rear projection), DynaWall . Shows windows rotated on tabletop display for varying user perspectives/orientation around table. Gesture input, Objects may be moved from one display to another via take-and-put or pick-and-drop. Virtual location is cooperation via system regardless of user physical location. users.erols.com/rwservices/pens/biblio00.html

43/50

02.11.13


[StreitzNA99b] (*)Streitz, Norbert A.; Geissler, Joerg; Holmer, Torsten; Konomi, Shin'ichi; Mueller-Tomfelde, Christian; Reischl, Wolfgang; Rexroth, Petra; Seitz, Peter; Steinmetz, Ralf "i-LAND: An interactive Landscape for Creativity and Innovation", Proc. CHI '99, May 15-20, 1999, Pittsburgh, Video demonstration Video of InteracTable and related devices.

[StrickonJA99a] (*)Strickon, Joshua Andrew "Design and HCI Applications of a Low-Cost Scanning Laser Range-Finder", Master's Thesis, EECS, M.I.T, June 1999 scanning laser rangefinger for tracking multiple hands (multipoint touchscreen) in front of large rear-projected display wall. Refers to Gesture Wall, smart wallboards (whiteboards) with handwriting tracking. Tracking/rangefinding by triangulation, time-of-flight (speed of light delays measured), continuous wave phase.

[Subrahmonia00] (*)Subrahmonia, Jayashree and Zimmerman, Thomas "Pen Computing: Challenges and Applications", Proceedings of ICPR 2000 (pre-print) Short overview of pen-computing: refers to ultrasonic/acoustic digitizer, also barcodes like that of Anoto but different Gives limiting factors for acoustic/sonic digitizer, at 50 dpi due to air currents, etc. Optical pattern digitizer building up mosaic of images from normal paper: not clear that they ever actually evaluated such a device

[Synaptics00a] (*)Synaptics Inc. "Synaptics TouchPad Interfacing Guide", Synaptics.com, January 18, 2000: original version 1998 Physical protocols for Synaptics Touchpad interfaces: PS/2 mouse, Serial RS-232C tablet, ADB Apple Macintosh. Optional dual sensing of pen and touch (capPen). Gestures for scrolling, mouse-button emulation (tapping) implemented in driver, tap-and-a-half drag gesture. Because of tap timing (time-out, no second tap) simulated mouse clicks are generated after a slight time delay. Edge Motion: movement to edge generates continuing motion in same direction. Hop gestures are two taps separate left or right. Drag gesture is tap-lift-hold (tap-and-a-half)

[TacTex00a] (*)TacTex Controls Inc. "MTC Express Guide multitouch touchpad: Owner's and Developer's Guide, Version 1.1", TacTex Controls Inc., April 20, 2000 optical-fiber multi-touch controller, shows map of fingertip images for five fingers as part of installation verification. Normalization process to calibrate users.erols.com/rwservices/pens/biblio00.html

44/50

02.11.13


touch response (taxel == touch pixel) with interpolation for higher resolution. "C" API reference.

[TakahashiT99a] (*)Takahashi, Tomoichi and Kuzuya, Mikio "3-D Input Device Using a Ball Rotation Interface", Proc. 8th Int'l. Conf. on HumanComputer Interaction, Munich Germany, Aug 22-26, 1999, Vol. 1 pp 397-401 3D three-dimensional input, using trackball (3D orientation) on top of joystick (X/Y) and up/down buttons (Z position)

[TarrC00a] (*)Tarr, Christopher; Salisbury, J. Kenneth Jr.; Massie, Thomas Harold; and Avilies, Walter A. "Method and apparatus for generating and interfacing with a haptic virtual reality environment", United States Patent 6,084,578, July 4, 2000 Interfacing a haptic device/display with a virtual reality environment, using a model of the compound objects of the virtual reality environment. Many references.

[TognazziniB99a] (*)Tognazzini, Bruce "Linear Touch Input Device", United States Patent 5,859,629, January 12, 1999 one-dimensional linear touchpad, pressure sensitive material. Placement next to keyboard, use for inputting linear quantities.

[TreeseW00a] (*)Treese, Win "Putting it Together: Going Wireless", netWorker, June 2000, pp. 9-12 Overview of wireless smartphones circa 2000: OmniSky Palm Vx with NovAtel wireless modem, Palm VII, Spring PCS Wireless Web, NeoPoint 1000 RIM 950 Wireless handheld. Some use touchscreen but not cited in article.

[Trinder99] (*)Trinder, Michael "The computer's role in sketch design: a transparent sketching medium", in Computers in Building: Proceedings of the CAAD Futures 99 Conference, Kluwer Academic Publishers, Boston 1999 Includes overview/survey of sketch input systems: electronic cocktail napkin, Bill Buxton. Compares mouse to drawing with a brick, pressuresensitive tablet and use of tilt in user interface.

[TurkM99] (*)Turk, Mathew "Chapter 10: Gesture Recognition", Draft manuscript for "Handbook" project: Available at vehand.engr.ucf.edu/handbook Gesture recognition, but primarily about hand and body gestures, not tablet/stylus gesture recognition for a computer GUI. One review section on users.erols.com/rwservices/pens/biblio00.html

45/50

02.11.13


Pen-based Gesture Recognition. PenPoint/GO is notable by not being mentioned: author's address is at Microsoft Research. Only citation before 1991 is to Sketchpad.

[UKA99] (*)Interactive Systems Labs, CMU and Uni Karsruhe "Publications on Neural Nets, Speech, Multimodal and Natural Language Processing", http://isl.ira.uka.de/ISL.publications.html Source of Jaeger abstracts on handwriting recognition: lip-reading, speech recognition and UIs mostly.

[Unigraphics00] (*)Unigraphics User Museum "Miscellaneous Junk", http://www.uguser.org/home/museum/hall/Misc_junk.htm Collection of early Unigraphics tablet/pointing devices: Textronix Data Tablet, Spaceball three-dimensional joystick/pointing device, UGDD Unigraphics Detail Drafting tablet overlay, showing menus for keystroke macros (CAD UI menus on tablet digitizer) or GRIP programs, McDonnel Douglas

[UreMJ99a] (*)Ure, Michael J. "Touch-sensitive keyboard mouse", United States Patent 6,982,302, November 9, 1999 multiple simultaneous touches used for touch-sensitive keyboard with chording: one-handed keyboard using multiple key depressions -- touchtone keyboard layout, or for one-hand PDA-type device. Any kind of multitouch sensor may be used. Automatic registration of fingers by having space (most frequent character) be all four fingers.

[UreMJ00a] (*)Ure, Michael J. "Touch-sensitive keyboard mouse and computing device using the same", United States Patent 6,107,997, August 22, 2000 multiple simultaneous touches used for touch-sensitive keyboard with chording: one-handed keyboard using multiple key depressions -- touchtone keyboard layout, or for one-hand PDA-type device. Touch sensor shows images of fingertips. Any kind of multi-touch sensor may be used. Haptic effects of real keyboard?

[UyeharaL00a] (*)Uyehara, Lance; Eberhard, Martin F.; and Tarpenning, Marc E. "Display orientation features for hand-held content display device", United States Patent 6,154,214, November 28, 2000 handheld PDA/ebook reader with touchscreen: orientation button brings up dialog to rotate screen to 0,90,180,270 degrees. Resets to 0 degrees when placed in cradle. Pop-up menus for other display options.

[VanKleeckM99a] users.erols.com/rwservices/pens/biblio00.html

(*)Van

Kleeck, Michael "Method and system for 46/50

02.11.13


entering data using an improved on-screen keyboard", United States Patent 6,008,799, December 28, 1999 On-screen virtual keyboard with alphabetic keys, common words (e.g. o: or, on of, over) on additional keys below, double-click and flick gesture to pop-up dictionary words or additional characters or punctuation. Cites to PenPoint and Windows for Pen Computing / PenWindows 1.0. Period character can automatically add additional two space characters.

[Videotile99] (*)Videotile: AT&T Laboratories "The Videotile", AT&T Laboratories, Cambridge Massachusetts Tablet digitizer and display, refers to sending raw analog video to the device rather than processing the video stream in the terminal: mentions Papyrus Associates and Allegro handwriting recognition. Recognition algorithms execute on separate server processor, not in local firmware

[VincentN00] (*)Vicent, N. and Dorizzi, B. "A Fractal Justification of the Normalization Step for Online Handwriting Recognition", Proc. 7th International Workshop on Frontiers in handwriting Recognition, pp. 535540 Cites to REMUS recognition software: handwriting recognition, application of fractal models to determine charactertistics which do not vary based on tablet resolution, writing speed, or writing size. Automatic scaling of sizes?

[VoelzH99a] (*)Völz, Horst "Das Mensh-Technik-System: Physiologische, physickalische und technische Grundlagen - Software und Hardware", Expert Verlag, Germany, 1999 (in German) Introduction and review tutorial of muman-machine interfaces. Broad-ranging overview includes sensors and human output for Hall-effect sensing of magnetic fields, oder/smell, gas emissions, graphical dithering, not just traditional touch and key inputs with visual output. Page 164 discusses touchscreen inputs, cites to Ward/Schulz (!).

[WagnerK99] (*)Wagner, Kirsten "Informations- und Wissensorganisation anhand räumlicher Ordnungsmodelle: Das "Spatial Data-Management System" der "Achitecture Machine Group" als Fallbeispiel", Position Statement, Internationale Zeitschrift für Theorie und Wissenschaft der Architektur, ISSN 1439-8363, Wolkenkuckucksheim, 1999 Review of data-access models using graphical representations: shows Memex system of Vannevar Bush, showing stylus input (with digitizer tablet? Telautograph?) for hand-written electronic ink, possibly handwriting recognition to insert "code symbols" as annotation and linking information users.erols.com/rwservices/pens/biblio00.html

47/50

02.11.13


on a document. Photograph of Sketchpad by Sutherland, 1963.

[WalrathK99a] (*)Walrath, Kathy and Campione, Mary "The JFC Swing Tutorial: A Guide to Constructing GUIs", Sun Microsystems, 1999 Java Swing: Layout Managers for positioning GUI elements at runtime (not an IDE), Limited support fo Accesibility API com.sun.java.accesibility.util and AccessibleJComponent base class, documentation for accessibility on included CD-ROM.

[WalshN99a] (*)Walsh, Nancy "Learning Perl/Tk", O'Reily & Associates, 1999 Mapping between UI events and mouse buttons in Perl

[WanderleyMM00a] (*)Wanderley, M.M. and Battier, M, eds. "General Bibliography on Gestural Control in Music", Reprint from "Trends in Gestural Control of Music", 2000, Ircam - Centre Pompidou Very long bibliography: mostly about gestures of music conductors, but contains some references to written gesture recognition with stylus and digitizer. Also contains references to recognition of American Sign Language gestures.

[WellsND99a] (*)Wells, Nichola D. "Teach Yourself KDE 1.1 in 24 hours", SAMS Publishing, 1999 Guide for KDE window manager for Linux/Unix: Describes configuration UI for mouse, thresholds for acceleration on movement, and threshold for minimum distance in a short period of time for mouse drag-gesture movement to go into accellerated speed: compare with flick gesture? KDE 2.0 also has minimum drag distance, minimum number of pixels movement before a drag is started.

[WellsN00a] (*)Wells, Nicholas "Special Edition: Using KDE", QUE, Division of Macmillan, 2000 Guide for KDE Desktop Environment/window manager for Linux/Unix

[WestermanW99a] (*)Westerman, Wayne "Hand Tracking, Finger Identification, and Chordic Manipulation on a multi-touch surface", Ph.D. dissertation, U. Delaware, Spring 1999 Refers to hotscroll continuous scrolling on OS/2 by Samual Audet, and Autoscroll (scrolling momentum) by a four-finger gesture without decelerating. Multi-touch gestures / multi-touch input devices at Bill Buxton's lab 1980's, mentions LeeSK85. Partial printed copy, full electronic copy.

[WilsonAD00] (*)Wilson, Andrew David "Adaptive Models for the Recognition of Human Gesture", Ph.D. Thesis, M.I.T, Feburary 2000 users.erols.com/rwservices/pens/biblio00.html

48/50

02.11.13


Gesture recognition (hand and body gesture) for interactive demonstration "Swamped!". Gesture of hand inside a puppet.

[WilsonJY99a] (*)Wilson, James Y. "Remote Occlusion Region", United States Patent 6,005,533, December 21, 1999 Remote-control touchscreen terminal for computer, shows screen of host computer with local virtual keyboard. Defines a blocking/occlusion window on screen of host computer to match local virtual keyboard image. Ominibus specification for CruisPAD pen computer. Wake-up from lowpower sleep mode when touchscreen is touched: Compare with Wang Freestyle.

[WinogradT99a] (*)Winograd, Terry and Guimbretiere, Francois "Visual Instruments for an interactive Mural", Proc. CHI 99, 15-20 May, 1999, pp. 234-235 Optically-tracked laser pointer digitizer: both a stationary click (turn on laser while close) and marking menu by sweeping laster pointer across an action bar (side of octagon for pie menu). Five gestures like Xerox STAR menu items (cut, copy, paste, undo gestures: sweep gesture across action bar. Universal menu gesture can be used anyplace for large-size display: press-and-hold? it refers to pie menus and Kurtenbach

[Wivik99a] (*)Synapse Adaptive "Wivik 2 V2.5 On-Screen Keyboard", SynapseAdaptive.com, 1999 Wivik (Windows Visual Keyboard) on-screen virtual/software keyboard for Windows 3.1, 95, NT, version 2.5. Accessibility for motor-impaired. Doubleclick gesture on key for shift/upper-case, selection/button activation on button-down/touch instead of button-up/release/lift. Expanding-quadrant selection (compare with marking menus): keyboard image shown in four segments, dwell on segment expands segment further divided into four quadrants, etc. Highlighting of keys as pointer passes over. Intelligent "always-on-top" when pointing to keyboard or application.

[WolfeA00] (*)Wolfe, Andrew Lawrence and Barrett, Gary Lloyd "Multimodal touch sensitive peripheral device", United States Patent 6,037,930, March 14,2000 Resistive film digitizer used to implement various virtual devices: joystick mode, mouse mode, absolute mode, keypad mode Compare to Kaplow?

[YuW00a] (*)Yu, Wai; Ramloll, Ramesh; and Brewster, Stephen "Haptic Graphs for Blind Computer Users", Proc. 1st Intl. Workshop on Haptic Human-Computer Interaction, pp. 41-51 users.erols.com/rwservices/pens/biblio00.html

49/50

02.11.13


Three-dimensional 3D force-feedback electromechanical digitizer for visualizing simple graphs and 3D surfaces for the blind and visually impaired. Adding auditory feedback and texturing aids in the perception of the surface: compare with SciAm article on multi-sensate integration.

[ZettsJM99a] (*)Zetts, John Mark and Desrosiers, Maurice Roger "Distinguishing gestures from handwriting in a pen based computer by size discrimination", United States Patent 5,862,256, January 19, 1999 Size/dimension threshold for tap gesture is smaller if character recognition is also enabled, to allow user to use both tap and small characters like periods. Effect on press-and-hold? two thresholds, but no press-and-hold

[ZettsJM99b] (*)Zetts, John Mark and Desrosiers, Maurice Roger "Distinguishing gestures from handwriting in a pen based computer by stroke analysis", United States Patent 5,864,635, January 26, 1999 Bounding rectangles to segment strokes into likely words: use this information plus size to distinguish writing from gestures.

[ZettsJM00a] (*)Zetts, John Mark and Desrosiers, Maurice Roger "Method of and System for Facilitating User Input into a Small GUI Window Using a Stylus", United States Patent 6,049,329, April 11, 2000 When user starts writing on text field, bring up larger rectangle to write in. If just tap in text field, select it.

Main Reference Page

users.erols.com/rwservices/pens/biblio00.html

50/50

History of Pen and Gesture Computing: Annotated ...

History of Pen and Gesture Computing: Annotated ...

Suggest Documents

History of Pen and Gesture Computing: Annotated

Pen Computing History - Rugged PC Review [PDF]

Cursive: Controlling Expressive Avatar Gesture Using Pen Gesture

Microsoft MIRA - Pen Computing Magazine

Microsoft MIRA - Pen Computing Magazine

The Evolution of Pen Computing - Semantic Scholar

A Corpus of Gesture-Annotated Dialogues for Monologue-to-Dialogue ...

Assessing the Impact of Pen-based Computing and ...

Assessing the Impact of Pen- based Computing and Collaboration ...

'Pen-like' natural graphic gesture capture disposal, based ... - CiteSeerX

Using Pen-Based Computing in Technology for

Utilizing DyKnow Software and Pen-Based, Wireless Computing in ...

Intel Processor History - History of Computers, Computing and Internet

2006 Compare & Contrast Annotated Rubric - World History ...

2006 Annotated DBQ Rubric - World History Connected

PEN magazine - Sydney PEN

Audio feedback for gesture recognition - School of Computing Science

A review of gesture-based computing research ... - Semantic Scholar

The Finger-Joint Gesture Wearable Keypad - School of Computing ...

History and Life: Teacher's annotated ed, // 1977 // Scott, Foresman ...

A brief, annotated bibliography of the history of the ...

The History of Computing in the History of Technology

Red Pen Blue Pen

Annotated Readings in the History of Risk Analysis in