Large Display, display in public space, multiple-zones service ability, Ambient ... On the plasma display, there is infrared-based touch sensor as an input device.
Mo@i: A Large Display Service Platform Enabling Multi-zones Serviceability Masayuki Iwai *, Akinori Komaki *, and Hideyuki Tokuda ** * Graduate School of Media and Governance, Keio University ** Faculty of Environmental Information, Keio University 5322 Endoh, Fujisawa, Kanagawa 252-8520, Japan {tailor, akinori, hxt}@ht.sfc.keio.ac.jp ABSTRACT
In ubiquitous computing age, we have shown numerous kinds of devices are rapidly evolved. Larger size displays are spread to not only home environment but also public spaces. Most of such displays, however, aim just show general information to users one way, so still has less interaction with them. We developed a novel large display, named Mo@i, which can locate in a public space. Mo@i can offer different abilities of service to users who are in different zone, because it has several types of actuators and sensors in the same platform. This paper describes the architecture of Mo@i and discusses the requirements of multiple-zone serviceability.
Section 3 describes about the relationship between serviceability and zones where users exist in front of the service platform. A scenario of using Mo@i is discussed in section 4. Related work is mentioned in section 5. 2.
ARCHITECTURE OF Mo@i
In this section describes architecture Mo@i. We have developed Smart Furniture[13] to create indoor intelligent furniture. touch sensor
PDP
Keywords
Large Display, display in public space, multiple-zones service ability, Ambient Technology, LED control, face tracking technique 1.
INTRODUCTION
Nowadays the speed of spreading computers to office and home environment is becoming increase. The devices have rich computing power and enough functionaries. Large size displays can be deployed in public space environment after home environment. However, in public space such as station, shopping street or museum, almost all the displays have a simple role to show usual information to general users. The information flow limited to one way from displays to users. Additionally, when users make use the traditional, these platform force users to use in a strict fixed zone. As a point of view of action model of users, It is natural one user would change distance from him/her to service platform.
LED panel Control Box sensors panel Usb Camera Control Box (behind) Ultrasonic Sensor Led 50inch display
Touch panel
In the ubiquitous computing age, it is needed the service platform which can interact with users to offer more valuable for each users respectively.
Figure 1 Layered structure of Mo@i
Therefore, for public space, we propose noble large display named Mo@i. Mo@i: “Multiple-zones and -Objective service Access platform with rich Interactivity” can offer many kinds of services to the several users who are in the different zones.
On the other hand, the design policy should be a service platform in public spaces. Thus, we selected 50” PDP display, which is rotated 90 degrees, as a basic platform. This is almost same height to adult users. Figure 1 shows layered hardware structure of Mo@i.
We propose hardware architecture of Mo@i in section 2 including sensors and actuators.
1
Facilities of Mo@i are selected based on the criterion of coverage of service to users. We consider the range of every sensor and actuator as shown in Table 1.
Table 1 Devices classification on Mo@i Range
Sensing
Neighboring range
Touch sensor
Middle range
Ultrasonic sensor
Actuating Plasma Display
z
Passive RFID reader Plasma Display
Camera Long range
Active RFID reader
LED lamp
We will explain each device. z
LARGE DISPLAY
The main actuator is 50inch huge PDP display [2]. This display can show the feedback of interaction between users. The display is connected to a laptop PC inside Mo@i which can generate contents by Java2D and Macromedia Flush. z
Mo@i has 3 number of ZPS-3D[5] ultrasonic sensors for each side as shown in Figure 3. The detecting range of this ultrasonic sensor is between 20cm-80cm. Users have to carry a small ultrasonic transmitter. The accuracy of target transmitter detecting is almost 1cm squares. Mo@i analyses the users movement of his/her hand by the analyzing software ZPS-MA.
TOUTCH SENSOR
CAMERAS
Mo@i uses two web cameras (300,000 pixels, viewing angles 44 degrees), each connected to a PC. Mo@i analyzes a human’s face image and detects three-dimensional position and orientation. These cameras of the Mo@i are laid out in Figure 3. As shown in Figure 3, Mo@i detects the face area by using MALib[6], and calculates centriod point and center point. This centriod point is adjusted to the position of the face. Mo@i detects user’s 3D-position by using the triangulation based on the face position. Orientation of the face is detected from a difference between this centriod point and this center point.
On the plasma display, there is infrared-based touch sensor as an input device. Users can select menus and control options by using their fingers. z
ARMS
USB Camera
One of the main input devices is ARMs. Mo@i can have 1-3 numbers of ARMs for each side and its height is adjustable. This adjustment facility can supply the needs that both grownup people and children intend to use a same platform. In side the ARM, there is basically empty space to put into several devices which have to be connected to main PC. We created there are 3 types of ARMs, SmartIts-type, RFID antenna-type, and Bluetooth type. Especially, RFID antenna-type is suitable for practical use.
Ultrasonic Sensor
Figure 3 (Left fig)Deployed sensors (Right fig)Detected centriod point of Human Face z
LED lamps
Mo@i has 18 full-color LED lamps, which are programmable, respectively [1]. Both transkit and a controller are deployed on the back. Each LED has 254 red *254 green *254 blue levels. The LEDs can brink in several patterns, graduation, sparkling, and random. Therefore, It can be easy to express rich context. LEDs are arranged around the display of the Mo@i. As the result of this, users behind Mo@i can see these LEDs as well as users front of Mo@i. z
ACTIVE RFID READERS
A RF-Code mantis [4] tag reader is implemented in Mo@i.
Figure 2 RFID antenna type ARM can detect a user ID from user’s key folder. RFID antenna-type[3] ARMs’ radio frequency are at 13.56 Mhz. It can detect any ISO15693 tags. By using this ARM, Mo@i can detect object-ID which is belonging to users. The examples of objects are key folder, wallet, cell phone with RF-ID tag, and PDAs(See Figure 2 ). z
This reader can detect RFID-tags with in almost 10m. 3.
MULTI-DINENTIONAL SERVISAVILITY
In this section, we discuss about distance between users and Mo@i as a service platform. Almost traditional service platforms limit the distance between users and themselves.
ULTRASONIC SENSORS
2
Service Platform Touchable Zone Face2Face Zone
Visible Zone
this zone at a same time. The effective application in this zone is streaming of CM videos which are considered user’s preference or historical data. This zone’s application must not be show too private contents of users, because some others may watch it. The application, which is moderately personalized however it is difficult to the specific a certain person, is practical to use. The size of this zone is 3m-6m from service platform. z
Ambient Zone
Figure 4 Multiple-zones Classification For example, touch sensor-based service platform can not user by users in far range. On the other hand, ambient LED platform can not serve more considerable service to nearby users. As shown in Figure 4, we define 4 zones around a service platform. z
Touchable Zone
This zone is the most nearest zone to the service platform. In touchable zone, a user can touch to the service platform and the user occupies the service platform completely. Thus, any applications which are launched in this zone must be personalized one such as e-mail or scheduler. (See Figure 5) For a user who has no RFID tags or sensor node, touch sensor or finical button is suitable in this zone. For a user who can carry a RFID, on the other hand, passive tag readers can be used in this zone such as Mo@i’s ARMs. The size of this area is less than 70cm from service platform. z
Face2Face Zone
Ambient Zone
Ambient zone is the far range from a service platform. The size of this zone is more than 6m-20m. Ambient zone is firstly proposed in the work of Hello.Wall[7]. For a service platform, it is too far from users to recognize the identification of users. Therefore, the platform has to represent the general information for public users. The useful devices are limited in this area such as LED. Users can not see detailed information, but can see the color of LED or blinking pattern of lamps. 4.
A Scenario in Everyday life
In this section, we describe the practical scenario using Mo@i in everyday life. A user named Bob is employee of a company. Mo@i is placed in his office floor When he come to his office floor, he can view the color of Mo@i, which represents a stock of his company. The distance is a little far from Mo@i. The, he know his company’s stock is gradually rising by the graduated blue LED lamps. When he enters the come to near range, Mo@i detects the RFID tag in his bag. Immediately, Mo@i notifies to the existing messages to him by blinking to LED. The pattern of blinking LED is totally different from the pattern on ordinary days. Bob tries to see the spooled message and he put his company ID-card to the ARM of Mo@i. Mo@i checks it’ ID and show a message application to him.
Systems for tracking faces using computer vision have recently become practical for human-computer interface application. This zone offers face-responsive interaction: direct manipulation, gaze-driven dialog.
By cricking the application, Bob can read the message. The message describes that a customer factory is in trouble so he have to go to a customer factory as soon as possible. (see Figure 5)
Direct manipulation is a service that changes the content of the display according to the movement of the face (3Dposition, direction, speed). Gaze-driven dialog[11] is a service to display some dialogs by user's screen gaze. For example, when gazing at a window in the screen, detailed information and the icon are displayed. This service doesn't have troublesome task to the user and can offer information customized to each user's individual.
When he leaves from the Mo@i in hurry, Mo@i’ cameras, which are always tracking his face, do not become detecting his face. To protect privacy and security, Mo@i removes his message application.
z
Visible Zone
Visible zone is the mid range. Users in this zone can see the display. There is opportunity that some users are exists in
Bob immediately get out his office and go to the customer along with the message. In this scenario, the user moves as following: (1)Ambient zone (2) Face2Face zone (3) Touchable zone(4)Out-of-service zone. By using this scenario, we can figure out the efficient usage in office environment. In the same way, users in public place can use Mo@i such as notation system of transfer train number or time.
3
select applications with privacy and security influence. Privacy risk management [9] for multiple users is needed. ACKNOWLEDGEMENTS
This research has been conducted as part of the Ubila Project supported by the Japanese Ministry of Internal Affairs and Communications. REFERENCES 1. COLOR Kinetics, http://www.colorkinetics.com/
Figure 5 A touchable zone application 5.
Related Work
Hello.Wall[7] defines three zones: ambient zone, notification zone, and cell interaction zone. This classification of zones is simple and suite for the service platform which has only ambient actuator such as LED.
2.
50” widescreen plasma display TH-50PHD7 http://panasonic.biz/pdp/
3.
Takaya Corp, TR3 RFID-tag reader http://www.takaya.co.jp/rf/index.htm
4.
RF-CODE mantis active tag reader http://www.rfcode.com/mantis_readers.asp
5.
ZPS-3D http://www.furukawakk.jp/zps/index.html
6.
MAlib http://www.malib.net/index.html#documents
7.
Th. Prante, C. Rocker, N. A. Streitz, R. Stenzel, C. Magerkurth, D. van Alphen, D. A. Plewe “Hello.Wall– Beyond Ambient Displays”: Video Track and Adjunct Proceedings of the Fifth International Conference on Ubiquitous Computing (UBICOMP’03), pp. 277-278, Seattle, Washington, USA, October 2003
8.
Kimberle Koile, Konrad Tollmar, David Demirdjian, Howard Shrobe and Trevor Darrell, "Activity Zones for Context-Aware Computing" UbiComp 2003: Ubiquitous Computing: 5th International Conference, Seattle, WA, USA, October, 2003
9.
Hong, J.I., Ng, J.D., Lederer, S., Landay, J. Privacy Risk Models for Designing Privacy-Sensitive Ubiquitous Computing Systems. In Proceedings of Designing Interactive Systems (DIS2004), 2004.
10.
Philip Robinson and Michael Beigl "Trust Context Spaces: An Infrastructure for Pervasive Security in Context-Aware Environments" First International Conference on Security in Pervasive Computing, Boppard, March 12 - 14, 2003
11.
Darrell T., Tollmar K., Bentley F., Checka N., Morency L., Rahimi A. and Oh A "Face-responsive interfaces: from direct manipulation to perceptive presence" UbiComp 2002, 135-151
12.
Junestrand, S., Keijer, U. & Tollmar, K. : “Private and Public Digital Domestic Spaces” In International Journal of Human-Computer Studies, Vol. 54, No. 5, May 2001, pp. 753-778. Academic Press, London, England.
13.
Hideyuki Tokuda, Kazunori Takashio, Jin Nakazawa, Kenta Matsumiya, Masaki Ito, Masato Saito. "SF2: Smart Furniture for Creating Ubiquitous Applications" IEEE Proceedings of International Workshop on Cyberspace Technologies and Societies (IWCTS2004), Tokyo, Japan January. 2004 pp.423-429
However, this classification is not enough to support large display-based service platform which has lots of sensors and actuators. Mo@i defines 4 kinds of zones to support seamless interaction with service platforms. Activity zone [8] defines the regions in which similar activities occur. This zone is semi-automatically petitioned based on observed users location and motion. The zones are, however, not over wrapped. Each zone is the same level. The distance and direction between service platform and users are important factors for the offering services. Mo@i has different kinds of serviceability for different range of zones. Trust Context Space [10] and Private and Public Digital Domestic Spaces [12] also define spaces based in privacy aware ness. Especially, Trust Context Space and define the personalized space, implicit context shared space, and explicit context shared space. There zone definition is important in thoritically, however in practical, the system have to manage every object and person’s space definition. There are difficult to find sensors to detect such delicate spaces. 6.
Conclusion and Future work
As a conclusion, we develop a novel service platform, named Mo@i, based on a large display with various sensors and actuators. Mo@i has 50” PDP display and controllable LEDs lamps as actuators. As input devices from users, Mo@i has touch sensor, arms which can detects short range RFID tag, ultrasonic sensors, and long range active RFID reader. To offer suited service for any range of users, Mo@i defines 4 kinds of zones: touchable zone, face2face zone, visible zone, and ambient zone. In any zone users exist, Mo@i can offer services using suitable sensors and devices.
We will try to adapt more privacy awareness issues as future work. To consider about relationship between users in front of a service platform, the service platform have to
4
