Enabling User-centered Interactions in the Internet of Things Teemu Leppänen, Iván Sánchez Milara, Jilin Yang, Joonas Kataja and Jukka Riekki Center for Ubiquitous Computing, University of Oulu, Finland
Center for Ubiquitous Computing
2
SMC 2016
Center for Ubiquitous Computing. Research activitities Shared
Personal Sense
Connect
Visualise
3
SMC 2016
Public
Current IoT architectures Cloud infrastructure
4
SMC 2016
What is the role of humans in IoT
???
5
SMC 2016
Current IoT architectures Cloud infrastructure
6
SMC 2016
Humans in IoT
Icons designed by Madebyoliver from Flaticon
Humans as communication nodes
Humans as processing nodes
Humans as actuators
D. Nunes, P. Zhang, and J. Silva, “A survey on Human-in-the-Loop applications towards an Internet of All”, IEEE Commun. Surv. Tuts., vol. 17, no. 2, pp. 944-965, February 2015. 7
SMC 2016
What should the role of humans in IoT
???
CC Attribution license. Postscapes and Harbor Research. http://www.postscapes.com/what-exactly-is-the-internet-of-things-infographic/
8
SMC 2016
Interactions in IoT
Thing to Thing
Human to Thing
Human to Human
A. M. Ortiz, D. Hussein, S. Park, S. N. Han, and N. Crespi, “The Cluster Between Internet of Things and Social Networks: Review and Research Challenges,” IEEE Internet Things J., vol. 1, no. 3, pp. 206–215, Jun. 2014. 9
SMC 2016
How can we build those interactions ?
10
SMC 2016
Mobile Agents Application design paradigm based on software agents with mobility Social
Intelligent
Autonomous
Mobility
SOFTWARE FRAMEWORK – Mobile agents -> multi-agent system in IoT – System components modeled as resources and accessed with Web protocols (HTTP & CoAP) for interoperability T. Leppänen, M. Liu, E. Harjula, A. Ramalingam, J. Ylioja, P. Närhi, J. Riekki, and T. Ojala, “Mobile Agents for Integration of Internet of Things and Wireless Sensor Networks,” in 2013 IEEE International Conference on Systems, Man, and Cybernetics, 2013, pp. 14–21.
11
SMC 2016
NFC NEAR FIELD COMMUNICATION – Short range wireless technology (~5cm) – Data stored permanently in the tag – Readers embedded in mobile phones Reader/Writer
12
P2P
SMC 2016
Card Emulation
Mobile agents interactions (I)
Mobile agent
Thing to Thing
13
SMC 2016
Mobile agents interactions (II) Mobile agent
Mobile agent
Human to Thing Mobile agent
Mobile agent
14
SMC 2016
Mobile agents interactions (III) Human to Human
Mobile agent
Mobile agent
Mobile agent
Mobile agent
Mobile agent
15
SMC 2016
System architecture Web Service
Migration through HTTP request
Agent requests data / actuates component
Device Migration through NFC (social interaction)
Migration through NFC
Sensor/ Actuator
Migration through COAP message
Device Sensor/ Actuator
16
SMC 2016
Smart phone application
17
SMC 2016
Summary • Humans are part of the IoT – It is necessary consider thing-to-thing, human-to-thing, human-tohuman interactions – Move away from classical person-as-observer paradigm
• We present an homogenous interaction method for the IoT – Best suited for scenarios where users should be in control – Technology enablers: Mobile agents and NFC
• We implement a real world prototype to verify the feasibility of the system
18
SMC 2016
Thanks for your attention!! Questions?
[email protected] [email protected]
19
SMC 2016