Interactive assistant robot Moaz al Hosny Student at Department of Communications and Electronics Engineering Faculty of Engineering – Philadelphia University E-mail:
[email protected]
Rhythm Kr Das Student at Department of computer application at JIS College of Engineering at India E-mail:
[email protected]
information and team work:
your remote control any where this is big problem, so we think about control you smart home by using your voice and every where around home. So our project is like as voice command system this means a system that processes the voice as input, decodes Or understands the meaning of that input processes it and generates an appropriate voice output or some physical instruction done by controlling system.
Team at Research-Gate
Any voice command system need three basic components which are speech to text converter, query processor and a text to speech converter.
Worked on this paper between two cities
Jordan and India
Our solution for building like this voice command system (interactive assistant robot) is Amazon Alexa service that help us to make all of that processes in efficient way.
We proud for working together
ABSTRACT
This services help us with its capability, such as voice interaction, music playback, making to-do lists, setting alarms, streaming podcasts, playing audiobooks, and providing weather, traffic, and other real time information, such as news, control car appliances, etc. ….
The evolution of robotic sciences and the important of this field in human life, induce us to make simple and efficient talkative assistant robot. Therefore, we want to talk about one simple kind of assistant robot that we build it ,because this kind of robot give us more help in our daily needs.
This interactive robot with Alexa services can turn on using two methods: wake word engine or bush button.
This paper talk about new method to make robot that assist human in conversational way. After hard working we conclude in this paper the procedure to make Alexa assistant robot using Raspberry-Pi three, speaker, microphone and supplementary elements. this project depends on Alexa services on amazon cloud .
In our project we use bush button because when we use work word engine, the noise take apart in turning Alexa services on.
2. Methodology
1. Introduction :
The way for building like this robot (interactive assistant)
Any one in this life prefer to use his sound rather than using touching objects to communicate with devices.so the conversational method is more widely used .
We need to microcomputer that has capability to do voice processing, and receive and send query to Amazon website.
2.1 Processing system
So when we think about smart home as example, we can assume the controlling system in the home use buttons and remote control to control whole systems in your home. That method it is very hard because if you lose
The chosen microcomputer is Raspberry pi 3 that has very useful specification such as small device and has all kind of input that aid us in this project. 1
We can use another microcomputer but in all kind of engineering project we must care about cost and performance.
Lets talk about specification of raspberry pi 3[ref]:
A 1.2GHz 64-bit quad-core ARMv8 CPU 802.11n Wireless LAN Bluetooth 4.1 Bluetooth Low Energy (BLE) Camera interface (CSI) Display interface (DSI) Micro SD card slot (now push-pull rather than push-push) Video Core IV 3D graphics core
Uses USB port for power, no external power needed Digital Class-B Power Amplifier inside State of the art digital technology User talk Raspberry pi 3
Speech to text Microphone plugged in sound card
The figure 1 show Raspberry pi 3 that we used for this project.
Using amazon services
Voice recognition and understanding the instruction
Retrieve critical query that have the desired output
Text to speech processing
Speaker
Figure 1 raspberry pi 3
2.2 Voice recognition system
Figure 2 voice recognition in hardware overview
In this project to make as talkative interactive robot we must need to speaker and microphone to make sure that robot understand what you talk.
The sound car that we used is shown at Figure 3.
The overview block diagram for work steps for voice recognition is shown at Figure 2. We use USB sound card that have these specifications: USB sound card convert digital signal to analog signal because Raspberry Pi 3 does not support mic input or does not has sound card built-in.
Integrated 2 channel USB Audio Controller Real USB Plug and Play drives 2Ch speakers directly supports 3D positional sound and virtual 5.1 Ch sound track
Figure 3 USB sound card
2
Another important thing is speaker. We use 3.5 mm jack speaker as shown in Figure 4.
Figure 6 DC fan
2.4 Powering system In our project we can use voltage regulator that is plugged in electrical socket at home or for movement system we can use batteries bank. That shown at Figure (7) .
Figure 4 speaker that is used in this project
The microphone that seen at Figure 5 are plugged in USB sound card to make analog to digital sound processing.
Figure 7 batteries bank that we used in this project Figure 5 microphone jack
This is a 8 cell battery pack. each of the battery contain: Table 1 table for batteries specification
2.3 Cooling system
Nominal Capacity
Because the high computation on raspberry pi we must use cooling system on it , the component of it ,they are:
Minimum Capacity
Heat sink and fan.
Charging Current
The fan shown at Figure 6. We use 5 Volt DC fan used to cool the CPU,GPU and wireless card.
Charging Time
2600mAh (0.2C, 2.75V discharge) 2550mAh (0.2C, 2.75V discharge) Standard charge: 1300mA Rapid charge : 2600mA Standard charge: 3hours Rapid charge : 2.5hours
3
Figure 8 overview of the our prototype
After this hard work the over all view of the our project is shown at Figure 8.
3. objectives this device can be used in many area that help people in many aspect such as, weather conditions, play music, answer questions etc…..
2.5 System Software and firmware In this prototype we use used Linux Kernel and voice assistant script are developed in python, Rubby, shell, PHP.
this project can be used for: Educational purpose – you can ask any type question like general question, basic mathematical problem, scientific question etc. Home automation – This device can use in home Automation system. you can control your home appliance (e.g. Light, fan, TV etc.) by talking or set preload command and it also have own decision making power to do a task. Entertainment: This device can Play your favorite music, FM radio, click picture, surfing internet. Health and fitness: This device can guide you in fitness tips as well as guide health. Automobile Automation: Control your car appliances (eg. light, AC, Music system etc).if this system used for smart home and controlling your home
2.6 Circuit diagram Fritzing circuit diagram in shown at Figure 9.
Figure 9 circuit diagram
4
4. Future work We hope to add some feature on this project like; camera for face and motion detection ,connect it to the home for building smart home controlled by conversational interactive assistant robot.
5. Conclusion in this paper we talk about interactive assistant robot and how the developers can make it in simple way. This paper focused on how we can use raspberry pi 3 as interactive robot with Amazon Alexa services.
References: [1]. Fong, T., Nourbakhsh, I., & Dautenhahn, K. (2003). A survey of socially interactive robots. Robotics and autonomous systems, 42(3), 143166. [2]. Shubham Oulkar Ram Baman Sagar Gulave And Pravin Kothawale . VOICE CONTROLLED HOME AUTOMATION USING RASPBERRY PI 3.International Journal of
Recent Innovation in Engineering and Research. [3]. https://www.raspberrypi.org/ [4]. Magpi book series.
5
