International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 22785841, Vol 1, Issue 7, December 2012.
ARM9 Based Real Time Embedded Network Video Capture And SMS Alerting system M.L.V.N.B.S.Kumar#1, Dr.N.S.Murthi Sarma#2, Ch.Sridevi#3, A.Pravin#4 #
ECE Department, BVC Engineering College Odalarevu 1
[email protected] 2
[email protected] 3
[email protected] 4
[email protected]
Abstract— In This paper, Network video capture system using friendly ARM9 board support package (BSP) S3C2440 is presented. This application system captures video, shares among networked systems and also alerts the controlling person with short message service alarm as required by the client. This system works in a real time environment and is supported by embedded RT Linux. This system provides low cost and high effective intelligent monitoring system like in elevators, home security systems etc with low power consumption. Unlike other embedded systems this real time system provides client video monitor with the help of friendly ARM9 BSP.
The rest of paper is organized as follows: in section II, The main architecture of the video capturing and alerting system. In section III and IV, its hardware design and software design are described in detail. Finally Results and Conclusion are made at the end of the paper.
Keywords—BSP , Friendly ARM9 , Embedded RT Linux, real time environment , Client video monitor
The network video surveillance system mainly consists of video capture system based on friendly ARM9 board support package, Ethernet interfaces for wired and wireless internet accesses, display device cum touch panel and Global system for mobile communication module. This capturing and alerting system is a real time system based on RT Linux [5]. GSM module is interfaced for alerting the controlling person from the client. Captured video is displayed both in the sharing network and on the display at the client.
I. INTRODUCTION Recent years monitoring facilities are necessary and useful for our daily life to make ourselves secure. From small firms to many large companies some kinds of video capturing systems have introduced to keep their security. In this paper video surveillance system[2] is designed bases on real time operating system i.e RT Linux. The video data collection and sharing are designed with ARM9 processor and Ethernet controller. The video data collection is designed with the capability of both wired and wireless internet accesses. The new version of our surveillance system will be powerful and useful for several kinds of clients. So one can say this system is client security oriented system. In this paper it is introduced new surveillance system that captures video, shares through wired or wireless internet access and alerts the controlling person through short message service[1]. This short message service is accompanied by Global system for mobile communication module.
www.ijrcct.org
II. MAIN ARCHITECTURE OF THE VIDEO CAPTURING AND ALERTING SYSTEM
[email protected]
Figure: 1 Diagram of system architecture
Page 489
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 22785841, Vol 1, Issue 7, December 2012. III. HARDWARE DESIGN In this paper it is considered ARM9 processor module, which has on board peripherals. It is an SOC chip[8] based on ARM9 with low power, high performance, very suitable for embedded product development. The application system hardware uses external peripherals GSM modem, RGB web camera, LCD cum Touch screen panel. And also standalone PCs for loading real time operating system, for loading applications and to see the captured video through wired or wireless internet access. The hardware structure of the application system is as shown in Figure: 2.
5) Serial (TTL) interface to connect serial devices like GSM modem. 6) Power plug to activate all peripherals on the ARM9 board. 7) Serial (RS 232) interface for debugging pupose. 8) RJ45 interface to Ethernet controller. 9) USB slave interface to load the operating system into NOR flash. 10) Stereo output to give audio output signals. 11) Ethernet controller for wired or wireless internet access. 12) Real time clock for real time opreration. 13) Nand flash memory which can be used as application memory. 14) NOR flash memory which can be used to load the operating system. 15) CMOS battery for operating real time clock. 16) USB host interface to connect RGB web camera. 17) SD card interface to connect external memory. 18) General Purpose Input output (GPIO) for connecting external I/O devices. In addition to this the ARM9 board also contains LCD cum touch panel interface. IV.SOFTWARE DESIGN AND DEVELOPMENT
Figure: 2 Diagram of Hardware structure And the structure of friendly ARM9 board is as shown in the Figure: 3. The on board peripherals are
Figure: 3 Diagram of Friendly ARM9 Structure 1) ARM9 Processor which is used to process the information received and to interconnect all peripherals. 2) 64 MB SD RAM 3) 64 MB SD RAM 4) PWM Buzzer to provide beep output when ever required.
www.ijrcct.org
The application system uses a real time operating system RT-Linux. Here we have used ubuntu 12.04 operating system. And by using the cross compiler arm-gcc-4.3.2[1] to compile kernel Zimage X35. The structure of Application system is Network Protocol Applications Qtopia file system Application program interface Zimage kernel Supervivi Bootloader ARM9 Hardware Figure: 4 Diagram of Software structure To activate ARM9 board support package in a real time environment the operating system installation is must. First one can install the USB driver and set the development board to NOR Flash. After the Linux system installation is complete, please set the board to Nand Flash. The steps of Linux installation is as explained below 1) Partition the Nand Flash 2) Install the bootloader 3) Install the kernel file 4) Install the File system A. Partition. 1) After connecting serial port and opening Hyper Terminal, power the development board and enter BIOS menu in personal computer.
[email protected]
Page 490
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 22785841, Vol 1, Issue 7, December 2012. 2) Select [f] to start partitioning Nand Flash as shown Figure: 5.
Figure: 5 Screen shot of Hyper Terminal for BIOS menu B. Installing Bootloader(Supervivi) This bootloader initializes all the peripherals of the BSP S3C2440 and also brings back the operating system to RAM. Supervivi is developed from vivi, supervivi-64M and supervivi-128M is applied to 64M and 128M-1G development board respectively. Because the usage and the function of them is same, so one can call them supervivi collectively. 1) Open DNW and connect USB cable, [USB :OK] in the title bar indicate the USB cable is connected successfully. Then select function [v] to upload supervivi. 2) Click “USB Port->Transmit/Restore” and select the file supervivi located in “images/linux” to upload. 3) After uploading is complete, the BIOS will burn supervivi to Nand Flash partition and then return to main menu.
enables you to compile and run your applications on RT Linux (ubuntu). 64M and 128M-1Gb mini2440/micro2440 has different file system downloading image which corresponds to root_qtopia-64M.img and root_qtopia-128M.img. Actually content of both images is same except the difference of the making tools (mkyaffs2image). So we call the file system image root-qtopia.img collectively. 1) Select the function [y] in bios menu to download root file system image. 2) Click “USB Port->Transmit/Restore” in DNW and select the corresponding image root-qtopia.img located in images\linux\ to download. 3) After downloading is complete, BIOS will upload kernel to Nand Flash partition and return to main menu 4) The procedure of uploading will last 2-3 minutes. The duration of image uploading is related to file size. 5) After uploading is complete, please unplug USB cable. If not, it may cause computer crash when you start or reset the system. 6) Select function [b] in BIOS menu will start system. If you set the starting mode of the development board as Nand Flash, the system will start when power is applied. The program flow diagram of the application system is as follows
C. Install the kernel file This kernel defines the functionality of all peripherals so that they are ready to work when they are initialized. Linux kernel is appropriate for 64M/128M-1Gb Nand Flash for FriendlyARM mini2440. 1) Select function [k] in BIOS menu to upload linux kernel zImage. 2) Click “USB Port->Transmit” in DNW and select corresponding kernel zImage located in “images\linux\” to upload. 3) After uploading is complete, the BIOS will burn kernel to Nand Flash partition and then return to main menu D.Install the File system This file system creates visibility of the peripherals functionality on ARM9 platform. Qtopia file system is a cross – platform, graphical, application development tool kit that
www.ijrcct.org
[email protected]
Page 491
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 22785841, Vol 1, Issue 7, December 2012. Figure: 6 Diagram of Program flow of the Application system As shown in the flow diagram first one can initialize video capture equipment. Convert it by changing various parameters to display it on the LCD screen on S3C2440 board. By enabling the collection window in acquisition mode[1] the video capture process starts later store the captured video and share it through wired/wireless network. After sharing enable the GSM module and send SMS to the controlling person if client is facing any problem. This process is carried out by the following code blocks A. It is the first to capture the video file using the class and objects Cvcapture *camera = cv createcameracapture(0); B. And to get the video use the following constructor Assert(image); C. After acquiring the video, release the capturing equipment by using the following method cvReleasecapture(&camera); D. And create the widgets on the panel by using the following constructor QopenCV widget::QopenCV widget(Qwidget *parent): Qwidget(parent); E. For creating buttons on the LCD screen we use the constructor Button::Button(); F. For buzzer outputs the following constructors are used Void buzzer setfreq(int freq); Void buzzer Beep(); G. And to create the keyboard on the LCD panel using the constructor Keyboard(Qwidget *parent); In addition to these peripherals, the application system enables the GSM module by the following AT commands AT+CNMI= “0,0,0,0,0,0,0”; /*sets a new way of SMS tips*/ AT+CMGF=1 /*sets SMS format*/ AT+CMGF? AT+CMGS= “ “; /*sends aSMS command*/ AT+CMGD=1; /* deletes SMS message*/ In order to establish SMS alerts, it is necessary to use the AT commands to design sending and receiving of SMS including SMS text. SMS provides remote monitoring. When client is in abnormal situation client can send SMS to required number. Thus it provides client security oriented system. Compiling Procedure In terminal prompt of ubuntu operating system first one has to create super user i.e from $ to # by using the command Sudo su After that create a folder by using the command Mkdir santhosh Open the created folder by using cd santhosh Create a new ‘C’ file by the command
www.ijrcct.org
vi networksms.c After this press ‘i’ to get into insert mode and enter the program like #include Main() { Printf(“network video capture”); } Press ‘Esc’ to get out from insert mode and save the program by the command :wq! Finally compile the program by using the command gcc networksms.c And get the output by the command ./a.out The terminal window will be as follows
Figure: 7 Screen shot of execution in terminal window Finally real time video is captured and is loaded to LCD display of S3C2440 chip in jpeg format with its GUI support. V. RESULTS Once RGB web camera is connected through master USB interface to S3C2440 board , make COM port settings in the hyper terminal window and after that dump ‘/bin’ file into ARM9 board, one has to set the following IP address: 192.168.1.200 Subnet mask: 255.255.255.0 Gateway: 192.168.1.1 After these settings the captured video will be displayed on the LCD of the ARM9 board[1]. Later if one enters 192.168.1.230 in the internet explorer browser address bar , gets the camera captured real time video on the networked systems supported by Ethernet controller. Later if any abnormal situation arises at the client, one can send message through short message service with the help of GSM module. The result is as shown as Figure :8
[email protected]
Page 492
International Journal of Research in Computer and Communication technology, IJRCCT, ISSN 22785841, Vol 1, Issue 7, December 2012. 7.
LCD : Liquid Crystal Display cum Touch screen panel provides display for the captured video. 8. GSM : Global System for Mobile communication modem is used to alert the controlling person using short message service. 9. Wi-Fi : Wireless Fidelity is the wireless internet access technology for video sharing. 10. Ethernet : Technology for connecting number of systems through a network. 11. GUI : Graphical User Interface for providing path to display the image frames on the LCD cum Touch screen panel. 12. Ubuntu : One of the versions of real time linux operating system that is supported by ARM9 board.
Figure: 8 Screen shot of Result of the application system with my own image
REFERENCES
VI. CONCLUSION
[1]
An Embedded network video capture and SMS alerting system has been introduced in this paper. It provides remote monitoring facilities and some characteristic properties are illustrated to be useful in the applications. The system performance has been explained in relation to the response speed of captured video display at the client, transferred video display at the controlling person and alert through GSM from client. With our surveillance system not only remote monitoring but also by the SMS alerts, controlling action will be taking place in lesser span. Thus our application system provides better security solutions. And in future we can also connect display systems through wireless network connections like wi-fi, wimax etc. APPENDIX GLOSSARY 1. BSP : Board Support Package of mini ARM9 to interface other external peripherals directly. 2. SMS : Short Message Service with the help of GSM module. 3. RT Linux : Real-Time Linux operating system to make the application system as a real time system. 4. Surveillance : Close monitoring to provide better security at the client. 5. SOC : System On Chip, The mini ARM9 board is designed on single silicon chip. 6. USB : Universal Serial Bus host/slave interface for connecting the video capture device and to load the operating system into the ARM9 board.
www.ijrcct.org
Duanchun ZHOU, Guangxing TAN. “ Network Video Capture and Short Message Service Alarm System Design Based on Embedded Linux” : IEEE Conference on Natural Computation, pp.3605-3608, 2010. [2] Wang Liwei, Yan Shi, Xu Yiqiu. “A Wireless Video Surveillance System based on 3G Network” : IEEE Conference on Environmental Science and Information Application Technology, pp.592-595,2010. [3] Xiaoguang Li, Yingting Ji, Lifeng Zhang. “ARM9-Based Embedded Linux and video capture system” :Conference on Electronic Measurement Technology, (02)pp.102-104, 2009. [4] Guowei WANG, Tiecheng SONG, Zhengshi CHEN. “Video Surveillance Server Based on Embedded Web Server” :International journal of Computer Engineering, (22)pp.202-204, 2005. [5] Yang Jian-wei, Yang Jian-xiang. “ Linux Transplant Based on the Processor of S3C2410” : International journal of InformationTechnology, (8):0097-0100, 2007. [6] Liu Chun-cheng. “USB Webcam Driver Development Based on Embedded Linux” : International journal on Computer Engineering and Design, 28(8):1885-1888, 2007. [7] P.Krishna Kishore, B. Chinna Rao, P.M.Francis. “ARM-Based Mobile Phone- Embedded Real-Time Remote Video Surveillance System With Network Camera” : International journal of Emerging Technology and Advanced Engineering, 2(8):138-142, 2012. [8] Bala Krishna.Sare, Gogineni Rajesh Chandra, Naresh Kumar Reddy.B. “ The Higher Security Systems for Smart Home using Advanced Technology”. International Journal of Engineering Science & Advanced Technology, 1(1): 36-39, 2011. [9] Qing XuanCai, YinSong Pan. “The USB-based embedded VIDEO4LINUX video signsl acquisition” :International journal of Electronic Design and Application, (02):40-42, 2009. [10] G. Senthi Kumar, S.Ragu , N. Siva Kumar. “Embedded Video Surveillance With Real time Monitoring On Web” : International Journal of Mathematics Trends and Technology, 46-49, 2011.
[email protected]
Page 493
