VOL. 3, NO. 3, March 2012
Journal of Emerging Trends in Computing and Information Sciences
ISSN 2079-8407
©2009-2012 CIS Journal. All rights reserved. http://www.cisjournal.org
Gait Based Personal Identification System Using Rotation Sensor Soumik Mondal, Anup Nandy, Pavan Chakraborty, G. C. Nandi
Robotics & AI Lab, Indian Institute of Information Technology Allahabad, India
{
[email protected],
[email protected],
[email protected],
[email protected]}
ABSTRACT Every individual has a unique walking pattern which may be used as a signature for identification. This paper describes the construction of a feasible human identification device using human gaits (Walking pattern). We have built a very low cost wearable suit mounted with eight rotation sensors, controller, software and power unit for measuring eight major joints of human body which are involved in locomotion. Different person’s walking patterns can be captured with this suit which has been named IGOD (Intelligent Gait Oscillation Detector). IGOD meets an excellent standard of accuracy for capturing movements of major joint’s oscillation during locomotion. A gait classifier has been designed using ANN (Artificial Neural Network) and LDA (Linear Discriminant Analysis) combined with a bottom up binary tree approach. The designed system is free from environment and projection uncertainties, which normally plague any vision based systems. The device has been tested with 30 subjects (Persons). We have achieved a high recognition accuracy of up to 100% over this limited sample of 30 persons. Keywords: Human Gait analysis for identification, Non Vision based approaches, Artificial Neural Networks, Linear Discriminant Analysis (LDA) with Binary Tree, Intelligent Gait Oscillation Detector (IGOD), Arm swing.
1. INTRODUCTION Research on human identification at a distance through video surveillance was started from 1999 and it has become popular since 2002. There were several DARPA (Defense Advanced Research Project Agency) projects involved in video surveillance based applications for criminal investigations and other asymmetric threats of national security. In gait biometric human walking pattern is an important signature for identification. The objectives are: •
To extract body biometric features.
•
To identify the person from those features.
Normally such work is done using vision based techniques. The advantages with such techniques are that they can be performed without the knowledge of the subject, and therefore no physical cooperation from the subjects is required. In recent years plenty of research papers have been published on vision-based human identification system. Although it attracts an enough impact on personal identification but there is no full proof methodology which can be applied on the real world. Gait pattern is considered to be the most promising attribute for human identification and video surveillance system. The accurate measurement of gait pattern and extraction of appropriate gait features provides an advantage for personal identification. There are several problems and complexities involved in vision based approaches. It attracts its inability to identify person accurately due to
environmental changes, poor illumination and low resolution of camera, background changes variations of different cloths, speed variations, carrying with bags and changes of walking direction which are affected in person walking. Also the vision based techniques for gait recognition required extraction of silhouette image from the original image data which needs computationally very complex algorithm. The challenging and feasible system of wearable sensor based personal recognition has been introduced in this paper. The most common wearable sensors which are used in this recognition systems are Accelerometer, Gyro and Force sensors (from 2004-2011) [1]. For the first, we introduced rotation sensor based personal recognition system which keeps the system low cost with better accuracy. A multi sensor based wearable biometric suit has been designed to capture human gait oscillations of eight major body joints simultaneously [2]. It is then followed by finding the suitable features which could be useful for human recognition purposes. ANN and LDA with bottom up binary tree technique have been used as a gait classifier separately for personal identification. The advantage with our method is the signal directly proportional to the rotation angle which we have already calibrated. This self made recognition device could be considered as a biometric tool for the research in Human Gait analysis and the extraction of gait signatures in medical diagnosis applications [2, 3]. The major drawback of our system is that it requires full cooperation from the subject. However, it offers much better accuracy in dynamic changes of the environment. We have tabulated different non-vision based techniques used in gait analysis in Table I. The methodology of this work has also been mentioned under the heading of techniques.
395
VOL. 3, NO. 3, March 2012
Journal of Emerging Trends in Computing and Information Sciences
ISSN 2079-8407
©2009-2012 CIS Journal. All rights reserved. http://www.cisjournal.org
Table 1: Related work in vision based and non vision based approaches. Authors / References Gafurov et al. [4], [5] Nakajima et al. [6] Middleton et al. [7] Ottaviano et al. [8] Derawi et al. [9], [10] Rong et al. [11] Pan et al. [12] Moustakidis et al. [13]
Technique
Feature Data Non-Vision
Accelerometer Sensor based gait recognition.
Acceleration in 3 directions Direction and position Time on toe to time on heel ratio
Gait
Data set / No. of class 21
Footprint
10
Gait
15
Position, Orientation and force.
Human Walking
NA
Gait cycle detection using DTW Gait cycles, gait feature code using DTW Acceleration in 5 different body parts Medial lateral, Anterior Posterior, and vertical force
Gait
60
Gait
35
Gait
30
Gait
40
Pressure sensor based personal recognition system with Euclidean distance taken as a classifier. Floor sensor based recognition system with stride length, stride cadence and time on toe to time on heel ratio taken as a feature. Human walking characteristics analysis using Cassino Tracking System with force sensor. Accelerometer sensors Based Gait Authentication with Cross Comparison and Cyclic Rotation Metric taken as recognition methods. Identification of human by walking pattern using gait acceleration with the help of accelerometer sensor. Accelerometer sensor based gait recognition for human identification. Human Identification using Ground Reaction Force. Here SVM taken as a classifier.
Biometrics
Figure 1: (a) Rear and (b) Front view of IGOD suit. (c) The locations of the eight rotation sensors are shown. The sensors are placed at shoulder joints, elbow joints, hip joints and knee joints. In total eight rotation sensors.
2. OBJECTIVE OF THIS RESEARCH WORK The main objective of this research is to develop a low cost, portable, non-invasive wearable sensor based biometric suit which could be applied to different applications like, • •
Human Identification Human Robot Interaction
• • • • • •
Gesture Classification Human Computer Interaction Diagnostic Gait Signature Detection Find the effect on gait with different age, body weight and different diseases. Analysis of abnormal gait signature Bio-inspired Bipedal robot controller [14] etc.
In this paper several contributions have been shown which
396
VOL. 3, NO. 3, March 2012
Journal of Emerging Trends in Computing and Information Sciences
ISSN 2079-8407
©2009-2012 CIS Journal. All rights reserved.
periodically appeal their own success.
http://www.cisjournal.org
The contributions are • • • • • •
Introduce a rotation sensor based biometric wearable suit for human identification. Personal recognition system which can be applicable to real world situation. Simple feature selection procedure which could help us to recognize the person with up to 100% accuracy. Choose the real time pattern recognition algorithm compatible with our feature. Better accuracy has been achieved rather than existing approaches. Hand oscillation for human identification.
3. DATA COLLECTION AND FEATURE EXTRACTION In this work, we have used a self made wearable body suit for capturing the human gait data in real time. Those data are being represented in the form of gait angular movement. The following descriptions concentrate on data capturing technique followed by feature extraction process. 3.1 Body Suit Description Our self made multi-sensors based biometric suit is being made by rotation sensors (i.e. potentiometer taken as a transducer and the resolution of the potentiometer is 0-300 degree) for measuring accurate joint angular movement. The sensors are mounted on the steel and aluminum plates for maintaining the rigidity. Those rigid links are placed on the different body joints (i.e. 2 knees, 2 hips, 2 shoulders and 2 elbows) for measuring the major body joins which are involved in human locomotion in the form of angular rotation [2]. Initially, the IGOD suit is used to get the raw data which is in the form of digital counts between 0-1000. Then we find out the zero corrected data from the raw data which eventually is to be converted in the corresponding angle values. The entire process is being done by the following formula given by:
(a)) and front (Figure 1 (b)) view. Figure 1 (c) clearly shows the locations of the eight rotation sensors.
One of the major difficulties involved in such wearable sensor based system talks about the sensors cannot be attached at the same position over all the time or at the accurate pivot point of each joint angle. As a result the system is needed for proper calibration. At first the sensor has been mounted loosely around the joint pivot point. The joint is made to move the whole range of its oscillation. After a few oscillations the loosely mounted sensor navigates to the most preferred position of the joint pivot point in tune with the natural oscillation of the particular joint. Now the sensors are being tightly fastened. By doing this process we can achieve a good level of confidence in order to ensure the repeatability in the position of the sensors. 3.2 Data Collection The experimental data have been collected for our research work using this prototype. We have created the Gallery data bases for normal walking for 30 (25 male and 5 female) different humans with 30 sec time interval taken in 10 different sessions. The age of our volunteers is about 20-30 years. According to our different volunteer’s point of view the suit does not affect their natural walking. In each session we have taken 30 sec of walking data in order to offer some amount of freedom to their normal walking. It was observed that a person wearing this suit required at list few gait cycles to stabilize and naturalize his/her intrinsic gait movement. Therefore 30 sec of data was taken. 3.3 Feature Extraction Suitable feature extraction is one of the most challenging aspects of any pattern recognition problem. First we need to understand the different phases of a gait cycle. Figure 2 illustrates this different phases of the gait cycle. The left leg is represented in red, while the right leg represented in black. When right leg is in the stance phase the left leg goes through a swing phase and then roles are reversed forming a complete gait cycle.
𝟑𝟑𝟑𝟑𝟑𝟑
𝜽𝜽𝒊𝒊𝒊𝒊 = �𝝋𝝋𝒊𝒊𝒊𝒊 − 𝝆𝝆𝒋𝒋 � × 𝟏𝟏𝟏𝟏𝟏𝟏𝟏𝟏, where 𝜽𝜽 is the desired angle, 𝝋𝝋 is the raw data captured from the suit, 𝝆𝝆 is the initial digital count, 𝑤𝑤ℎ𝑒𝑒𝑒𝑒𝑒𝑒 𝒊𝒊 = 1 to Total no. of samples and 𝒋𝒋 = 1 to 8 (corresponding joint). Here initial digital count 𝝆𝝆 implies all the joint angle values captured at the position of the person standing without any joint movement. In our previous work [2] we had attempted to show that the theoretical concept of human locomotion and the practical data taken by this suit are equally be in similar. Figure 1 depicts a person wearing the IGOD suit with rear (Figure 1
Figure 2: Different phases of human locomotion within a gait cycle.
397
VOL. 3, NO. 3, March 2012
ISSN 2079-8407
Journal of Emerging Trends in Computing and Information Sciences ©2009-2012 CIS Journal. All rights reserved. http://www.cisjournal.org
Having studied the human physiology we found that each and every gait cycle is independent on each other in human locomotion. It belongs to within the session when the walking pattern tends to be very straight forward and highly stable. Therefore, our objective is to find out the suitable features for recognition purposes within the gait cycle. The feature vectors are selected by calculating the mini mum and maximum angle values of each major joint within the gait cycle and the time propagated by that gait cycle. As the time plays a prominent role in an individual recognition using human gait so our total feature matrix is composed of 17 dimensions. Every gait cycle has been decomposed into substantial parts which are known as one sample of oscillation. The number of sample is extracted from the person’s different gait which is dependent on the normal walking speed. The angular movement for each leg joint is based on the stride length. Figure 3 and Figure 4 explain the total feature extraction process for the captured gait data set. In those two figures we have shown only two consecutive gait cycles in the same gait.
Hip joint oscillation of a human is close to a sinusoidal motion. Therefore the period of oscillation T could be determined from the time gap between two consecutive maxima. Any measured signal has some amount of noise therefore determining the peak time tpk for the maximum will not be straight forward. Fowling centroid method is used to calculate tpk. Figure 5 with graphically illustrates this centroiding technique and calculating the period Tk. The shaded portion above the threshold θ0 shown in the figure is used for weighted centroiding.
Where θ0 is threshold angle, which we fix between the minimum and maximum. We then compute kth maxi mum tpk ̅ = � 𝜃𝜃𝑖𝑖5 , 𝜃𝜃𝑘𝑘5 𝑖𝑖
𝑡𝑡𝑝𝑝𝑝𝑝 =
����𝑘𝑘5 = � 𝜃𝜃𝑖𝑖5 . 𝑡𝑡𝑖𝑖5 , 𝜃𝜃𝜃𝜃 𝑖𝑖
𝑓𝑓𝑓𝑓𝑓𝑓 𝜃𝜃𝑖𝑖5 > 𝜃𝜃0
̅ 𝜃𝜃𝑘𝑘5 = � 𝜃𝜃𝑖𝑖5�� 𝜃𝜃𝑖𝑖5 . 𝑡𝑡𝑖𝑖5 �� �� 𝜃𝜃𝜃𝜃𝑘𝑘5 𝑖𝑖
𝑖𝑖
𝑇𝑇𝑘𝑘 = 𝑡𝑡𝑝𝑝𝑝𝑝 −1 − 𝑡𝑡𝑝𝑝𝑝𝑝
The period Tk , is the time gap between two consecutive peaks k and k-1.
Figure 5: Graphical illustration of centroiding technique to compute the peak time tpk using a threshold θ0 . The period of oscillation Tk is calculated the peak time tpk.
Figure 3: Oscillation curves of the Right Elbow, Shoulder, Hip and Knee. The features extracted are the maximum and minimum joint angle value and the gait cycle. These have been marked in the figure.
398
VOL. 3, NO. 3, March 2012
Journal of Emerging Trends in Computing and Information Sciences
ISSN 2079-8407
©2009-2012 CIS Journal. All rights reserved. http://www.cisjournal.org
Figure 4: Oscillation curves of the Left Elbow, Shoulder, Hip and Knee. The features extracted are the maximum and minimum joint angle value and the gait cycle. These have been marked in the figure. (Please note the gait cycle shown in this and figure 3 should be the same)
4. METHODS USED FOR RECOGNITION
constituted in such a manner so that the each layers output could be propagated with minimum error rate.
The Figure 6 describes the steps for recognizing the gait pattern. The process begins by recoding the movement-joint angles values (First 3 blocks of Figure 6). Feature extraction matrix is created from the measured joint angles. Two pattern recognition algorithms ANN and LDA have been used for recognition.
In our research work we have used ANN with Feed forward Networks and 30 hidden Neurons [15]. We have considered 60% of the total sample is for training and rest of the sample for testing. We have been achieved up to 100% recognition accuracy. 4.2 Linear Discriminant Analysis (LDA) We have used Linear Discriminant Analysis (LDA) [16][19] for several reasons. It helps us to provide a better understanding of the distribution of our feature data. In our research it is more efficient for data classification which offers us very good class separability among our classes of data. When we have done transformation of our original data sets to a 2D space it is observed that a decision region has been drawn effectively between our given classes.
Figure 6: Recognition phases.
We can find the LDA function from the Bayes' rule. If we have n classes, the Bayes' rule is assigning the object x to class a, where 𝑷𝑷(𝒂𝒂|𝒙𝒙) > 𝑃𝑃(𝒃𝒃|𝒙𝒙), 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃. We cannot get 𝑷𝑷(𝒂𝒂|𝒙𝒙) directly from the measurement but we can obtain 𝑷𝑷(𝒙𝒙|𝒂𝒂). So, the modified Bayes’ Rule is to assign the object x to class a, where
4.1 Artificial Neural Network (ANN) ANN is a very well known and very well acceptable pattern recognition tool applied in any machine learning applications. We have chosen ANN in gait identification for two reasons: It gives us the advantage to deal with our nonlinear data. The highly non linear structured neurons are
𝑷𝑷�𝒙𝒙│𝒂𝒂�. 𝑷𝑷(𝒂𝒂)
∑∀𝒌𝒌 𝑷𝑷�𝒙𝒙│𝒌𝒌�. 𝑷𝑷(𝒌𝒌)
>
𝑷𝑷�𝒙𝒙│𝒃𝒃�. 𝑷𝑷(𝒃𝒃)
∑∀𝒌𝒌 𝑷𝑷�𝒙𝒙│𝒌𝒌�. 𝑷𝑷(𝒌𝒌)
, 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃
399
VOL. 3, NO. 3, March 2012
Journal of Emerging Trends in Computing and Information Sciences
ISSN 2079-8407
©2009-2012 CIS Journal. All rights reserved.
That is 𝑷𝑷(𝒙𝒙|𝒂𝒂). 𝑷𝑷(𝒂𝒂) > 𝑃𝑃(𝒙𝒙|𝒃𝒃). 𝑷𝑷(𝒃𝒃), 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃
http://www.cisjournal.org
If we assume that, 𝑷𝑷(𝒙𝒙|𝒂𝒂) is Multivariate Normal distribution. So, we get 𝟏𝟏 𝑷𝑷�𝒙𝒙│𝒂𝒂� = � � 𝒆𝒆[− �(𝟐𝟐𝟐𝟐) . |𝑪𝑪𝒂𝒂 |
𝟏𝟏 (𝒙𝒙−𝝁𝝁𝒂𝒂 )𝑻𝑻𝑪𝑪−𝟏𝟏 𝒂𝒂 (𝒙𝒙−𝝁𝝁𝒂𝒂 ) ] 𝟐𝟐
𝟏𝟏 𝑷𝑷(𝒂𝒂) (𝒙𝒙−𝝁𝝁𝒂𝒂 )𝑻𝑻 𝑪𝑪−𝟏𝟏 𝒂𝒂 (𝒙𝒙−𝝁𝝁𝒂𝒂 ) ] � � 𝒆𝒆[− 𝟐𝟐 �(𝟐𝟐𝟐𝟐) . |𝑪𝑪𝒂𝒂 | 𝟏𝟏 𝑷𝑷(𝒃𝒃) (𝒙𝒙−𝝁𝝁𝒃𝒃 )𝑻𝑻 𝑪𝑪−𝟏𝟏 𝒃𝒃 (𝒙𝒙−𝝁𝝁𝒃𝒃 ) ] , 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃 >� � 𝒆𝒆[− 𝟐𝟐 �(𝟐𝟐𝟐𝟐) . |𝑪𝑪𝒃𝒃 |
That is 𝟏𝟏 (𝒙𝒙−𝝁𝝁𝒂𝒂 )𝑻𝑻 𝑪𝑪−𝟏𝟏 𝒂𝒂 (𝒙𝒙−𝝁𝝁𝒂𝒂 ) � � 𝒆𝒆�− 𝟐𝟐
� �|𝑪𝑪𝒂𝒂 | 𝑷𝑷(𝒃𝒃) [− >� � 𝒆𝒆 �|𝑪𝑪𝒃𝒃 |
𝟏𝟏 (𝒙𝒙−𝝁𝝁𝒃𝒃 )𝑻𝑻𝑪𝑪−𝟏𝟏 𝒃𝒃 (𝒙𝒙−𝝁𝝁𝒃𝒃 ) ] , 𝒇𝒇𝒇𝒇𝒇𝒇 𝟐𝟐
We can write this equation as
So,
we
𝟏𝟏
have
𝝁𝝁𝒂𝒂 𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 − 𝝁𝝁𝒂𝒂 𝑪𝑪−𝟏𝟏𝝁𝝁𝑻𝑻𝒂𝒂 + 𝒍𝒍𝒍𝒍�𝑷𝑷(𝒂𝒂)� > 𝟐𝟐
𝟏𝟏
𝝁𝝁𝒃𝒃 𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 − 𝝁𝝁𝒃𝒃 𝑪𝑪−𝟏𝟏𝝁𝝁𝑻𝑻𝒃𝒃 + 𝒍𝒍𝒍𝒍�𝑷𝑷(𝒃𝒃)� , 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃 𝟐𝟐
𝟏𝟏
Where, 𝝁𝝁𝒂𝒂 is vector mean and 𝑪𝑪𝒂𝒂 is covariance matrix of class a. Now assign object with measurement x to class a if,
𝑷𝑷(𝒂𝒂)
𝒍𝒍𝒍𝒍(|𝑪𝑪|) − 𝟐𝟐𝟐𝟐 𝒏𝒏�𝑷𝑷(𝒂𝒂)� + 𝒙𝒙𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 − 𝟐𝟐𝝁𝝁𝒂𝒂 𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 + 𝝁𝝁𝒂𝒂 𝑪𝑪−𝟏𝟏𝝁𝝁𝑻𝑻𝒂𝒂 < 𝒍𝒍𝒍𝒍(|𝑪𝑪|) − 𝟐𝟐𝟐𝟐 𝒏𝒏�𝑷𝑷(𝒃𝒃)� + 𝒙𝒙𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 − 𝟐𝟐𝝁𝝁𝒃𝒃 𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 + 𝝁𝝁𝒃𝒃 𝑪𝑪−𝟏𝟏𝝁𝝁𝑻𝑻𝒃𝒃 , 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃
Let 𝒇𝒇𝒊𝒊 = 𝝁𝝁𝒊𝒊 𝑪𝑪−𝟏𝟏 𝒙𝒙𝑻𝑻𝒌𝒌 − 𝝁𝝁𝒊𝒊 𝑪𝑪−𝟏𝟏 𝝁𝝁𝑻𝑻𝒊𝒊 + 𝒍𝒍𝒍𝒍 (𝑷𝑷(𝒊𝒊)) 𝟐𝟐
So, Assign object with measurement x to group a if 𝒇𝒇𝒂𝒂 > 𝒇𝒇𝒃𝒃 , 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃.
The second term of this function that is 𝝁𝝁𝒊𝒊 𝑪𝑪−𝟏𝟏𝝁𝝁𝑻𝑻𝒊𝒊 is actually Mahalanobis distance, which gives the distance to measure dissimilarity between several classes.
That is Linear Discriminant functions. Thus, Linear Discriminant Analysis has assumption of Multivariate Normal distribution and all classes have the same covariance matrix. But, we can calculate same covariance matrix of all 𝟏𝟏 classes 𝑪𝑪 by the formula 𝑪𝑪 = ∑𝒏𝒏𝒊𝒊=𝟏𝟏 𝒑𝒑𝒊𝒊 𝒄𝒄𝒊𝒊 , where 𝒑𝒑 the total is 𝒑𝒑
∀ 𝒂𝒂 ≠ 𝒃𝒃
𝒍𝒍𝒍𝒍(|𝑪𝑪𝒂𝒂 |) − 𝟐𝟐𝟐𝟐 𝒏𝒏�𝑷𝑷(𝒂𝒂)� + (𝒙𝒙 − 𝝁𝝁𝒂𝒂 )𝑻𝑻 𝑪𝑪−𝟏𝟏 𝒂𝒂 (𝒙𝒙 − 𝝁𝝁𝒂𝒂 ) > 𝒍𝒍𝒍𝒍(|𝑪𝑪𝒃𝒃|) − 𝟐𝟐𝟐𝟐 𝒏𝒏�𝑷𝑷(𝒃𝒃)� + (𝒙𝒙 − 𝝁𝝁𝒃𝒃 )𝑻𝑻 𝑪𝑪−𝟏𝟏 𝒃𝒃 (𝒙𝒙 − 𝝁𝝁𝒃𝒃 ), 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃
If all covariance matrices are equal 𝑪𝑪 = 𝑪𝑪𝒂𝒂 = 𝑪𝑪𝒃𝒃, then we can write
𝒍𝒍𝒍𝒍(|𝑪𝑪𝒂𝒂 |) − 𝟐𝟐𝟐𝟐 𝒏𝒏�𝑷𝑷(𝒂𝒂)� + (𝒙𝒙 − 𝝁𝝁𝒂𝒂 )𝑻𝑻 𝑪𝑪−𝟏𝟏(𝒙𝒙 − 𝝁𝝁𝒂𝒂 ) > 𝒍𝒍𝒍𝒍(|𝑪𝑪𝒃𝒃 |) − 𝟐𝟐𝟐𝟐 𝒏𝒏�𝑷𝑷(𝒃𝒃)� + (𝒙𝒙 − 𝝁𝝁𝒃𝒃 )𝑻𝑻 𝑪𝑪−𝟏𝟏(𝒙𝒙 − 𝝁𝝁𝒃𝒃 ), 𝒇𝒇𝒇𝒇𝒇𝒇 ∀ 𝒂𝒂 ≠ 𝒃𝒃 We can write (𝒙𝒙 − 𝝁𝝁𝒂𝒂 )𝑻𝑻 𝑪𝑪−𝟏𝟏(𝒙𝒙 − 𝝁𝝁𝒂𝒂 ) into 𝒙𝒙𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 − 𝟐𝟐𝝁𝝁𝒂𝒂 𝑪𝑪−𝟏𝟏𝒙𝒙𝑻𝑻 + 𝝁𝝁𝒂𝒂 𝑪𝑪−𝟏𝟏 𝝁𝝁𝑻𝑻𝒂𝒂 so, the inequality becomes
number of sample, 𝒑𝒑𝒊𝒊 and 𝒄𝒄𝒊𝒊 is the number of sample and covariance matrices of 𝒊𝒊th class. 𝒏𝒏 is the number of classes.
In our case we have used this Linear Discriminant function combination with a bottom up Binary Tree structured classification rule to recognize different walking patterns. This technique of using the Binary Tree Structured was to arrest the exponential error growth rate. We will explain the working of our algorithm by considering 4 classes. These classes will have following 4 feature matrix R1, R2, R3 and R4. Person 1 P1 => R1, Person 2 P2 => R2, Person 3 P3 => R3 and Person 4 P4 => R4. The unknown test feature X is compared in binary tree method in one case with R1 and R2 and the other with R3 and R4. In both cases LDA maximum function is derived. These outputs in pairs (In this case one pair) are again compared with X in binary tree method. This will continue till all the classes are checked. Figure 7 shows the process for above example with 4 cases. In reality we make use of this technique with 30 classes instead of 4 classes. In this case it has been notified that the most dominating class which is actually being associated with test class X will reach to the last node of this tree.
400
VOL. 3, NO. 3, March 2012
Journal of Emerging Trends in Computing and Information Sciences
ISSN 2079-8407
©2009-2012 CIS Journal. All rights reserved. http://www.cisjournal.org
Table 2: Performance Evaluation Table No. of Subjects
Figure 7: Binary Tree structured based reorganization process with LDA.
5. RESULT ANALYSIS The gait recognition result deals with the feature selection technique and recognition technique applied in personal identification. In our work we have applied ANN and LDA separately. In this work we have taken 30 classes (30 different humans’ natural walking data). Both the methods give us up to 100% recognition result. In our work we randomly select the training set and testing set from our feature matrix in 60% and 40% ratio. We run this system for 30 times and for all the time we have achieved up to 100% recognition accuracy. It proves that our feature selection process and choosing those recognition techniques went through in positive directions. We have also attempted to apply those recognition methods with consideration of less number of features. As a result, the recognition rate gets considerably diminished. If we choose only the leg features then the average recognition rate by applying those methods are up to 87%. If we choose the leg feature with gait cycle time then the recognition method gives us about 93% recognition rate. Table 2 is the comparison between our adopted approach and others related approach in terms of presenting recognition performance. In this table EER means Equal Error Rate and RR means Recognition Rate. Compare to the other methods our result is extremely promising. It is hoped that a larger data set than 30 will also have a recognition rate close up to 100%.
Performance
Gafurov et al. [4][5]
21
5%-13% EER
Nakajima et al. [6]
10
85% RR
Middleton et al. [7]
15
80% RR
Derawi et al. [9], [10]
60
5.7%-20% EER
Rong et al. [11]
35
6.7% EER
Pan et al. [12]
30
96.7% RR
Moustakidis et al. [13]
40
72.89% - 98.21% RR
In This Paper
30
Up to 100% RR
6. CONCLUSION & DISCUSSION We are fully aware that current system will require full cooperation of the individual whose gait signature we would like to indentify. This individual should cooperate to wear our suit and lend his gait signature. There are also other biometric cues for human identification such as face iris, and finger printing. These biometric techniques have been long studied and tested on very large scale data set. It is therefore obvious to wonder why build new technique when other methods are functioning sufficiently well. The method we have proposed might seem irrelevant, but we believe that it has a far implication in understanding the health and structure of particular human being. Through further studies we would like to establish that every human being has a distinct gait signature. Most of gait analysis (Vision or non-vision) done by others some of which has been tabulated in Table-1, have only used the leg movements for identification. We strongly feel that the upper body movement (arm swings) has strong connection related to gait stability and locomotion which is strongly evident from our data. There is a strong correlation between the speed of locomotion and hand swing oscillation. As a future work we would like to investigate if this distinct human gait signature has a distinct correlation with the individual’s body structure. Can aging effect be noticed in the gait signature? Does diseases such as Knee Osteoarthritis, Hip Osteoarthritis, Cerebral Palsy, Parkinson, and Hemiplegic Gait have distinct signature and can it be identified at the initial stages during the setting in of the diseases. Through our method we would like to construct a gait signature database with other biometric information such
401
VOL. 3, NO. 3, March 2012
Journal of Emerging Trends in Computing and Information Sciences
ISSN 2079-8407
©2009-2012 CIS Journal. All rights reserved. http://www.cisjournal.org
as weight, height, sex and age of normal human beings and people with a known history of the above medical diseases. This will be a long drawn process. The present work is the first step in understanding the human gait signature. In this context Gait Based Personal Identification System will have grate relevance.
ACKNOWLEDGEMENT This project was developed under the funding of Indian Institute of Information Technology Allahabad, India. Details of our designed suit were published in the Proceedings of the 3rd International Conference on Contemporary Computing, Noida, India, 2010 [2].
REFERENCES [1] C. C. Yang and Y. L. Hsu “ A Review of AccelerometryBased Wearable Motion Detectors for Physical Activity Monitoring,” Sensors, Vol. 10, pp. 7772-7788, 2010. [2] S. Mondal, A. Nandy, A. Chakrabarti, P. Chakraborty and G. C. Nandi, “A Framework for Synthesis of Human Gait Oscillation Using Intelligent Gait Oscillation Detector (IGOD),” Communications in Computer and Information Science, vol. 94, Contemporary Computing, Part 7, pp. 340-349, 2010. [3] T. W Calvert, J. Chapman, and A. Patla, "Aspects of the Kinematic Simulation of Human Movement," Computer Graphics and Applications, IEEE , vol.2, no.9, pp.41-50, Nov. 1982. [4] D. Gafurov, K. Helkala, and T. Søndrol, “Biometric Gait Authentication using Accelerometer Sensor,” Journal of Computers, vol. 1, no. 7, October/November 2006. [5] D. Gafurov, and E. Snekkenes, “Gait Recognition Using Wearable Motion Recording Sensors,” EURASIP Journal on Advances in Signal Processing - Special issue on recent advances in biometric systems: a signal processing perspective, vol. 2009, Article ID 415817, January 2009. [6] K. Nakajima, Y. Mizukami, K. Tanaka, and T. Tamura, "Footprint-based personal recognition," IEEE Trans. Biomedical Engineering, vol. 47, no. 11, pp. 1534-1537, Nov. 2000. [7] L. Middleton, A. A. Buss, A. Bazin, and M. S. Nixon, "A floor sensor system for gait recognition," Fourth IEEE Workshop on Automatic Identification Advanced Technologies, 2005, pp. 171- 176, 17-18 Oct. 2005. [8] E. Ottaviano, M. Ceccarelli, and S. Grande, “An Experimental Evaluation of Human Walking,” 3rd International Congress Design and Modelling of Mechanical Systems CMSM’2009.
[9] M. O. Derawi, P. Bours, and K. Holien, "Improved Cycle Detection for Accelerometer Based Gait Authentication," Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), 2010, pp. 312-317, 15-17 Oct. 2010. [10] M. O. Derawi, C. Nickel, P. Bours, and C. Busch, "Unobtrusive User-Authentication on Mobile Phones Using Biometric Gait Recognition," Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), 2010, pp. 306311, 15-17 Oct. 2010. [11] L. Rong, D. Zhiguo, Z. Jianzhong, and L. Ming, "Identification of Individual Walking Patterns Using Gait Acceleration," The 1st International Conference on Bioinformatics and Biomedical Engineering, 2007, pp. 543-546, 6-8 July 2007. [12] G. Pan, Y. Zhang, and Z. Wu, "Accelerometer-based gait recognition via voting by signature points," Electronics Letters, vol. 45, no. 22, pp. 1116-1118, October 22 2009. [13] S. P. Moustakidis, J. B. Theocharis, and G. Giakas, "Subject Recognition Based on Ground Reaction Force Measurements of Gait Signals," IEEE Trans. Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 38, no. 6, pp. 1476-1485, Dec. 2008. [14] S. Mondal, A. Nandy, Chandrapal, P. Chakraborty and G. C. Nandi “A Central Pattern Generator based Nonlinear Controller to Simulate Biped Locomotion with a Stable Human Gait Oscillation,” International Journal of Robotics and Automation (IJRA), vol. 2, Issue 2, pp. 93-106, 2011. [15] G. B. Huang, and H. A. Babri, "Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions," IEEE Trans. Neural Networks, vol. 9, no. 1, pp. 224-229, Jan 1998. [16] T. K. Kim, and J. Kittler, “Locally Linear Discriminant Analysis for Multimodally Distributed Classes for Face Recognition with a Single Model Image,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 318-327, March 2005. [17] O. C. Hamsici, and A. M. Martinez, “Bayes Optimality in Linear Discriminant Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 4, pp. 647-657, April 2008. [18] A. M. Martinez, and A. C. Kak, “PCA versus LDA,”IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 228-233, February 2001. [19] A. Subasi, and M. I. Gursoy, “EEG signal classification using PCA, ICA, LDA and support vector machines,” Expert Systems with Applications, vol. 37, pp. 8659– 8666, 2010.
402
