Big Data and NoSQL system for Control Systems

6 downloads 8526 Views 97KB Size Report
data from relational to NoSQL system, and use a distributed environment containing many nodes. ... Keywords: Control System, Data Mining, Big Data, Distributed environment, NoSQL .... We will compare and analyze the results of the storage,.
International Journal of Engineering and Future Technology, Year 2017; Volume 14; Issue No. 2; ISSN 2455-6432 Copyright © 2017, International Journal of Engineering and Future Technology



%LJ'DWDDQG1R64/V\VWHPIRU&RQWURO6\VWHPV  @RQDQH[SHULPHQWDOSODWIRUP,QWKHILIWKVHFWLRQZHFDUU\RXWVRPHLQWHUHVWLQJTXHULHVWR WHVWDQGFRPSDUHSHUIRUPDQFH$FRQFOXVLRQFORVHVWKLVSDSHUDWWKHODVWVHFWLRQ

 

'LVWULEXWHGGDWDLVVXHDQGUHODWHGZRUN



,Q WKLV VHFWLRQ ZH SUHVHQW WKH FRQVWUDLQWV RI WKH UHODWLRQDO PRGHO LQ GLVWULEXWHG ZRUOG WKH 1R64/ WHFKQRORJ\DQGVRPHUHODWHGZRUNVJLYHQWRGHDOZLWKWKLVLVVXH$GLVWULEXWHGHQYLURQPHQWLVDVHWRI SK\VLFDOPDFKLQHV QRGHV ZKLFKSDUWLFLSDWHMRLQWO\WRDFFRPSOLVKSDUDOOHOSURFHVVLQJDQGVWRUDJH$OO UHVRXUFHVRIWKHQRGHV &38PHPRU\GLVNV FDQEHVKDUHGRUQRW7KHQXPEHURIQRGHVFDQGLIIHUIURPDIHZWRWKRXVDQGVRI QRGHV6RZHFDQILQGVLPSOHFOXVWHUVZLWKIHZQRGHVZKLFKW\SLFDOO\VKDUHGLVNV OLNH6$1RU1$6 RU PRUHFRPSOH[OLNHJULGVWKDWFRQWDLQKXQGUHGVRUWKRXVDQGVRIQRGHVZKHUHUHVRXUFHVDUHRIWHQQRW VKDUHG 7KHPDLQSDUWRIWKH&6GDWDEDVHVDUHEDVHGRQWKHUHODWLRQDOPRGHOZKLFKLVEXLOGRQWKHFRQFHSWRI WDEOH UHODWLRQEHWZHHQGDWD DQGRSHUDWLRQVRIVHWDOJHEUD 7KLVPRGHOLVVXLWDEOHIRUWUDQVDFWLRQDOQHHGVGXHWRWKH$&,'SURSHUWLHV $WRPLFLW\ &RQVLVWHQF\ ,VRODWLRQ DQG 'XUDELOLW\  >@ DQG LW ZRUNV YHU\ ZHOO LQ D VLQJOHQRGH HQYLURQPHQW &RQYHUVHO\ UHODWLRQDO GDWD FDQQRW EH ZHOO GLVWULEXWHG DQG GHSOR\HG LQ D GLVWULEXWHG PXOWLQRGHV HQYLURQPHQW7KH$&,'SURSHUWLHVEHFRPHFRQVWUDLQWVIRUWKHPRGHODQGWKHQSUHYHQWGDWDIURPEHLQJ GLVWULEXWHGHIIHFWLYHO\EHWZHHQQRGHV>@ 1RWH DOVR WKDW $&,' FRQVWUDLQWV DOWKRXJK WKH\ HQVXUH FRQVLVWHQF\ PD\ EHFRPH LQ VRPH FDVHV D EORFNLQJIDFWRU>@>@)RULQVWDQFHDQLQYHVWLJDWRULQLQWHUQHWLVRIWHQLQWHUHVWHGLQKDYLQJLPPHGLDWH UHVSRQVHHYHQLIWKDWUHVSRQVHLVQRWXSWRGDWH&RQVHTXHQWO\QHZV\VWHPVQHHGWREHFUHDWHGLQ RUGHUWRG\QDPLFDOO\GLVWULEXWHDQGPDQDJHGDWDEHWZHHQQRGHVZLWKPRUHHIILFLHQF\DQGXVHIXOQHVV 1HZV\VWHPVIRU%LJ'DWDKDYHEHHQHPHUJHGOLNH1R64/DQG1HZ64/

60

International Journal of Engineering and Future Technology

 'DWDPRGHOHYDOXDWLRQ&ULWHULD 7KHIROORZLQJFULWHULDZLOOEHXVHGWRHYDOXDWHWKHGRFXPHQWRULHQWHGPRGHO  1DWXUHRIGDWD VWUXFWXUHGVHPLVWUXFWXUHG   'DWDUHODWLRQVKLS UHIHUHQWLDOLQWHJULW\KLHUDUFKLFDOUHODWLRQVKLSV   'DWDOLIHF\FOH YHUVLRQLQJ77/   'DWDYLHZ &58'RSHUDWLRQV   'DWDFRQVLVWHQF\ $&,'SURSHUWLHV   3HUIRUPDQFH LQGH[LQJSDUWLWLRQLQJ   6WRUDJHYROXPH %LJ'DWD   'DWDDQDO\VLV GDWDDJJUHJDWHV   3HUVLVWHQF\DQGIDXOWWROHUDQFH GDWDUHSOLFDWLRQ   'DWDVHFXULW\ DFFHVVULJKWVGDWDHQFU\SWLRQ  ,QJHQHUDOGDWDFDQEHVWUXFWXUHGRUVHPLVWUXFWXUHGGHSHQGLQJRQWKHUHODWHGXVHFDVH 'RFXPHQWRULHQWHGGDWDEDVHVVWRUHGRFXPHQWVLQ-621 -DYD6FULSW2EMHFW1RWDWLRQ DGDWDIRUPDW ZLWKDKLHUDUFKLFDOVWUXFWXUHRISURSHUWLHVDQGYDOXHV,WLVDQRSHQVLPSOHDQGHDV\VWDQGDUG-621DQG ;0/DUHWZRGDWDIRUPDWVPRVWXVHGFXUUHQWO\WRH[FKDQJHGDWDRYHU,QWHUQHW-621LVPRUHFRPSDFW FRPSDUHGWR;0/,WVXSSRUWVDOONLQGRIGDWDW\SHVDVZHOODVGDWDDUUD\V 6LQFHLWLVFORVHWR;0/-621IRUPDWDOVRDOORZVVWRULQJVHPLVWUXFWXUHGGDWD'RFXPHQWVZLWKIUHH WH[WFDQEHWKHQVWRUHGDVNH\YDOXHSDLUV8VHUFDQFRQILJXUHDQLQGH[WKDWDOORZVVHDUFKLQJDVSHFLILF FKDLQLQWKHWH[W ,QWKHUHODWLRQDOGDWDPRGHOWKHWDEOHVFRQWDLQDVHWRIURZVZKHUHHYHU\URZLVJURXSLQJDVHWRIYDOXHV ([LVWLQJUHODWLRQVKLSVDUHEDVHGRQMRLQVEHWZHHQURZVLQGLIIHUHQWWDEOHVDQGWKH\DUHQRWEDVHGRQWKH VHPDQWLFUHODWLRQVKLSVEHWZHHQNH\ZRUGV YDOXHV 





3URSRVDO



$VSURSRVDOZHVXJJHVWPLJUDWLQJ&6GDWDWRDVXLWDEOH1R64/V\VWHP:HFKRRVHD1R64/V\VWHP DFFRUGLQJWRVSHFLILFFULWHULDZKLFKDUHSUHGRPLQDQWO\EDVHGRQWKHILWWLQJRI1R64/FODVVWR&6GDWD $OVR VLQFH &6 GDWD PXVW EH FRQVLVWHQW WKH W\SH RI WKH FKRVHQ 1R64/ V\VWHP PXVW EH &3 &RQVLVWHQF\3DUWLWLRQLQJ 0LJUDWHG1R64/&6GDWDZLOOEHGLVWULEXWHGRQDSODWIRUPFRQVLVWHGRIPDQ\ QRGHV 7KH 6KDUGLQJ LV D 1R64/ SURSHUW\ ZKLFK GLVWULEXWHV DQG DOORFDWHV G\QDPLFDOO\ UHVRXUFHV EHWZHHQQRGHVDQGDGDSWWKHPDFFRUGLQJWRGDWDQHHGV)LJUHSUHVHQWVDVFKHPDIRURXUSURSRVHG PLJUDWLRQ7KLVFDQJUHDWO\LPSURYHWKHSHUIRUPDQFHRQHLWKHUWKHGDWDVWRUDJHRUWKHSURFHVVLQJWLPH IRUDGKRFTXHULHV n DCS NoSQL data

  

DCS Relational Data

DCS NoSQL data

 

)LJ3URSRVHGDSSURDFK 61

DCS NoSQL data

International Journal of Engineering and Future Technology



3UHSDUDWLRQRIWDUJHW&6GDWD



7RSUHSDUH&6GDWDZHVWDUWLPSOHPHQWLQJDGLVWULEXWHGSODWIRUPDQGZHSHUIRUPPLJUDWLRQGDWDIURP 2UDFOHJ5WR0RQJR'%YHUVLRQ6RPHH[SHULPHQWVDQGWKHLUUHVXOWVZLOOEHGRQHLQWKHQH[W VHFWLRQ)LUVWO\ZHFRQILJXUHDGLVWULEXWHGSODWIRUPPDQDJHGGLUHFWO\E\0RQJR'% 

5HVXOWVDQG'LVFXVVLRQ



7KH QHZ &6 0RQJR'% GDWDEDVH LV QRZ UHDG\ RXU JRDO LV WR SURYH SHUIRUPDQFH DFTXLUHG E\ XVLQJ HODVWLFLW\ JLYHQ E\ GLVWULEXWHG 1R64/ GDWD 7KLV HODVWLFLW\ VLJQLILHV WKH DELOLW\ WR GLVWULEXWH GDWD DQG TXHULHVSURFHVVLQJRQPXOWLSOHQRGHVFRQWUDU\WRWKHULJLGLW\RIUHODWLRQDOGDWD6RWKHRUHWLFDOO\JRRG SHUIRUPDQFHLVH[SHFWHG,QWKHIROORZLQJZHXVHWKHVDPHGDWDPLQLQJTXHULHVIRUERWKWKHGLVWULEXWHG 0RQJR'%GDWDDQGWKH2UDFOHPRQRQRGHGDWD:HZLOOFRPSDUHDQGDQDO\]HWKHUHVXOWVRIWKHVWRUDJH UXQ WLPH DQG VKDUHG TXHU\ SURFHVVLQJ E\ YDU\LQJ HDFK WLPH WKH QXPEHU RI VKDUHV IURP  WR  $V H[SHULPHQWVZHXVHFROOHFWLRQVZKLFKFRQWDLQLQJUHDOWLPHGDWDXVHGIUHTXHQWO\LQORRNLQJIRUIUHTXHQW LWHPVHWV)RUGDWDVWRUDJHZHFDQVHHLQ)LJDJUDSKVKRZLQJWKDW0RQJR'%KDVVKDUHGDXWRPDWLFDOO\ &6GDWDRQGLIIHUHQWVKDUGVEXWIRU2UDFOHRQO\RQHQRGHVXSSRUWVGDWDVWRUDJHWKHRWKHUQRGHVUHPDLQ LGOH





 )LJ&RPSDULVRQWKH&6GDWDVWRUDJHUHSDUWLWLRQEHWZHHQ0RQJR'%DQG2UDFOH





&RQFOXVLRQ



$VH[SHULPHQWDIWHUFRQILJXULQJDGLVWULEXWHGHQYLURQPHQWZLWKDQXPEHURIQRGHVZHKDYHLQVWDOOHG 0RQJR'% DQG PLJUDWHG &6 GDWD 7KH 1R64/ VKDUGLQJ SURSHUW\ DOORZV UHSDUWLWLRQ RI VWRUDJH DQG SURFHVVLQJ EHWZHHQ DOO QRGHV 6RPH H[SHULPHQWV 'DWD 0LQJ TXHULHV KDYH EHHQ GRQH LQ RUGHU WR FRPSDUH SHUIRUPDQFH RI UHVXOWV EHWZHHQ PXOWLQRGHV 1R64/ GDWD DQG PRQRQRGH UHODWLRQDO GDWD 2YHUDOO WKH ILQDO UHVXOWV GHPRQVWUDWH DQ LQWHUHVWLQJ LPSURYHPHQW LQ UXQ WLPH LQ DGGLWLRQ RI WKH GDWD VWRUDJH JDLQHG E\ MRLQLQJ DOO GLVN QRGHV )LQDOO\ LQ SHUVSHFWLYH ZH ORRN IRUZDUG WR HQODUJH WKLV H[SHULPHQWDWLRQLQZLGHVSUHDGSODWIRUPVHQYLURQPHQWVZLWKPDQ\QRGHVOLNH+DGRRSSODWIRUP$OVR VLQFH1R64/LVQHZIDVKLRQHGDQGVWLOOLQGHYHORSPHQWZHDUHKHDULQJRISRWHQWLDOQHZ1R64/V\VWHPV WR WHVW WKHP DQG ILQG WKH PRVW DSSURSULDWH IRU &6 GDWD 'RFXPHQW RULHQWHG FOXVWHUV SURYLGH KLJKO\ VFDODEOHDUFKLWHFWXUHDQGEHWWHUV\VWHPDYDLODELOLW\)RUWKLVUHDVRQWKLVPRGHOLVRQHRIWKHPRVWXVHG 1R64/PRGHOVRQWKHZRUOGZLGH  62

International Journal of Engineering and Future Technology

5HIHUHQFHV 

>@.DXU.5DQL5  0RGHOLQJDQGTXHU\LQJGDWDLQ1R64/GDWDEDVHVPublished in: BigData, 2013 IEEE International Conference. INSPEC Accession Number 13999217. >@+DVKHP+5DQF'  $QLQWHJUDWLYH0RGHOLQJRI%LJ'DWD3URFHVVLQJPublished in International Journal of Computer Science and Applications. Print ISSN 0972-9038.  >@96KDUPD0'DYH³64/DQG1R64/'DWDEDVHV´,QWHUQDWLRQDO-RXUQDORI$GYDQFHG5HVHDUFKLQ&RPSXWHU 6FLHQFHDQG6RIWZDUH(QJLQHHULQJ9ROXPH,VVXH$XJXVW,661;5HVHDUFKSDSHU DYDLODEOHZZZLMDUFVVHFRPSDJH >@1'HJURRGW³/ pODVWLFLWpGHVEDVHVGHGRQQpHVVXUOH&ORXG&RPSXWLQJ´0DVWHUWKHVLVLQ6FLHQFHVFRPSXWHU )UHH8QLYHUVLW\RI%UX[HOOHVS >@/L

Suggest Documents