Using Information Theory to Observe Natural ...

World Academy of Science, Engineering and Technology International Journal of Computer, Electrical, Automation, Control and Information Engineering Vol:10, No:5, 2016



8VLQJ,QIRUPDWLRQ7KHRU\WR2EVHUYH1DWXUDO ,QWHOOLJHQFHDQG$UWLILFLDO,QWHOOLJHQFH /LSHQJ=KDQJ/LPHL/L@ +RZHYHU WKHFDOFXODWLRQLVWRRFRPSOLFDWHG0RVWUHVHDUFKHUVMXVWSXUVXH WR LPSOHPHQW $UWLILFLDO ,QWHOOLJHQFH PRUH FORVH WR 1DWXUDO ,QWHOOLJHQFH 7KHUHDUHPDQ\GLIIHUHQWYLHZVRQWKH1DWXUDO,QWHOOLJHQFH :HWU\WRSXWLWDVLGHDQGPDNHEDVLFFRQFHSWVPRUHFOHDULQ RUGHUWRSXVKWKHUHVHDUFKRI1DWXUDO,QWHOOLJHQFHDQG$UWLILFLDO ,QWHOOLJHQFHWRDKLJKHUOHYHO 7KHSXUSRVHRIWKLVSDSHULVWRH[SORUHOHDUQLQJPHFKDQLVP RIQDWXUDOLQWHOOLJHQWV\VWHPDQGWKHOLPLWRIQDWXUDOLQWHOOLJHQW V\VWHP7KHEDVLFIHDWXUHVRIWKHQDWXUDOLQWHOOLJHQWV\VWHPDQG RULJLQ RI 1DWXUDO ,QWHOOLJHQFH DUH VWXGLHG 7KLV SDSHU LV WR REVHUYH 1DWXUDO ,QWHOOLJHQFH DQG $UWLILFLDO ,QWHOOLJHQFH IURP DQRWKHUDQJOH

International Science Index, Computer and Information Engineering Vol:10, No:5, 2016 waset.org/Publication/10004555

Abstract²7KLV SDSHU WDNHV D SKLORVRSKLFDO YLHZ DV D[LRP DQG UHYHDOV WKH UHODWLRQVKLS EHWZHHQ LQIRUPDWLRQ WKHRU\ DQG 1DWXUDO ,QWHOOLJHQFH DQG $UWLILFLDO ,QWHOOLJHQFH XQGHU UHDO ZRUOG FRQGLWLRQV 7KLV SDSHU DOVRGHULYHV WKH UHODWLRQVKLS EHWZHHQ QDWXUDO LQWHOOLJHQFH DQG QDWXUH $FFRUGLQJ WR FRPPXQLFDWLRQ SULQFLSOH RI LQIRUPDWLRQ WKHRU\ 1DWXUDO,QWHOOLJHQFH FDQEH GLYLGHG LQWRUHDO SDUW DQGYLUWXDO SDUW%DVHGRQLQIRUPDWLRQWKHRU\SULQFLSOHWKDW,QIRUPDWLRQGRHVQRW LQFUHDVHWKHUHVWULFWLRQPHFKDQLVPRI1DWXUDO,QWHOOLJHQFHFUHDWLYLW\LV FRQGXFWHG7KHUHVWULFWLRQPHFKDQLVPRIFUHDWLYLW\UHYHDOVWKHOLPLWRI QDWXUDO LQWHOOLJHQFH DQG DUWLILFLDO LQWHOOLJHQFH 7KH SDSHU SURYLGHV D QHZDQJOHWRREVHUYHQDWXUDOLQWHOOLJHQFHDQGDUWLILFLDOLQWHOOLJHQFH

 Keywords²1DWXUDOLQWHOOLJHQFHDUWLILFLDOLQWHOOLJHQFHFUHDWLYLW\ LQIRUPDWLRQWKHRU\

7

, ,1752'8&7,21

+( UHVHDUFK RQ 1DWXUDO ,QWHOOLJHQFH DQG $UWLILFLDO ,QWHOOLJHQFHKDVDORQJKLVWRU\*HQHUDOO\WKHUHDUHWKUHH PDLQDUHDVIRUWKHPHWKRGRILWVUHVHDUFK   &RPSXWHU VLPXODWLRQ ± $, 7KLV PHWKRG LV WR WDNH ERWK KXPDQDQGFRPSXWHUDVEODFNER[DQGREVHUYHWKHUHVXOWV RILQSXWDQGRXWSXW>@>@$QGWRHVWDEOLVKDFRPSXWHU PDWKHPDWLFDO PRGHO EDVHG RQ WKH UHVXOWV 7KHQ PRGLI\ WKHLUPDWKHPDWLFDOPRGHOIXUWKHUXQWLOWKHUHVXOWVRILQSXW DQG RXWSXW DUH FORVHVW WR WKH UHVXOWV RI KXPDQ 7KH PRVW IDPRXVH[DPSOHLVWKH7XULQJWHVW>@   6WXG\ KXPDQ LQWHOOLJHQFH WKURXJK SV\FKRORJ\ 7KLV PHWKRGLVWRVWXG\KXPDQLQWHOOLJHQWEHKDYLRUE\DSSO\LQJ WKH PHDVXUHPHQW RI ,4 DQG (4 >@ ,W LV WR WDNH RQO\ KXPDQDVEODFNER[DQGREVHUYHWKHUHVXOWVRILQSXWDQG RXWSXW>@>@   %LRORJLFDO QHXUDO QHWZRUN UHVHDUFK 7KLV PHWKRG LV WR VWXG\ WKH UHVSRQVH RI QHXUDO QHWZRUN DQG REVHUYH WKH UHDFWLRQ RI WKH ELRORJLFDO QHXUDO QHWZRUNV WKH UHVXOWV RI RXWSXW ZKHQWKHUHLVLQSXW>@>@ $OOWKHVHMXVWEHORQJWRH[SHULPHQWDOWKHRULHV,IZHZDQWWR H[SODLQZKDWDUHWKHOLPLWDWLRQVRIQDWXUDOLQWHOOLJHQFHDQGZKDW LVWKHUHODWLRQVKLSEHWZHHQQDWXUDODQGQDWXUDOLQWHOOLJHQFHLWLV QHFHVVDU\WRJRIXUWKHUWREXLOGDVROLGEDVHRIWKHRU\,QRUGHU WRGRVRLWQHHGVDQD[LRPWRVXSSRUWWKLVWKHRU\E\XVLQJWKH LPDJLQDWLRQJLYHQE\QDWXUHWRUHDFKDKLJKHUOHYHORIVWXG\ ,IZHVD\WKDWQDWXUDOLQWHOOLJHQWLVWKHSURFHGXUHDQGUHVXOWV 

,,48(67,216 7KHUH DUH VRPH TXHVWLRQV DV IROORZV 2ULJLQ RI 1DWXUDO ,QWHOOLJHQFH 7KH UHODWLRQVKLS EHWZHHQ 1, DQG QDWXUH 7KH UHVWULFWLRQ PHFKDQLVP IRU 1, DQG FUHDWLYLW\ RI 1, 7KH UHODWLRQVKLS DPRQJ WKRVH 7KH VXLWDEOH WRROV IRU WKH UHODWHG UHVHDUFKHV ,Q RUGHU WR DQVZHU WKHVH TXHVWLRQV ZHOO VRPH SKLORVRSKLFDOSRLQWVKDYHWREHFRQVLGHUHG%HFDXVH1,V\VWHP FDQ EH GHVFULEHG DV DQ LQIRUPDWLRQ SURFHVVLQJ V\VWHP LQIRUPDWLRQ WKHRU\ VKRXOG EH D VXLWDEOH WRRO WR H[SODLQ WKH TXHVWLRQVLQFOXGLQJWKHUHODWLRQVKLSVDQGUHVWULFWLRQV ,,, 3+,/2623+@

B. Condition Entropy 2QHPD\DOVRGHILQHWKHFRQGLWLRQDOHQWURS\RIWZRHYHQWV; DQG@ &DUWHU 7RP 0DUFK   $Q LQWURGXFWLRQ WR LQIRUPDWLRQ WKHRU\ DQG HQWURS\ 3')  6DQWD )H 5HWULHYHG $XJ @ 3RROH'DYLG0DFNZRUWK$ODQ*RHEHO5DQG\ &RPSXWDWLRQDO ,QWHOOLJHQFH$/RJLFDO$SSURDFK1HZ@ 5XVVHOO6WXDUW-1RUYLJ3HWHU $UWLILFLDO,QWHOOLJHQFH$UWLILFLDO ,QWHOOLJHQFH $ 0RGHUQ $SSURDFK QG HG  8SSHU 6DGGOH 5LYHU 1HZ -HUVH\3UHQWLFH+DOO,6%1 >@ 0F&DUWK\-RKQ0LQVN\0DUYLQ5RFKHVWHU1DWKDQ6KDQQRQ&ODXGH   $ 3URSRVDO IRU WKH 'DUWPRXWK 6XPPHU 5HVHDUFK 3URMHFW RQ $UWLILFLDO,QWHOOLJHQFH$UWLILFLDO,QWHOOLJHQFH$UFKLYHGIURPWKHRULJLQDO RQ$XJXVW5HWULHYHG$XJXVW? >@ /RHKOLQ - & 3HUORII 5 6WHUQEHUJ 5 - 8UELQD 6   ,QWHOOLJHQFH .QRZQV DQG XQNQRZQV $PHULFDQ 3V\FKRORJLVW    GRL >@ 0DLFK$OR\VLXV $+REEHV'LFWLRQDU\%ODFNZHOOS >@ 1LGGLWFK 3HWHU )RUHZRUG $Q (VVD\ &RQFHUQLQJ +XPDQ 8QGHUVWDQGLQJ2[IRUG8QLYHUVLW\3UHVVS[[LL >@ *RWWIUHGVRQ /LQGD 6   0DLQVWUHDP 6FLHQFH RQ ,QWHOOLJHQFH ,QWHOOLJHQFH  ± GRLV  ,661  >@ 1HLVVHU 8OULFK %RRGRR *Z\QHWK %RXFKDUG 7KRPDV - %R\NLQ $ :DGH%URG\1DWKDQ&HFL6WHSKHQ-+DOSHUQ'LDQH)/RHKOLQ-RKQ & 3HUORII 5REHUW 6WHUQEHUJ 5REHUW - 8UELQD 6XVDQD   ,QWHOOLJHQFH .QRZQV DQG XQNQRZQV $PHULFDQ 3V\FKRORJLVW  ±,661;5HWULHYHG2FWREHU >@ /HJJ6KDQHDQG+XWWHU0DUFXV $)RUPDO0HDVXUHRI0DFKLQH ,QWHOOLJHQFH7HFKQLFDO5HSRUW8163(&,),('3URFHHGLQJVRIWKHWK $QQXDO0DFKLQH/HDUQLQJ&RQIHUHQFHRI%HOJLXPDQG7KH1HWKHUODQGV %HOHOHDUQ 





International Scholarly and Scientific Research & Innovation 10(5) 2016

781

scholar.waset.org/1999.4/10004555