Data Migration Methodology from Relational to ...

185 downloads 544 Views 415KB Size Report
constrained structure, scalable schema design, and faster access compared to ... PHP, Python ...) via drivers. ... TABLE I. BASIC SQL VS MONGODB SYNTAX.
World Academy of Science, Engineering and Technology International Journal of Computer, Electrical, Automation, Control and Information Engineering Vol:9, No:12, 2015



'DWD0LJUDWLRQ0HWKRGRORJ\IURP5HODWLRQDOWR 1R64/'DWDEDVHV 0RKDPHG+DQLQH$EGHVDGLN%HQGDUDJ2PDU%RXWNKRXP 

x

(FRQRPLF SUREOHPV LQ RUJDQL]DWLRQ 7KLV FDQ OHDG WR XQLQVWDOOLQJFRPPHUFLDODQGH[SHQVLYHGDWDEDVHVRIWZDUH DQGLQVWDOOLQJRSHQVRXUFHDQGFKHDSHUGDWDEDVHLQVWHDG x 8QLI\LQJYDULRXVDSSOLFDWLRQVDQGGDWDEDVHV:HQHHGWR XQLI\YDULRXVGDWDEDVHVWRRQHGDWDEDVHVSHFLILFWRHQVXUH EHWWHUHIILFLHQF\DQGFRQVLVWHQF\RIGDWD ,QWKLVDUWLFOHWZRW\SHVRIGDWDEDVHVZLOOEHXVHGIRUGDWD PLJUDWLRQ6RXUFHGDWDEDVHLVUHODWLRQDODQGWDUJHWGDWDEDVHLV DUHFHQWRQHLQWKHPDUNHW1R64/GDWDEDVH>@ x 5HODWLRQDOGDWDEDVH$UHODWLRQDOGDWDEDVHRU5'%06LVD GDWDEDVH EDVHG RQ D UHODWLRQDO PRGHO WKDWZDV GHYHORSHG E\ (GJDU &RGG LQ  >@ 7KH EDVLF QRWLRQ RI WKLV GDWDEDVHLVWKHVHSDUDWLRQLQWRWDEOHVIRUVWRULQJDOOWKHVH GDWD 7KH WDEOHV DUH VWUXFWXUHG LQ URZV DQG FROXPQV ZKHUHWKH\FDQEHOLQNHGZLWKHDFKRWKHUE\IRUHLJQNH\V $ELJDGYDQWDJHRIWKLVGDWDEDVHW\SHLVLWVHDVHWRXVHVR WKH XQWUDLQHG EXVLQHVV XVHUV FDQ FUHDWH HDV\ RZQ GDWDEDVHV+RZHYHUWKHKXJHJURZWKRIQHZDSSOLFDWLRQV WKDWGHSHQGRQVWRULQJDQGSURFHVVLQJELJDPRXQWRIGDWD ZKLFKDGGHGPRUHFKDOOHQJHVWRWKH5'%06DQGZKHUH WKHFODVVLFDO64/V\VWHPVEHLQJLQDSSURSULDWHLQDYDULHW\ RIZD\VOHDGWRDQHZGDWDEDVHPRGHOFDOOHG1R64/ x 1R64/ 'DWDEDVH 1R64/ GDWDEDVHV KDYH HPHUJHG WUHPHQGRXVO\ LQ WKH ODVW \HDUV RZLQJ WR WKHLU OHVV FRQVWUDLQHG VWUXFWXUH VFDODEOH VFKHPD GHVLJQ DQG IDVWHU DFFHVVFRPSDUHGWRUHODWLRQDOGDWDEDVHV7KHPDLQIHDWXUH WKDWPDNHVGLIIHUHQFHLQWKHPRGHORI1R64/GDWDLVWKDW LWGRHVQRWXVHWKHWDEOHDVVWRUDJHVWUXFWXUHRIWKHGDWD,Q DGGLWLRQ LWV VFKHPD LV YHU\ HIILFLHQW LQ KDQGOLQJ WKH XQVWUXFWXUHG GDWD 7KH 1R64/ GDWDEDVH WDNHV PDQ\ PRGHOLQJWHFKQLTXHVOLNHNH\YDOXHVWRUHVGRFXPHQWGDWD PRGHO DQG JUDSK 7KH IROORZLQJ LOOXVWUDWHV WKLV FOHDUO\ >@>@  .H\YDOXH VWRUHV 'DWD LV VWRUHG DV YDOXHV ZLWK D XQLTXH NH\ DVVLJQHG WR HDFK YDOXH $OVR WKLV W\SH RI 1R64/ GDWDEDVHDOORZVIRUNHHSLQJKLJKSHUIRUPDQFHLQUHDGLQJ DQGRU ZULWLQJ &XUUHQWO\ WKH EHVW VROXWLRQV KDYLQJ DGRSWHG WKH V\VWHP RI NH\YDOXH DUH 9ROGHPRUW 5HGLV DQG5LDN  'RFXPHQW VWRUHV 7KH FRQFHSW RI WKLV GDWDEDVH ZKLFK LV EDVHG RQ GRFXPHQWV LV D NLQG RI H[WHQVLRQ RI WKH NH\YDOXHGDWDEDVHLQZKLFKWKHYDOXHLVUHSUHVHQWHGDVD GRFXPHQWFRQWDLQLQJGDWDUHSUHVHQWHGLQVWDQGDUGIRUPDWV -621 -DYD6FULSW 2EMHFW 1RWDWLRQ ;0/ HWF  $OO GRFXPHQWV DUH VWRUHG LQ FROOHFWLRQV HTXLYDOHQW WR WDEOHV LQ64/ 7KHDGYDQWDJHRIGDWDEDVHRULHQWHGGRFXPHQWVLV WR UHWULHYH D VHW RI KLHUDUFKLFDOO\ VWUXFWXUHG LQIRUPDWLRQ IURPDXQLTXHNH\7KHPRVWFXUUHQWLPSOHPHQWDWLRQVDUH

International Science Index, Computer and Information Engineering Vol:9, No:12, 2015 waset.org/Publication/10004179

Abstract²&XUUHQWO\ WKH ILHOG RI GDWD PLJUDWLRQ LV YHU\ WRSLFDO $VWKHQXPEHURIDSSOLFDWLRQVGHYHORSHGUDSLGO\WKHHYHULQFUHDVLQJ YROXPHRIGDWDFROOHFWHGKDVGULYHQWKHDUFKLWHFWXUDOPLJUDWLRQIURP 5HODWLRQDO'DWDEDVH0DQDJHPHQW6\VWHP 5'%06 WR1R64/ 1RW 2QO\ 64/  GDWDEDVH 7KLV YHU\ UHFHQW WHFKQRORJ\ LV LPSRUWDQW HQRXJK LQ WKH ILHOG RI GDWDEDVH PDQDJHPHQW 7KH PDLQ DLP RI WKLV SDSHULVWRSUHVHQWDPHWKRGRORJ\IRUGDWDPLJUDWLRQIURP5'%06WR 1R64/ GDWDEDVH 7R LOOXVWUDWH WKLV PHWKRGRORJ\ ZH LPSOHPHQW D VRIWZDUH SURWRW\SH XVLQJ 0\64/ DVD 5'%06DQG 0RQJR'%DV D 1R64/ GDWDEDVH $OWKRXJK WKLV LV D KDUG HQJLQHHULQJ ZRUN RXU UHVXOWV VKRZ WKDW WKH SURSRVHG PHWKRGRORJ\ FDQ VXFFHVVIXOO\ DFFRPSOLVKWKHJRDORIWKLVVWXG\

 Keywords²'DWD 0LJUDWLRQ 0\64/ 5'%06 1R64/ 0RQJR'%

, ,1752'8&7,21

&

855(17/@   ([WUDFWLRQ GDWD IURP WKH VRXUFH GDWDEDVH   7UDQVIRUPDWLRQ GDWD DQG   0LJUDWLRQRIGDWDWRWKHWDUJHWGDWDEDVH 7KHUH LV D YDULHW\ RI UHDVRQV IRU GDWD PLJUDWLRQ LQFOXGLQJ VHUYHU VWRUDJH HTXLSPHQW UHSODFHPHQWV RU XSJUDGHV ,Q WKLV UHJDUGZHRQO\VWDWHIHZRIWKHVHUHDVRQV>@>@ x 8SJUDGLQJ WR QHZ YHUVLRQ GDWDEDVH ,Q WKH FDVH RI XSJUDGLQJ RI VRIWZDUH HTXLSPHQW LQ WKH RUJDQL]DWLRQ LQFOXGLQJ QHZ YHUVLRQ RI GDWDEDVH ZH QHHG WR PLJUDWH GDWDWRQHZGDWDEDVH x ([LVWLQJ GDWDEDVH LV LQVXIILFLHQW ,Q WKH FDVH RI D ODUJH LQFUHDVH RI VWRUHG GDWD WKHUH LV LQVXIILFLHQW FDSDFLW\ RU VSHHGRIGDWDEDVH x &KDQJLQJRIRUJDQL]DWLRQSROLF\,QWKHFDVHRIFKDQJLQJ VHFXULW\RUDQRWKHUW\SHRISROLF\LQRUJDQL]DWLRQZHQHHG WRXSJUDGHWREHWWHUGDWDEDVH  +0 LV ZLWK WKH 'HSDUWPHQW RI &RPSXWHU 6FLHQFH /DERUDWRU\ RI (QJLQHHULQJ DQG ,QIRUPDWLRQ 6\VWHPV )DFXOW\ RI 6FLHQFHV 6HPODOLD &DGL $\\DG 8QLYHUVLW\ 0DUUDNHVK 0RURFFR FRUUHVSRQGLQJ DXWKRU WR SURYLGH SKRQHHPDLOPKDQLQH#XFDPD  %$ LV ZLWK WKH 'HSDUWPHQW RI 0DWKHPDWLFV DQG &RPSXWHU 6FLHQFH )DFXOW\ RI 3RO\GLVFLSOLQDU\ 6DIL &DGL $\\DG 8QLYHUVLW\ 0RURFFR HPDLO $EHQGDUDJ#XFDPD  %2 LV ZLWK WKH 'HSDUWPHQW RI &RPSXWHU 6FLHQFH /DERUDWRU\ RI (QJLQHHULQJ DQG ,QIRUPDWLRQ 6\VWHPV )DFXOW\ RI 6FLHQFHV 6HPODOLD &DGL $\\DG8QLYHUVLW\0DUUDNHVK0RURFFR HPDLORERXWNKRXP#XFDPD  



International Scholarly and Scientific Research & Innovation 9(12) 2015

2404

scholar.waset.org/1999.4/10004179

World Academy of Science, Engineering and Technology International Journal of Computer, Electrical, Automation, Control and Information Engineering Vol:9, No:12, 2015

International Science Index, Computer and Information Engineering Vol:9, No:12, 2015 waset.org/Publication/10004179

 7$%/(, %$6,&64/96021*2'%6@

International Science Index, Computer and Information Engineering Vol:9, No:12, 2015 waset.org/Publication/10004179



)LJ5HODWLRQDOGDWDEDVHORJLFDOVWUXFWXUH

A. Loading the Logical Structure of the Source Database ,Q WKH EHJLQQLQJ LW LV QHFHVVDU\ WR VSHFLI\ WKH UHODWLRQDO GDWDEDVH VRXUFH 7KHQ ZH FRQQHFW WR VRXUFH GDWDEDVH WR REWDLQDOOLQIRUPDWLRQDERXWW\SHDQGYHUVLRQ:HDOVRQHHGWR VSHFLI\ DOO WKH LQIRUPDWLRQ DERXW 1R64/ WDUJHW GDWDEDVH )XUWKHUPRUH LQ WKLV VWHS ZH REWDLQ D UHSUHVHQWDWLRQ RI WKH UHODWLRQDO PRGHO RI WKH VRXUFH GDWDEDVH )RU WKLV ZH QHHG WR JHWWKHQDPHVRIWDEOHVWKHLUDWWULEXWHVDQGUHODWLRQVKLSV7KH LQIRUPDWLRQ RQ WKH UHODWLRQVKLSV FDQ EH UHWULHYHG IURP WKH SULPDU\FRQVWUDLQWDQGIRUHLJQNH\VIRUHDFKWDEOH)LJLVDQ LQVWDQFH RI RXU PRGHO UHSUHVHQWLQJ D SRUWLRQ RI RXU VRXUFH GDWDEDVH

 )LJ5HODWLRQDO6FKHPD)ODW'7DEOHV &XVWRPHUDQG2UGHU  

B. Mapping Between Relational Model and MongoDB Model 7KLV VWHS LV GHGLFDWHG WR GHILQH WKH PDSSLQJ EHWZHHQ WKH UHODWLRQDO PRGHO RI 0\64/DQGGRFXPHQWRULHQWHG PRGHO RI 0RQJR'% ,W FRQVLVWV LQ GHILQLQJ ZKLFK DWWULEXWHV RI WKH UHODWLRQDO PRGHO RI WKH VRXUFH GDWDEDVH ZLOO EH OLQNHG WR WKH DWWULEXWHV RI WKH WDUJHW PRGHO /RDGLQJ GDWDEDVH WDEOHV DQG WKHLUDWWULEXWHVFDQEHLPSOHPHQWHGLQGLIIHUHQWZD\V2QHRI WKHPLVWRXVH-'%&GULYHU'XULQJWKHPLJUDWLRQRIUHODWLRQDO PRGHO WKH V\VWHP ZLOO SURSRVH D VHW RI VXLWDEOH WDEOHV WR PLJUDWHWRWKHWDUJHWGDWDEDVH7KHSURSRVDORIVXLWDEOHWDEOHV ZLOO EH EDVHG RQ WKH W\SH RI WKH 0\64/ RI WKH VRXUFH GDWDEDVH 7KH PDLQ FRQFHUQ RI WKRVH FRPLQJ IURP D UHODWLRQDO EDFNJURXQGLVWKHDEVHQFHRI-2,1VLQ1R64/GDWDEDVHV$V GHPRQVWUDWHG EHORZ WKH GRFXPHQW PRGHO PDNHV -2,1V UHGXQGDQWLQPDQ\FDVHV,Q)LJWKHUHODWLRQDOGDWDEDVHXVHV WKH³&XVWRPHUB,'´ILHOGWRMRLQWKH³&XVWRPHU´WDEOHZLWKWKH ³2UGHU´WDEOHWRHQDEOHWKHDSSOLFDWLRQWRUHSRUWHDFKRUGHUWR WKHULJKWFXVWRPHU8VLQJWKHGRFXPHQWPRGHOHPEHGGHGVXE GRFXPHQWVDQGWDEOHVHIIHFWLYHO\SUHMRLQGDWDE\DJJUHJDWLQJ UHODWHGGDWDZLWKLQDVLQJOHGDWDVWUXFWXUH&ROXPQVDQGURZV WKDW ZHUH WUDGLWLRQDOO\ QRUPDOL]HG DQG GLVWULEXWHG DFURVV VHSDUDWH WDEOHV FDQ SUHVHQWO\ EH VWRUHG WRJHWKHU LQ D VLQJOH GRFXPHQWHOLPLQDWLQJWKHQHHGWR-2,1VHSDUDWHWDEOHVZKHQ WKHDSSOLFDWLRQKDVWRUHWULHYHFRPSOHWHUHFRUGV>@ 0RGHOLQJWKHVDPHGDWDLQ0RQJR'%HQDEOHVXVWRFUHDWHD VFKHPD LQ ZKLFK ZH HPEHG DQ DUUD\ RI VXEGRFXPHQWV IRU HDFKRUGHUGLUHFWO\ZLWKLQWKHFXVWRPHUGRFXPHQW )LJ ,Q

 )LJ5LFKO\6WUXFWXUHG0RQJR'%'RFXPHQW 

 )LJ7KH0RQJR'%PRGHOUHVXOWRIWKHPDSSLQJIURPUHODWLRQDO PRGHO

,,, 352326('62)7:$5( ,Q RUGHU WR WHVW WKH YDOLGLW\ RI WKH SURSRVHG PHWKRGRORJ\ ZH GHYHORS D VRIWZDUH SURWRW\SH ZKLFK LV SURJUDPPHG E\ 

International Scholarly and Scientific Research & Innovation 9(12) 2015

2406

scholar.waset.org/1999.4/10004179

World Academy of Science, Engineering and Technology International Journal of Computer, Electrical, Automation, Control and Information Engineering Vol:9, No:12, 2015

 XVLQJ-$9$RQD3&SODWIRUP7KHRSHUDWLRQVHTXHQFHZLOOEH GHPRQVWUDWHGLQWKHIROORZLQJSDUDJUDSKVWKURXJKWKHXVHRI VHYHUDOVFUHHQVKRWV ,QLWLDOO\ WKH XVHU PXVW FRQQHFW WR 0\64/ V\VWHP WKURXJK WKHLQWHUIDFHVKRZQLQ)LJIRUFKRRVLQJWKHVRXUFHGDWDEDVH ZKLFKZLOOPLJUDWHWR0RQJR'%

)LQDOO\ WKH GDWD DUH LQVHUWHG LQ 0RQJR'% )LJSUHVHQWV GDWDPLJUDWHGLQFROOHFWLRQIRUPVZKHUHWKHXVHUFDQDFFHVVWR DOO WKH IHDWXUHV RI 0RQJR'% XVLQJ WKH WDEV SUHVHQWHG LQ WKLV LQWHUIDFH'RFXPHQWV&ROOHFWLRQVDQG5HTXHVWV 

International Science Index, Computer and Information Engineering Vol:9, No:12, 2015 waset.org/Publication/10004179







)LJ&RQQHFWLRQWRVRXUFHGDWDEDVH 

)LJ5HVXOWRIPLJUDWLRQ

1H[W )LJ  SURYLGHV D VHW RI WDEOHV RI VRXUFH GDWDEDVH WR WKHXVHUZKLFKKHZLOOFKRRVHLQRUGHUWRFRQVXOWRUPLJUDWH ,I WKH PLJUDWHG WDEOH LV MRLQ WR DQRWKHU WDEOH ERWK ZLOO EH PLJUDWHGDXWRPDWLFDOO\

,9 &21&/86,21 ,Q WKLV SDSHU ZH KDYH IRFXVHG RQ GDWD PLJUDWLRQ IURP UHODWLRQDO WR 1R64/ GDWDEDVH :H KDYH DOVR GLVFXVVHG WKDW 1R64/LVEHWWHUDQGIDVWHUWKDQ5'%061H[WZHSUHVHQWHG PHWKRGRORJ\ IRU GDWD PLJUDWLRQ IURP 0\64/ DV 5'%06 WR 0RQJR'% DV 1R64/ RULHQWHGGRFXPHQW GDWDEDVH 'XULQJ GDWDPLJUDWLRQWKHPRGHOVWUXFWXUHRIWKHWDUJHW 1R64/ ZDV DXWRPDWLFDOO\FUHDWHGIURPUHODWLRQDOVFKHPD)RULOOXVWUDWLRQ ZH SURSRVH DQ DSSOLFDWLRQ GHYHORSHG RQ -$9$ WKDW LV EDVHG RQWKHSURSRVHGPHWKRGRORJ\ $VDIXWXUHGLUHFWLRQWKHVRIWZDUHWKDWZHGHYHORSHGFRXOG EHHQKDQFHGE\RWKHUIHDWXUHVDQGLPSURYHPHQWVVXFKDV7R FRYHU DOO W\SHV RI GDWDEDVHV DYDLODEOH DV 5'%06 RU 1R64/ IRU PLJUDWLQJ IURP ERWK RI WKHP QRW MXVW WKH 0\64/ DQG 0RQJR'%



$&.12:/('*0(17 7KHDXWKRUVZLVKWRDFNQRZOHGJHWKHFRQWULEXWLRQVRIRWKHU PHPEHUV RI WKH GHSDUWPHQW RI FRPSXWHU VFLHQFH IRU WKHLU KHOSIXO GLVFXVVLRQV DQG WKH DYDLODELOLW\ RI DOO UHVRXUFHV WKDW KDYHKHOSHGPDNHWKLVZRUNLQWKHEHVWFRQGLWLRQV7KH\DOVR ZLVKWRWKDQN0U5HGRXDQH%RXOJXLGIRUSRLQWLQJRXWPDQ\ (QJOLVKFRUUHFWLRQVWKDWOHDGWRWKHLPSURYHPHQWRIWKHSDSHU 7KH DXWKRUV ZRXOG DOVR OLNH WR WKDQN WKH UHYLHZHUV IRU WKHLU UHPDUNVDQGVXJJHVWLRQV 

 )LJ0LJUDWLRQWR0RQJR'% 



International Scholarly and Scientific Research & Innovation 9(12) 2015

2407

scholar.waset.org/1999.4/10004179

World Academy of Science, Engineering and Technology International Journal of Computer, Electrical, Automation, Control and Information Engineering Vol:9, No:12, 2015



International Science Index, Computer and Information Engineering Vol:9, No:12, 2015 waset.org/Publication/10004179

5()(5(1&(6 >@ % :DOHN . &\ULO ³$ PHWKRGRORJ\ IRU 'DWD 0LJUDWLRQ EHWZHHQ 'LIIHUHQW'DWDEDVH0DQDJHPHQW6\VWHPV´:RUOG$FDGHP\RI6FLHQFH (QJLQHHULQJDQG7HFKQRORJ\9RO >@ % :DOHN . &\ULO ³'DWD 0LJUDWLRQ EHWZHHQ 'RFXPHQW2ULHQWHG DQG 5HODWLRQDO 'DWDEDVHV´ :RUOG $FDGHP\ RI 6FLHQFH (QJLQHHULQJ DQG 7HFKQRORJ\9RO >@ 0 $ODP DQG .ULVKDQ :DVDQ 6 ³0LJUDWLRQ IURP 5HODWLRQDO 'DWDEDVH LQWR 2EMHFW 2ULHQWHG 'DWDEDVH´ -RXUQDO RI &RPSXWHU 6FLHQFH     >@ ; /L[LDQ / @ 1&RU\/7UDYLV,5HHQX+*DU\³1RVTO9V5GEPV:K\7KHUH,V 5RRP IRU %RWK´ 3URFHHGLQJV RI WKH 6RXWKHUQ $VVRFLDWLRQ IRU ,QIRUPDWLRQ 6\VWHPV &RQIHUHQFH 6DYDQQDK *$ 86$ 0DUFK WK±WK  >@ 0$ 0RKDPHG 2* $OWUDIL 02 ,VPDLO ³5HODWLRQDO YV 1R64/ 'DWDEDVHV $ 6XUYH\´ ,QWHUQDWLRQDO -RXUQDO RI &RPSXWHU DQG ,QIRUPDWLRQ 7HFKQRORJ\ ,661  ±   9ROXPH  ± ,VVXH  0D\ >@ 5&DWWHOO³6FDODEOH64/DQG1R64/'DWD6WRUHV´6,*02'5HFRUG 'HFHPEHU 9RO1R  >@ 0RQJR'%   7KH 0RQJR'%  0DQXDO KWWSGRFVPRQJRGERUJPDQXDO >@ 1R64/  0DNLQJVHQVHRI1R64/$JXLGHIRUPDQDJHUVDQGWKH UHVWRIXV'DQ0F&UHDU\HW$QQ.HOO\ >@ 0LJUDWLRQ *XLGH   5'%06 WR 0RQJR'% 0LJUDWLRQ *XLGH &RQVLGHUDWLRQV DQG %HVW 3UDFWLFHV D 0RQJR'% :KLWH 3DSHU )HEUXDU\                                    





International Scholarly and Scientific Research & Innovation 9(12) 2015

2408

scholar.waset.org/1999.4/10004179

Suggest Documents