An Efficient Cache Replacement Algorithm for ...

)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ3DUDOOHO'LVWULEXWHGDQG*ULG&RPSXWLQJ3'*&

$Q(IILFLHQW&DFKH5HSODFHPHQW$OJRULWKPIRU 0LQLPL]LQJWKH(UURU5DWHLQ/67705$0 &DFKHV 5DVKLGDK)2ODQUHZDMX

$VLID0HKUDM%DED

%XUKDQ8O,VODP.KDQ

'HSWRI(&( .XOOL\\DKRI(QJLQHHULQJ ,,800DOD\VLD

'HSWRI(&( 6FKRRORI7HFKQRORJ\ ,867$ZDQWLSRUD.DVKPLU

'HSWRI(&( .XOOL\\DKRI(QJLQHHULQJ ,,800DOD\VLD

0DVKNXUL@>@

 )LJ,OOXVWUDWLRQRIWZRGLIIHUHQWFDFKHDOORFDWLRQWHFKQLTXHV

)LJVKRZVWZRGLIIHUHQWZD\VRIEORFNFDFKHDOORFDWLRQV IURP PDLQ PHPRU\ LQGH[ 0RGHUQ KLJKHQG FRPPXQLFDWLRQ ZRUNVWDWLRQVDQG3&VDUHXVXDOO\FRQILJXUHGZLWKDWOHDVWWZR OHYHOVRIFDFKHVVXFKDV/DQG/ZKHUHVRPHRIWKHPRGHUQ PLFURSURFHVVRU FKLSV ,QWHO &RUH L  FRQWDLQ WKUHH OHYHOV RI FDFKHV $V WKH FRQYHQWLRQDO 65$0 RULHQWHG SURFHVVRUV DUH YHU\ HUURU SURQH WKXV PRVW RI WKH H[LVWLQJ VWDWH RI DUW WHFKQRORJLHV IRU GHVLJQLQJ HIILFLHQW PHPRU\ PDQDJHPHQW PDLQO\ H[SORUHG GLIIHUHQW W\SHV RI QRQYRODWLOH WHFKQRORJLHV HJ 3&0V 55V DQG 6775$0V 67705$0V DUH FRQVLGHUHGWKHEHVWSRVVLEOHDOWHUQDWLYHWRFRQYHQWLRQDO65$0 WHFKQRORJLHV DV WKHVH FDQ EH HPEHGGHG LQWR RQFKLS FDFKH PHPRULHV ,W DOVR KDV YHU\ QHJOLJLEOH SRZHU GHQVLW\ DQG LPPXQLW\ FRQVWUDLQWV DV FRPSDUHG WR WKH 65$0 FKLSV 9RODWLOH  +RZHYHU WKH 67705$0V DUH PRUH RQ GHPDQG HQWLWLHVIURPWKHVHFXULW\YLHZSRLQWEXWWKHVHSRVHKLJKHUURU UDWH GXULQJ WKH RSHUDWLRQV 7KH ZULWH RSHUDWLRQV WDNH SODFH LQ YDULRXV VWRULQJ HOHPHQWV OLNH 0DJQHWLF 7XQQHO -XQFWLRQV 0-7V  FRXQWHU HWF >@>@ ZKHUH WKH VWRFKDVWLF WUDQVLWLRQ

7KLV ZRUN ZDV VXSSRUWHG E\ 0LQLVWU\ RI +LJKHU (GXFDWLRQ 0DOD\VLD .HPHQWHULDQ3HQGLGLNDQ7LQJJL XQGHU)XQGDPHQWDO5HVHDUFK*UDQW6FKHPH )5*6 QXPEHU)5*6

‹,(((



)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ3DUDOOHO'LVWULEXWHGDQG*ULG&RPSXWLQJ3'*&

GLVWULEXWLRQVRIZULWHRSHUDWLRQVOHDGWRKDYLQJDKLJKHULPSDFW RQ H[WHQGLQJ DV\PPHWULF HUURU UDWHV  6HYHUDO VWXGLHV KDYH IRXQG WR DGGUHVV WKH ZULWH HUURU UDWH UHGXFWLRQ LQ 677 05$0V ZKHUH IHZ RI WKHP LQFRUSRUDWHG FLUFXLW OHYHO DSSURDFKWRHOLPLQDWHHUURUUDWHVE\PDQLSXODWLRQRIZULWHSXOVH DPSOLWXGH IHDWXUHV 6RPH RI WKHP LQLWLDWHG 57/OHYHO EDVHG WHFKQRORJLHV ZKLFK UHGXFH WKH KDPPLQJ ZHLJKW RI LQFRPLQJ EORFNV E\ DSSO\LQJ VSHFLDO HQFRGLQJ PHFKDQLVPV 7KH DERYH VWDWHGERWKWHFKQLTXHVLPSRVHXQQHFHVVDU\FLUFXLWU\RYHUKHDGV GXULQJLQVWUXFWLRQIHWFKLQJDQGSURFHVVLQJWKXVWKHUHLVDQHHG RI GHVLJQLQJ DQ HIILFLHQW FDFKH UHSODFHPHQW PHFKDQLVP WR UHGXFH WKH FDFKH ZULWH HUURUV E\ PLQLPL]LQJ WKH WUDQVLWLRQ F\FOHV LQ WKH SHULSKHUDO FLUFXLWV>@>@>@ 7KH SURSRVHG VWXG\ SUHVHQWV DQ HIILFLHQW FDFKH UHSODFHPHQW DOJRULWKP ZKLFK LQWHJUDWHV D GLUHFW FRPSXWDWLRQ RI KDPPLQJ GLVWDQFH LQ EHWZHHQ LQFRPLQJ GDWD EORFN DQG WKH FXUUHQW EORFN LQ WKH FDFKHV,WDOVRWUDFNVGRZQWKHGLIIHUHQWOHYHORIWUDQVLWLRQVIRU IRUPXODWLQJWKHHUURUUDWHV,Q/FDFKHVWKHZULWHRSHUDWLRQV KDSSHQ GXH WR WKH FDFKH PLVVHV DQG ZULWH EDFN UHTXHVWV IURP /FDFKHV7KHUHIRUHWKHSURSRVHGPRGHOSHUIRUPVDFRPSDUH ORJLF RSHUDWLRQ LQ EHWZHHQ LQFRPLQJ GDWD EORFN DQG WKH DVVRFLDWLYH LQYDOLG OLQHV DYDLODEOH WR FRPSXWH WKH KDPPLQJ GLVWDQFH ,Q ZULWH RSHUDWLRQ WKH SURSRVHG FDFKH UHSODFHPHQW DOJRULWKP FDOFXODWHV WKH QXPEHU RI WUDQVLWLRQV DQG ELW ZLVH GLIIHUHQFHLQEHWZHHQWKHLQFRPLQJEORFNDQGWKHWDUJHWOLQHWR IRUPXODWHWKHLQFRPLQJEORFNUHSODFHPHQWLQWKHFDFKH,WDOVR GHILQHVDQDVVRFLDWLYHO\IXQFWLRQZKLFKVKRZVWKDWWKHLPSDFW RI  WR  WUDQVLWLRQ LQ WRWDO HUURU UDWH LQFUHDVHV JUDGXDOO\ DV FRPSDUHG WR WKH  WR  WUDQVLWLRQV 7KH SURSRVHG VWXG\ DOVR KLJKOLJKWVDFRPSDUDWLYHDQDO\VLVLQEHWZHHQWKHFRQYHQWLRQDO /58DOJRULWKPIRUFDFKHUHSODFHPHQWDQGWKHSURSRVHGFDFKH UHSODFHPHQW DOJRULWKP ZKLFK LOOXVWUDWHV WKDW WKH SURSRVHG PRGHOGHSLFWVYHU\ORZPLVVUDWHVZLWKUHVSHFWWRWKHLQFUHPHQW LQILOHVL]H,WDOVRKLJKOLJKWVKRZRXUSURSRVHGPRGHODFKLHYHV YHU\ OHVV ZULWH HUURU UDWHV LQ WKH WDUJHW EORFNV E\ LPSRVLQJ PLQLPXPQXPEHURIWRWUDQVLWLRQV7KHSDSHULVRUJDQL]HG DV IROORZV 6HFWLRQ ,, GLVFXVVHV DERXW WKH UHFHQW VWXGLHV WRZDUGV FRQYHQWLRQDO HIILFLHQW FDFKH UHSODFHPHQW DOJRULWKP IROORZHG E\ UHVHDUFK PHWKRGRORJ\ KLJKOLJKWHG LQ 6HFWLRQ ,,, 6HFWLRQ ,9 KLJKOLJKWV WKH H[SHULPHQWDO RXWFRPHV DQG WKH FRPSDUDWLYHDQDO\VLVRIWKHSURSRVHGFDFKHUHSODFHPHQWPRGHO WRHQVXUHWKHHIIHFWLYHQHVVDQGWKHIXWXUHHQKDQFHPHQW6HFWLRQ 9GHSLFWVWKHFRQFOXVLRQRIWKHSURSRVHGVWXG\ ,, /,7(5$785(6859(@ LQFRUSRUDWHG D FRPELQHG FRVW VHQVLWLYLW\ DQG ORFDOLW\SULQFLSOHWRLPSURYHWKHFDFKHSHUIRUPDQFHDVVRFLDWHG ZLWK WKH FDFKH UHSODFHPHQW DOJRULWKPV  7KH\ KDYH GHILQHG D QHZ PHPRU\ KLHUDUFK\ ZKLFK LV FDSDEOH RI UHGXFLQJ WKH DYHUDJHPHPRU\DFFHVVWLPH7KHSURSRVHGORFDOLW\DZDUHFRVW VHQVLWLYH FDFKH UHSODFHPHQW DOJRULWKP PD[LPL]HV WKH RYHUDOO /FDFKHSHUIRUPDQFHE\XSWRWRZKLOHHYDOXDWHG RQ 63(& &38 EHQFKPDUNV DQG GHSLFWV  WR  RQ DYHUDJH VSHHG XS ZKHQ HYDOXDWHG XVLQJ GXDO FRUH &30 DUFKLWHFWXUH PRGHO $XWKRUV LQ >@ LQWURGXFHG D FRYHU VHW PHWKRGWRVROYHWKHUXOHGHSHQGHQF\LVVXHDQGLPSRUWDQWFDFKH UXOHV RFFXU GXULQJ WKH LPSOHPHQWDWLRQ SURFHVV RI 2SHQ )ORZ

VZLWFKHV LQ 7HUQDU\ &RQWHQW $GGUHVVDEOH 0HPRU\ 7&$0  7KH SHUIRUPDQFH DQDO\VLV VKRZV WKH HIIHFWLYHQHVV RI WKH SURSRVHGPHWKRGE\FRPSDULQJLWZLWKWKHH[LVWLQJWHFKQLTXHV ,Q >@ DXWKRUV SURSRVHG D FDFKH UHSODFHPHQW DOJRULWKP QDPHO\ /HDVW (UURU 5DWH /(5  IRU UHGXFLQJ WKH ZULWH HUURU UDWHV LQ / FDFKHV 7KH GHVLJQ SULQFLSOHV RI WKH SURSRVHG DOJRULWKPH[SOLFLWO\GHSLFWVWKDWLWDFTXLUHVPLQLPXPHUURUUDWH LQ ZULWH RSHUDWLRQ IURP LQFRPLQJ EORFN UHTXHVWV 7KH FRPSDUDWLYH DQDO\VLV VKRZV WKDW /(5 RXWSHUIRUPV WKH FRQYHQWLRQDO/58DOJRULWKPLQWHUPVRIFDFKHZULWHHUURUUDWH DQG FDFKH PLVV UDWH ,W H[KLELWV WKH PLQLPL]DWLRQ RI HUURU UDWH E\ [ ZLWK DERXW  DQG   SHUIRUPDQFH RYHUKHDG DV FRPSDUHGWRWKH/58PHFKDQLVP$XWKRUVLQ>@GHYHORSHGD YHU\ OLJKW ZHLJKW FDFKLQJ PDQDJHPHQW DOJRULWKP IRU PD[LPL]LQJ WKH WUDIILF YROXPH RI GDWD LQVWUXFWLRQ ,W DOVR PLQLPL]HV WKH EDQGZLGWK XVDJH 7KH H[SHULPHQWDO RXWFRPHV VKRZV WKDW WKH FDFKH DOJRULWKP SHUIRUPV EHWWHU WKDQ WKH H[LVWLQJ VWUDWHJLHV LQ WHUPV RI DFFHVV ODWHQF\  EHWWHU KLW UDWLR DQG HIILFLHQW VHUYHU EDQGZLGWK FRQVXPSWLRQ $ SHUIRUPDQFH HIIHFWLYH UHJLRQDO SRSXODULW\ DZDUH FDFKH UHSODFHPHQW DOJRULWKP KDV EHHQ LQWURGXFHG LQ >@ ,W HQVXUHV KLJKUHOLDELOLW\DQGUHGXFHVXQQHFHVVDU\FDFKHUHSODFHPHQWVLQ IODVKEDVHGVROLGVWDWHGULYHV7KHSHUIRUPDQFHPHWULFVVKRZV WKDWLWLPSURYHVWKURXJKSXWE\XSWRDQGRXWSHUIRUPVWKH FRQYHQWLRQDO FDFKH UHSODFHPHQW VWUDWHJLHV ,Q >@ DXWKRUV LQWURGXFHG D 5DQGRP )LUVW )ODVK (QODUJHPHQW 5))(  DOJRULWKPWRLPSURYHWKHSHUIRUPDQFHRIZULWHRSHUDWLRQVLQ/ FDFKHV 7KH H[SHULPHQWDO UHVXOWV VKRZ WKDW LW RXWSHUIRUPV WKH SUHYLRXVO\ SURSRVHG WHFKQLTXHV ZLWK UHVSHFW WR PHUJH HUDVH DQGZULWHFRXQW7KHDXWKRUVLQ>@DGGUHVVHGWKHSUREOHPRI FDFKHUHSODFHPHQWVIRUWUDQVFRGLQJSUR[\FDFKLQJ,WSURSRVHG DQHIILFLHQWFDFKHUHSODFHPHQWDOJRULWKPWRPDLQWDLQWKHFDFKH FRQVLVWHQF\ E\ WDNLQJ LQWR DFFRXQW GLIIHUHQW YHUVLRQ RI VDPH PXOWLPHGLDREMHFWV ,,, 5(6($5&+0(7+2'2/2*%L@ ÆPLQ 6WHSVL[$VVLJQ7EÅ%>%L@ 6WHSVHYHQ)WDUJHWÅ 6WHSHLJKWHQGLI 6WHSQLQHHQGIRU 6WHSWHQHQG Algorithm Two:9DOLGEORFNVHDUFKLQJ ,QSXWLQFRPLQJQHZFDFKHEORFN1E  2XWSXWWDUJHWDOORFDWHGEORFN7E  6WHSRQHVWDUW 6WHSWZRLI)WDUJHWÆ 6WHSWKUHHIRU%LÅ$VVRFLQ7V 6WHSIRXULIWUDQ%>%L@ ÆPLQ 6WHSILYH$VVLJQ7EÅ%>%L@ 6WHSVL[)WDUJHWÅ 6WHSVHYHQHQGLI 6WHSHLJKWHQGIRU 6WHSQLQHHQGLI 6WHSWHQUHWXUQ7E 6WHSHOHYHQHQG

,Q WKH DERYH PHQWLRQHG DOJRULWKPV 1E 7V )WDUJHW %L 7E GHQRWHQHZFDFKHEORFNWDUJHWVHWILQGWDUJHWEORFNLQGH[DQG WDUJHW EORFN UHVSHFWLYHO\ 7KH DERYH PHQWLRQHG DOJRULWKPV GHSLFW WZR GLIIHUHQW W\SHV RI VFHQDULR WR FRPSXWH WKH WDUJHW EORFN ILQGHU IRU LQFRPLQJ GDWD EORFNV 7KH SURSRVHG FDFKH UHSODFHPHQW SROLF\ EDVLFDOO\ SUHVHQWV WZR GLIIHUHQW W\SHV RI DOJRULWKPV ZKHUH DOJRULWKP RQH VKRZV KRZ WDUJHW EORFN LV DOORFDWHG E\ ILQGLQJ DQ LQYDOLG GDWD EORFN DQG FRQVLGHULQJ PLQLPXP WUDQVLWLRQ LQGH[ UHIHUUHG E\  WR  ZULWH RSHUDWLRQV VLJQDO FKDUDFWHULVWLFV 6HFRQGO\ LW LQLWLDWHV DOJRULWKP WZR ZKLFK HQDEOHV YDOLG EORFN VHDUFKLQJ DQG DOORFDWLQJ WDUJHW EORFNV 7KH DOJRULWKPV VHW ILQG WDUJHW YDOXH   LQ WKH LQLWLDO SKDVH RI WKH SURFHVV DQG VHW ILQG WDUJHW YDOXH   DIWHU FRPSOHWLRQRIWKHSURFHVV ,9 5(68/7$1$/@ 8 0LFURILOPV ;8 0LFURILOPV 80 ,QWHUQDWLRQDO 'LVVHUWDWLRQ $EVWUDFWV ,QWHUQDWLRQDO 7KH VFLHQFHV DQG HQJLQHHULQJ 8QLYHUVLW\ 0LFURILOPV6FLHQFH >@ 0 .KDUEXWOL DQG @ &: 6PXOOHQ 9 0RKDQ $ 1LJDP 6 *XUXPXUWKL DQG 0 5 6WDQ 5HOD[LQJ QRQYRODWLOLW\ IRU IDVW DQG HQHUJ\HIILFLHQW 6775$0 FDFKHV LQ IEEE 17th International Symposium on High Performance Computer ArchitectureSS >@ 16 .LP . )ODXWQHU ' %ODDXZ DQG 7 0XGJH &LUFXLW DQG PLFURDUFKLWHFWXUDOWHFKQLTXHVIRUUHGXFLQJFDFKHOHDNDJHSRZHUIEEE Transactions on Very Large Scale Integration (VLSI) Systems YRO  QRSS >@ --HRQJDQG0'XERLV&RVWVHQVLWLYHFDFKHUHSODFHPHQWDOJRULWKPV LQ High-Performance Computer Architecture, HPCA-9 the Ninth International SymposiumSS >@ 6.KDQ$5$ODPHOGHHQ&:LONHUVRQ20XWOXDQG'$-LPpQH] ,PSURYLQJ FDFKH SHUIRUPDQFH E\ H[SORLWLQJ UHDGZULWH GLVSDULW\ LQ High Performance Computer Architecture (HPCA), 2014 IEEE 20th International Symposium on >@ 5 6KHLNK DQG 0 .KDUEXWOL ,PSURYLQJ FDFKH SHUIRUPDQFH E\ FRPELQLQJ FRVWVHQVLWLYLW\ DQG ORFDOLW\ SULQFLSOHV LQ FDFKH UHSODFHPHQW DOJRULWKPV LQ Computer Design (ICCD), 2010 IEEE International Conference onSS >@ - 3 6KHX DQG @ $ 0RQD]]DK + )DUEHK DQG 6 0LUHPDGL /(5 /HDVW HUURU UDWH UHSODFHPHQW DOJRULWKP IRU HPHUJLQJ 6775$0 FDFKHV ,((( Transactions on Device and Materials Reliability YRO  QR  SS ± >@ ; 6XQ DQG = :DQJ $Q RSWLPL]HG FDFKH UHSODFHPHQW DOJRULWKP IRU LQIRUPDWLRQFHQWULF QHWZRUNV ,Q IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity)SS >@ )@ $6 5DPDVDP\ DQG 3 .DUDQWKDUDM 5))( $ EXIIHU FDFKH PDQDJHPHQW DOJRULWKP IRU IODVKPHPRU\EDVHG 66' WR LPSURYH ZULWH



)RXUWK,QWHUQDWLRQDO&RQIHUHQFHRQ3DUDOOHO'LVWULEXWHGDQG*ULG&RPSXWLQJ3'*& SHUIRUPDQFH Canadian Journal of Electrical EngineeringYROQRSS

and

Computer

>@ . /L + 6KHQ . 7DMLPD DQG / +XDQJ ³$Q HIIHFWLYH FDFKH UHSODFHPHQW DOJRULWKP LQ WUDQVFRGLQJHQDEOHG SUR[LHV The Journal of SupercomputingYROQRSS