Categorizing and Recommending API Usage Patterns ...

2016 International Computer Symposium

&DWHJRUL]LQJDQG5HFRPPHQGLQJ$3,8VDJH3DWWHUQVEDVHGRQ'HJUHH &HQWUDOLWLHVDQG3DWWHUQ'LVWDQFHV 

6KLQ-LH/HH:X&KHQ6X&KL(Q+XDQJDQG-LH/LQ@ %ODFN'XFN2SHQ+XEKWWSVZZZRSHQKXEQHW >@ '0DQGHOLQ/;X5%RGt.DQG'.LPHOPDQ³-XQJORLG0LQLQJ +HOSLQJWR1DYLJDWHWKH$3,-XQJOH´3URFHHGLQJVRIWKH$&0 6,*3/$1 &RQIHUHQFH RQ 3URJUDPPLQJ /DQJXDJH 'HVLJQ DQG ,PSOHPHQWDWLRQSS >@ 5+ROPHV5-:DONHUDQG*&0XUSK\³$SSUR[LPDWH6WUXFWXUDO &RQWH[W 0DWFKLQJ $Q $SSURDFK WR 5HFRPPHQG 5HOHYDQW ([DPSOHV´,(((7UDQVDFWLRQVRQ6RIWZDUH(QJLQHHULQJYROQR SS'HF >@ -.LP6/HH6:+ZDQJDQG6.LP³(QULFKLQJ'RFXPHQWV ZLWK ([DPSOHV $ &RUSXV 0LQLQJ $SSURDFK´ $&0 7UDQVDFWLRQV RQ,QIRUPDWLRQ6\VWHPVYROQRSS >@ 6&KDWWHUMHH6-XYHNDUDQG.6HQ³61,))$6HDUFK(QJLQHIRU -DYD 8VLQJ )UHH)RUP 4XHULHV´ 3URFHHGLQJV RI WKH WK ,QWHUQDWLRQDO&RQIHUHQFHRQ)XQGDPHQWDO$SSURDFKHVWR6RIWZDUH (QJLQHHULQJSS >@ +=KRQJ7;LH/=KDQJ- 3HLDQG+0HL³0$320LQLQJ DQG5HFRPPHQGLQJ$3,8VDJH3DWWHUQV´3URFHHGLQJVRIWKHUG (XURSHDQ&RQIHUHQFHRQ(&2232EMHFW2ULHQWHG3URJUDPPLQJ SS >@ - $\UHV - )ODQQLFN - *HKUNH DQG 7 @ - :DQJ @ 0 3 5RELOODUG 5 - :DONHU DQG 7 =LPPHUPDQQ ³5HFRPPHQGDWLRQ 6\VWHPV IRU 6RIWZDUH (QJLQHHULQJ´ ,((( 6RIWZDUHYROLVVXHSS >@ * (UNDQ DQG ' 5 5DGHY ³/H[5DQN *UDSKEDVHG /H[LFDO &HQWUDOLW\$V6DOLHQFHLQ7H[W6XPPDUL]DWLRQ´-RXUQDORI$UWLILFLDO ,QWHOOLJHQFH5HVHDUFKYROQRSS >@ '-XUDIVN\DQG-+0DUWLQ³6SHHFKDQG/DQJXDJH3URFHVVLQJ´ 3HDUVRQ(GXFDWLRQ,QWHUQDWLRQDOSS± >@ 67KXPPDODSHQWDDQG7;LH³3DUVHZHE$3URJUDPPHU$VVLVWDQW IRU 5HXVLQJ 2SHQ 6RXUFH &RGH RQ WKH :HE´ 3URFHHGLQJV RI WKH 7ZHQW\VHFRQG,((($&0,QWHUQDWLRQDO&RQIHUHQFHRQ$XWRPDWHG 6RIWZDUH(QJLQHHULQJSS >@ 16DKDYHFKDSKDQDQG.&OD\SRRO³;6QLSSHW0LQLQJIRU6DPSOH &RGH´3URFHHGLQJVRIWKHVW$QQXDO$&06,*3/$1&RQIHUHQFH RQ 2EMHFWRULHQWHG 3URJUDPPLQJ 6\VWHPV /DQJXDJHV DQG $SSOLFDWLRQVSS >@ 771JX\HQ+$1JX\HQDQG1+3KDP³*UDSKEDVHG0LQLQJ RI0XOWLSOH2EMHFW8VDJH3DWWHUQV´3URFHHGLQJVRIWKHWKHWK-RLQW 0HHWLQJRIWKH(XURSHDQ6RIWZDUH(QJLQHHULQJ&RQIHUHQFHDQGWKH $&0 6,*62)7 6\PSRVLXP RQ 7KH )RXQGDWLRQV RI 6RIWZDUH (QJLQHHULQJSS >@ -DYD$3,KWWSGRFVRUDFOHFRPMDYDVHGRFVDSL >@ 06'1/LEUDU\KWWSPVGQPLFURVRIWFRPHQXVOLEUDU\ >@ $ 5DMDUDPDQ DQG - ' 8OOPDQ ³0LQLQJ RI 0DVVLYH 'DWDVHWV´ &DPEULGJH8QLYHUVLW\3UHVV'HF >@ 5%DH]D@ *LW+XE*LVWKWWSVJLVWJLWKXEFRP >@ &RGH5HFRPPHQGHUVhttp://eclipse.org/recommenders/ >@ 6 6XEUDPDQLDQ / ,QR]HPWVHYD DQG 5 +ROPHV ³/LYH $3, 'RFXPHQWDWLRQ´ 3URFHHGLQJV RI WKH ,QWHUQDWLRQDO &RQIHUHQFH RQ 6RIWZDUH(QJLQHHULQJ,&6( SS >@ : -DQMLF 2 +XPPHO DQG & $WNLQVRQ ³5HXVH2ULHQWHG &RGH 5HFRPPHQGDWLRQ 6\VWHPV´ ,Q 5HFRPPHQGDWLRQ 6\VWHPV LQ 6RIWZDUH(QJLQHHULQJSS6SULQJHU >@ .UXJOH6HDUFKKWWSRSHQVHDUFKNUXJOHRUJ >@ 0HUREDVH&RPSRQHQW)LQGHUKWWSZZZPHUREDVHFRP >@ 6-/HH;/LQDQG:&6X³$&RPPHQW'ULYHQ$SSURDFKWR $3,8VDJH3DWWHUQV'LVFRYHU\DQG6HDUFK´,Q3URFHHGLQJVRI 7DLZDQ&RQIHUHQFHRQ6RIWZDUH(QJLQHHULQJ

ȁࡿ࢔࢏࢖ࡾࢋࢉȁ͓ ȁࡿ࢔࢏࢖࡯ࡾࢋࢉȁ͓ ࡴ࢏࢚૞









       

       

       

       









 

 

 

 









    

    

    

    

















$YHUDJH+LW5DWH





The hit rate of the recommendation results is defined as ‫ݐ݅ܪ‬௞ ൌ

ȁௌ௡௜௣஼ோ௘௖ȁ͓ ȁௌ௡௜௣ோ௘௖ȁ͓ 

ǡ

where SnipCRec denotes the code snippets with correct recommendations, and SnipRec denotes the total code snippets with recommendations.  7KHKLWUDWHVRIWKHUHFRPPHQGDWLRQUHVXOWVIRUWKH SURMHFWV DUH GHSLFWHG LQ 7DEOH  7KH DYHUDJH UHFRPPHQGDWLRQKLWUDWHLVZLWKFRGHVQLSSHWV ZKLFKPHDQVWKHV\VWHPKDVDSSUR[LPDWHO\KDOIDFKDQFHRI FRUUHFWO\SUHGLFWLQJWKHILUVWIROORZXS$3,XVDJHSDWWHUQV WKDW ZHUH DFWXDOO\ XVHG E\ WKH SURJUDPPHUV ZLWK WRS  UHFRPPHQGDWLRQV ,9 &21&/86,21 7KLVSDSHUSUHVHQWVWZRQRYHOPHWKRGVIRUFDWHJRUL]LQJ DQGUHFRPPHQGLQJ$3,XVDJHSDWWHUQVWKURXJKH[WHQGLQJ RXU SUHYLRXV ZRUN RI D FRPPHQWGULYHQ V\VWHP IRU GLVFRYHULQJDQGVHDUFKLQJ$3,XVDJHSDWWHUQV7KHV\VWHP ZDVH[WHQGHGZLWKWZRNH\IHDWXUHVILUVWDSURJUDPPHULV SURYLGHGZLWKDVHWRI$3,XVDJHSDWWHUQFDWHJRULHVWKDWDUH DXWRPDWLFDOO\ LGHQWLILHG EDVHG RQ D SURSRVHG GHJUHH FHQWUDOLW\EDVHG FOXVWHULQJ DOJRULWKP VHFRQG D SURJUDPPHUZLOOEHUHFRPPHQGHGDQXPEHURIIROORZXS $3,XVDJHSDWWHUQVZKLOHDGRSWLQJDXVDJHSDWWHUQEDVHGRQ D SURSRVHG PHWULF RI PHDVXULQJ GLVWDQFHV EHWZHHQ $3, XVDJHSDWWHUQV :H DOVR FRQGXFW H[SHULPHQWV WR YDOLGDWH WKH SURSRVHG DSSURDFK 7KH $3, XVDJH SDWWHUQV FDWHJRUL]DWLRQ FDQ DFKLHYHSUHFLVLRQUDWHZLWKUHFDOOUDWH:LWKWRS  UHFRPPHQGDWLRQV$3, XVDJH SDWWHUQV UHFRPPHQGDWLRQ KDGDSSUR[LPDWHO\KDOIDFKDQFHRIFRUUHFWO\SUHGLFWLQJWKH ILUVWIROORZXS$3,XVDJHSDWWHUQVWKDWZHUHDFWXDOO\XVHG E\WKHSURJUDPPHUV $&.12:/('*0(17 7KLVUHVHDUFKLVVSRQVRUHGLQSDUWE\0LQLVWU\RI6FLHQFH DQG 7HFKQRORJ\ XQGHU WKH JUDQW ( 0