based on the software size measurement, achieving high accuracy in functional size measurement (FSM) is critical. Several studies examined the relation ...
2014 Joint Conference of the International Workshop on Software Measurement and the International Conference on Software Process and Product Measurement
7KH(IIHFWRI+LJKOLJKWLQJ(UURU&DWHJRULHVLQ)60 7UDLQLQJRQWKH$FFXUDF\RI0HDVXUHPHQW
$OL0HUW(UWXJUXO*RNFHQ@
A. Research Methodology and Implementation ,Q RUGHU WR LQYHVWLJDWH WKH HIIHFW RI KLJKOLJKWLQJ UHFXUUHQW HUURUV GXULQJ WUDLQLQJ ZH FROOHFWHG &260,& IXQFWLRQDO VL]H PHDVXUHPHQWUHVXOWVRIIRXUFRXUVHSURMHFWVEHWZHHQWKH\HDUV DQG $OO RI WKHVH SURMHFWV DUH 0,6 SURMHFWV DQG WKHLUIXQFWLRQDOVL]HVDQGIXQFWLRQDOLWLHVDUHVLPLODU:HKDYH DQG&260,&IXQFWLRQDOVL]HPHDVXUHPHQWVIRU WKH\HDUVDQGUHVSHFWLYHO\ 7KHUHIRUH ZH FROOHFWHG D WRWDO RI PHDVXUHPHQW UHVXOWV IURP IRXU SURMHFWV
%HVLGHV WKHVH UHOLDELOLW\ FDVH VWXGLHV WZR GLIIHUHQW UHOLDELOLW\ LPSURYHPHQW VWXGLHV DUH FRQGXFWHG EDVHG RQ WKH *XLGHOLQH IRU $VVXULQJ WKH $FFXUDF\ RI &260,& 0HDVXUHPHQWV>@ @ $GGLWLRQDOO\ 6DOPDQRJOX GHYHORSHG D PHWKRGRORJ\ DQGWRRO WRSUHYHQW WKH PHDVXUHPHQWHUURUVGXULQJWKHPHDVXUHPHQWSKDVH>@
1RWLFH WKDW FRXUVH GDWD DUH REWDLQHG IURP WKH VWXGHQWV ZKRDUHJLYHQWKH VDPHIXQFWLRQDOVL]HPHDVXUHPHQWWUDLQLQJ IRU WKH ILUVW WLPH 7KLV PHDQV WKDW QRQH RI WKH VWXGHQWV DUH H[SHULHQFHG ZLWK WKH &260,& IXQFWLRQDO VL]H PHDVXUHPHQW EHIRUH WKH FRXUVH +RZHYHU WKH VWXGHQWV RI ODVW WZR \HDUV DQG DUH ZDUQHG DERXW UHFXUUHQW HUURUV LQ &260,&IXQFWLRQDOVL]HPHDVXUHPHQW B. Expert Review Process $FFXUDWH &260,& IXQFWLRQDO VL]H PHDVXUHPHQW GRFXPHQWVFDOOHGUHIHUHQFHNH\VDUHSUHSDUHGIRUWKHSURMHFW RI IRXU \HDUV E\ D KLJKO\ H[SHULHQFHG FHUWLILHG PHDVXUHU 7KHVHNH\VDUHQDPHG.H\.H\.H\DQG.H\IRU WKHSURMHFWVRI\HDUVDQGUHVSHFWLYHO\ 7KHUHIHUHQFHNH\RIHDFKSURMHFWLVSUHSDUHGEDVHGRQWKH656 GRFXPHQWVRIHDFKVRIWZDUHSURMHFW
7KHVH UHVHDUFK VWXGLHV SHUIRUPHG WR LGHQWLI\ DQG LQFUHDVH WKH UHOLDELOLW\ DQG DFFXUDF\ RI )60 PHWKRGV DUH UHVXOWHG LQ HOLPLQDWLQJWKHHUURUVIURPPHDVXUHPHQWGRFXPHQWV+RZHYHU WKH VWXGLHV DOVR VKRZV WKDW &260,& PHDVXUHPHQW DFFXUDF\ VWLOOKDYHURRPWRLPSURYH ,,, 7+( ())(&7 2) +,*+/,*+7,1* (5525 &$7(*25,(6217+('(&5($6(,1(55255$7(
0RUHRYHUWZRH[SHULHQFHGPHDVXUHUVHYDOXDWHGWKHUHVXOWV ,Q RWKHU ZRUGV WZR PHDVXUHUV UHYLHZHG WKH VXEPLWWHG PHDVXUHPHQW UHVXOWV DQG GHWHFWHG WKH HUURUV PDQXDOO\ E\ FRPSDULQJ WKHVH UHVXOWV ZLWK WKH PHDVXUHPHQWV LQ UHIHUHQFH NH\V 7KH PHDVXUHUV IROORZ DQ LWHUDWLYH UHYLHZ SURFHVV LQ ZKLFK WKH\ VWDUW ZLWK GHWHFWLQJ WKH HUURUV LQ (& FDWHJRU\ WKURXJKRXW DOO RI WKH GRFXPHQWV $IWHU GHWHFWLRQ RI WKH HUURUV EHORQJLQJ WR (& FDWHJRU\ LV GRQH WKH\ PRYHG RQ ZLWK WKH GHWHFWLRQ RI HUURUV EHORQJLQJ WR RWKHU FDWHJRULHV LWHUDWLYHO\ XQWLO(&1DPHVDQGGHVFULSWLRQVRIWKHHUURUFDWHJRULHVDUH JLYHQLQ7DEOH,>@
,Q WKLV VWXG\ RXU SXUSRVH LV WR XQGHUVWDQG LI ZDUQLQJ WKH WUDLQHUV DERXW WKH UHFXUUHQW HUURUV UHODWHG WR &260,& IXQFWLRQDO VL]H PHDVXUHPHQWV )60 SUHYHQWV WKHP WR UHSHDW WKH VDPH HUURUV ,Q RWKHU ZRUGV VSHQGLQJ PRUH WLPH RQ WKH IUHTXHQWO\ REVHUYHG HUURU FDWHJRULHV > @ GXULQJ WUDLQLQJ LV H[SHFWHGWRUHVXOW LQ D UHGXFWLRQ LQ WKH HUURUUDWH7R YDOLGDWH RXUH[SHFWDWLRQVZHDQDO\]HG&260,& JLYHQDVSDUWVRIWZR FRXUVHV ZLWK WKH VDPH FRQWHQW QDPHO\ 6RIWZDUH 0DQDJHPHQW FRXUVH 60 DQG6RIWZDUH3URMHFW0DQDJHPHQWFRXUVH ,6 DW 0(78 ,QIRUPDWLFV ,QVWLWXWH DVVLJQPHQW GDWD EHORQJLQJ WR IRXU FRQVHTXHQW \HDUV 1RWH WKDW ERWK FRXUVHV ZHUHJLYHQE\WKHVDPHLQVWUXFWRULQWKHVHIRXU\HDUV 7$%/(,
1$0(6$1''(6&5,37,2162)(5525&$7(*25,(6
(UURU &DWHJRULHV (&
1DPH
'HVFULSWLRQ
(&
'XSOLFDWH)XQFWLRQDO3URFHVV )3
,IWZRGLIIHUHQW)3VKDYHH[DFWO\WKHVDPH '*'0 WXSOHDQGUHSUHVHQWWKH VDPHIXQFWLRQDOLW\RIWKHV\VWHPRQHRIWKHVHWZR)3VLVUHGXQGDQW
(&
/DFNRI/LVW)3EHIRUH8SGDWH)3
)RUDVSHFLILF8SGDWH)3LIXVHUIRUJHWVWRPHDVXUHLWVUHODWHG/LVW)3 PHDVXUHPHQWPD\KDYHWKLVW\SHRIGHIHFW
(&
/DFNRI/LVW)3EHIRUH'HOHWH)3
)RUDVSHFLILF'HOHWH)3LIXVHUIRUJHWVWRPHDVXUHLWVUHODWHG/LVW)3 PHDVXUHPHQWPD\KDYHWKLVW\SHRIGHIHFW
(&
/DFNRI5HWULHYH)3EHIRUH8SGDWH)3
)RUDVSHFLILF8SGDWH)3LIXVHUIRUJHWVWRPHDVXUHLWVUHODWHG5HWULHYH)3 PHDVXUHPHQWPD\KDYHWKLVW\SHRIGHIHFW
(&
/DFNRI'DWD0RYHPHQW '0 W\SH:ULWH : LQ$GG 'HOHWHDQG8SGDWH)3V
$GG'HOHWHDQG8SGDWH)3VVKRXOGFRQVLVW:'0,IWKHVH)3VGRQRW FRQWDLQDWOHDVWRQH:'0GHIHFWVRFFXUFRQFHUQLQJWKLVHUURUFDWHJRU\
(&
5HGXQGDQW'0W\SH:LQ/LVW)3V
/LVW)3VXVXDOO\GRQRWFRQWDLQ:'0,IWKHVH)3VFRQWDLQDWOHDVWRQH: '0GHIHFWVRFFXUFRQFHUQLQJWKLVHUURUFDWHJRU\
153
(UURU &DWHJRULHV (&
1DPH
'HVFULSWLRQ
(&
0XOWLSOHRFFXUUHQFHVRIWKHVDPH'0ZLWKLQWKHVDPH)3
,ID)3FRQWDLQVPRUHWKDQWZR'0VWKDWPRYHWKHVDPH'*ZLWKWKHVDPH '0W\SHGHIHFWVRFFXUFRQFHUQLQJWKLVHUURUFDWHJRU\
(&
(DFK)3VKRXOGEHFRPSRVHGRIDWOHDVW'0V
0HDVXUHPHQWUXOHRI&260,&)600HWKRG
(&
(DFK)3VKRXOGFRQWDLQDWOHDVW:ULWH : ([LW ; '0
0HDVXUHPHQWUXOHRI&260,&)600HWKRG
(&
(DFK)3VKRXOGFRQWDLQDWOHDVW(QWU\ ( '0
0HDVXUHPHQWUXOHRI&260,&)600HWKRG
(&
/LVW)3PLJKWEHLQFOXGHGLQ8SGDWH'HOHWH)3V
,IOLVW)3LVPHDVXUHGZLWKLQDQ\XSGDWHRUGHOHWH)3QRWDVDVHSDUDWH)3 GHIHFWVRFFXUFRQFHUQLQJWKLVHUURUFDWHJRU\
(&
&UHDWH'HOHWH8SGDWHRSHUDWLRQVPLJKWEHFRPELQHG
,IPHDVXUHUVFRPELQHWKHVHIXQFWLRQDOLWLHVDQGPHDVXUHWKHPDVDZKROH GHIHFWVRFFXUFRQFHUQLQJWKLVHUURUFDWHJRU\
(&
'DWD*URXS '* 'XSOLFDWLRQ
,IWZRGLIIHUHQW'*FRQWDLQVH[DFWO\WKHVDPHFRPELQDWLRQVRI'DWD $WWULEXWHVGHIHFWVRFFXUFRQFHUQLQJWKLVHUURUFDWHJRU\
(&
8VHULQWHUIDFHFRPSRQHQWVDQG6\VWHPXVHUVDUH FRQVLGHUHGDV'*2EMHFW2I,QWHUHVW 22,
(&
22,VDUHQDPHGZURQJ
,IPHDVXUHUVXVHXVHULQWHUIDFHFRPSRQHQWVVXFKDVFRPPDQGPHQXEXWWRQ DQGVFUHHQIRUQDPLQJ22,VDQG'*VGHIHFWVRFFXUFRQFHUQLQJWKLVHUURU FDWHJRU\ ,IPHDVXUHUVXVHYHUEVVXFKDVVHOHFWVHDUFKVDYHDQGILQGIRUQDPLQJ22,V GHIHFWVRFFXUFRQFHUQLQJWKLVHUURUFDWHJRU\
6LQFHZHKDYHGLIIHUHQWQXPEHURISURMHFWVLQHDFK\HDUZH FDQ SHUIRUP D PRUH UHDVRQDEOH FRPSDULVRQ XVLQJ WKH DYHUDJH QXPEHURIHUURUV7KHUHIRUHEHVLGHVWKHWRWDOQXPEHURIHUURUV ZHDOVRFDOFXODWHGWKHLUDYHUDJH
,9 5(68/76$1'',6&866,216 7DEOH ,, UHIOHFWV WKH WRWDO DQG DYHUDJH QXPEHUV RI HUURUV REWDLQHG IURP WKH PHDVXUHPHQWV RI WKH VWXGHQWV EHWZHHQ WKH \HDUV DQG EDVHG RQ WKH FRUUHVSRQGLQJ HUURU FDWHJRULHV5HFDOOWKDWWKHHUURUVDUHFDWHJRUL]HGLQWRHUURU FDWHJRULHVDFFRUGLQJWRWKHVWXG\RI>@
,Q RUGHU WR EHWWHU YLVXDOL]H WKH FKDQJHV LQ YDULRXV HUURU FDWHJRULHV (& WKURXJK\HDUVZHSORWWHG)LJWKDWUHSUHVHQWV WKH DYHUDJH QXPEHU RI HUURUV UHODWHG WR HDFK HUURU FDWHJRU\ (& IRUIRXU\HDUV,QWKLVILJXUHEDUVZLWKOLJKWHUJUH\FRORUV UHSUHVHQW WKH HUURUV REWDLQHG EHIRUH WKH VWXGHQWV DUH ZDUQHG DERXWWKHPRVWIUHTXHQWHUURUVLQDQG2QWKHRWKHU KDQG GDUNHU JUH\ EDUV DUH UHSUHVHQWDWLYHV RI WKH DYHUDJH QXPEHU RI HUURUV REWDLQHG LQ DQG LQ ZKLFK HUURU FDWHJRULHVZHUHPRUHIRFXVHG
7$%/(,, 727$/$1'$9(5$*(180%(52)(55256,1 ($&+&$7(*25@ ISO/IEC, “20926: Software and systems engineering 6RIWZDUH PHDVXUHPHQW,)38*IXQFWLonal size measurement method.” 2009. >@ M. Villavicencio and A. Abran, “Educational Issues in the Teaching of 6RIWZDUH 0HDVXUHPHQW LQ 6RIWZDUH (QJLQHHULQJ 8QGHUJUDGXDWH
155
>@
>@ >@ >@
>@ >@
> @ G. Yilmaz, S. Tunalilar, and O. Demirors, “Towards the 'HYHORSPHQWRI a Defect Detection Tool for COSMIC Functional Size Measurement,” -W &RQI UG ,QW :RUN 6RIWZ 0HDV WK ,QW &RQI 6RIWZ 3URFHVV3URG0HDVSS –2FW >@ O. Demirörs and M. (METU) Salmanoglu, “Exploration of an Error 3UHYHntion Model for COSMIC Functional Size Measurement Method,” LQ 7KH -RLQW &RQIHUHQFH RI WKH QG ,QWHUQDWLRQDO :RUNVKRS RQ 6RIWZDUH0HDVXUHPHQW ,:60 DQGWKHWK,QWHUQDWLRQDO&RQIHUHQFHRQ 6RIWZDUH3URFHVVDQG3URGXFW0HDVXUHPHQW 0HQVXUD S >@ *
