The Prosody of Authentic Emotions - Illinois Speech and Language ...

4 downloads 29040 Views 91KB Size Report
kehreinr@mailer.uni marburg.de. Abstract. Prosodic ... liable acoustic data can best be collected in a sound studio. In the study ..... Cambridge, Mass.: MIT Press ...
7KH3URVRG\RI$XWKHQWLF(PRWLRQV 5RODQG.HKUHLQ )RUVFKXQJVLQVWLWXW³'HXWVFKHU6SUDFKDWODV´ 3KLOLSSV8QLYHUVLW\RI0DUEXUJ*HUPDQ\ NHKUHLQU#PDLOHUXQLPDUEXUJGH

$EVWUDFW 3URVRGLFYDULDWLRQLQRUDOFRPPXQLFDWLRQFDQRFFDVLRQDVKLIW LQ KRZ D VSHDNHU¶V IHHOLQJV DQG HPRWLRQV DUH LQWHUSUHWHG D ILQGLQJWKDWLVERWKFRPPRQVHQVHDQGZHOOHVWDEOLVKHGZLWKLQ WKHVFLHQWLILFFRPPXQLW\+RZHYHUQHLWKHUSV\FKRORJLVWVQRU UHVHDUFKHUVLQOLQJXLVWLFDQGFRPPXQLFDWLRQVFLHQFHVKDYH\HW DFKLHYHG FODULW\ FRQFHUQLQJ WKH H[DFW UHODWLRQV EHWZHHQ WKH WZR SKHQRPHQD 7KLV SDSHU RXWOLQHV WKH UHVXOWV RI D VWXG\ GHDOLQJ ZLWK WKH H[SUHVVLRQ RI HPRWLRQV LQ ³QDWXUDO´ VSRNHQ ODQJXDJH ,Q WKLV VWXG\ VRPH OLJKW FRXOG EH VKHG RQ WKH IXQ GDPHQWDOUHODWLRQVEHWZHHQXQLWVRISURVRG\DQGRWKHUVLJQDO OLQJ V\VWHPV DFWLYH LQ WKH H[SUHVVLRQ RI HPRWLRQV 5HVXOWV VKRZWKDWHPRWLRQVDUHPHUHO\SHUFHLYHGDVGLVFUHWHDQGDUHLQ IDFWVHPDQWLFFRPSRVLWHVFRQVWUXFWHGRXWRIVHYHUDOHOHPHQWV ZKLFKHDFKEHDULQGLYLGXDOVHPDQWLFFRPSRQHQWV

 ,QWURGXFWLRQ 7KHUHFRJQL]HGDFKLHYHPHQWVRILQWHUQDWLRQDOSURVRGLFVWXGLHV FRQWLQXHWRVWDQGLQYHU\SRRUUHODWLRQWRWKHVRPHWLPHVTXLWH WD[LQJ UHVHDUFK HIIRUWV LQYROYHG 1XPHURXV WKHRUHWLFDO DQG PHWKRGRORJLFDOH[SODQDWLRQVFDQEHSXWIRUZDUGIRUWKLV7KH WKHRUHWLFDODVSHFWVFDQQRWEHGHDOWZLWKDWOHQJWKLQWKLVSDSHU EXWFI>@>@ LWLVLPSRUWDQWVROHO\WRQRWHKHUHWKDWIURPD WKHRUHWLFDO VWDQGSRLQW D SURVRGLF PRGHO WKDW LQFOXGHV SLWFK DORQH ± OHW DORQH MXVW WZR UHODWLRQDO SLWFK OHYHOV ± LV LQDGH TXDWH IRU DQ DQDO\VLV RI WKH H[SUHVVLRQ RI HPRWLRQ )RU WKLV UHDVRQ , HPSOR\ D GLIIHUHQWLDWHG HPSLULFDOO\ IRXQGHG SUR VRGLF PRGHO ZKLFK DFFRXQWV IRU DOO WKUHH SURVRGLF IHDWXUHV SURPLQHQFHDQGGXUDWLRQDVZHOODVSLWFK $VWKLVPRGHOLV GHVFULEHGLQGHWDLOHOVHZKHUH FI>@ KHUH,ZLOOPHQWLRQMXVW WZR RI WKH GHVFULSWLYH FDWHJRULHV IURP LW ZKLFK DOVR FKDUDF WHULVH WKRVH SURVRGLF XQLWV IRXQG WR EH UHOHYDQW WR HPRWLRQ )XQFWLRQDO SURVRGLF XQLWV DUH FODVVLILHG ILUVW DFFRUGLQJ WR WKHLU GRPDLQ HLWKHU ORFDO DFURVV V\OODEOHV RU JOREDO DFURVV ZKROHV\QWDFWLFSUDJPDWLFEDVHXQLWVRIVSRNHQODQJXDJHFI >@ DQGVHFRQGWKHIRUPIXQFWLRQUHODWLRQWKH\H[KLELW GLV FUHWHIRUP$ PHDQLQJ$IRUP% IXQFWLRQ%FRQWLQXRXV PRUHOHVVIRUP$ PRUHOHVVPHDQLQJ$  2EWDLQLQJ GDWD SRVHV D PHWKRGRORJLFDO SUREOHP LQ HP SLULFDO SURVRG\ UHVHDUFK LQ SDUWLFXODU IRU VWXGLHV RI WKH SUR VRGLF H[SUHVVLRQ RI HPRWLRQV6SRQWDQHRXV³QDWXUDO´VSHHFK GDWDFROOHFWHGLQ³QDWXUDO´VLWXDWLRQVWKDWDUHQRQHWKHOHVVVXLW DEOH IRU DFRXVWLF DQDO\VLV DUH QHHGHG \HW ZKLOVW WKH IRUPHU FDQEHREWDLQHGPRVWUHDGLO\YLDUHFRUGLQJV³LQWKHILHOG´UH OLDEOHDFRXVWLFGDWDFDQEHVWEHFROOHFWHGLQDVRXQGVWXGLR ,Q WKH VWXG\ GHVFULEHG LQ WKLV SDSHU E\ PDNLQJ XVH RI VSHHFK GDWD WKDW RIIHU DQ RSWLPDO EDODQFH EHWZHHQ D FDVXDO VW\OH LQ WKH /DERYLDQ VHQVH FI >@  DQG DFRXVWLF TXDOLW\ , KDYHEHHQDEOHWRGHPRQVWUDWHIXQGDPHQWDOUHODWLRQVEHWZHHQ SURVRGLFXQLWVRISULPDU\OLQJXLVWLFUHOHYDQFHSURVRGLFXQLWV UHOHYDQW WR WKH H[SUHVVLRQ RI HPRWLRQ DQG OLQJXLVWLFXQLWVRI YHUEDO VLJQDOOLQJ V\VWHPV LQ WKH SHUFHSWLRQ RI HPRWLRQV LQ

*HUPDQ 7KH HPSLULFDO LQYHVWLJDWLRQ ZDV JXLGHG E\ WKH IRO ORZLQJUHVHDUFKTXHVWLRQV:K\GRREVHUYHUVFRPPXQLFD WLRQ SDUWQHUV SHUFHLYH FHUWDLQ XWWHUDQFHV RI RWKHUV LQ FRQWH[W DVHPRWLRQDO"$UHWKHUHSURVRGLFXQLWVZLWKJHQXLQHHPR WLRQDO PHDQLQJ" ,I VR DUH WKH\ GLVFUHWH RU FRQWLQXRXV XQLWV" +RZGRWKHVHXQLWVLQWHUDFWIRUPDOO\ZLWKSURVRGLFXQLWVWKDW VXSSRUWSULPDU\OLQJXLVWLFIXQFWLRQV"  'DWD

 0HWKRG

7KHFRUSXVXSRQZKLFKP\UHVHDUFKLVEDVHGFRQVLVWVRIILYH GLDORJXHV ZLWK D WRWDO OHQJWK RI  PLQXWHV 7KH FRQYHUVD WLRQV DUH DOO FRQILQHG WR WKH RQH WRSLF LQ ZKLFK SDUWLFLSDQWV FRRSHUDWLYHO\ DVVHPEOH D /HJR FRQVWUXFWLRQ RQH JLYLQJ LQ VWUXFWLRQVWRDQXQVHHQRWKHU 7KHYLVXDOFKDQQHOZDVGHOLE HUDWHO\ H[FOXGHG WR KHOS IRFXV WKH DQDO\VLV  7KH H[SHULPHQW RVWHQVLEO\ FRQFHUQHG WKH RSWLPLVDWLRQ RI YHUEDO LQVWUXFWLRQV 7KURXJK YDULRXV FRQWUROOHG PRGLILFDWLRQV WR WKH VLWXDWLRQ ± PDQLSXODWLRQRIWKH/HJRNLWWKHDPRXQWRIWLPHDOORZHGRU WKH H[SHFWDWLRQ RI VXFFHVV ± LW ZDV SRVVLEOH WR FUHDWH ERWK D SHUIHFWGLVWUDFWLRQIURPWKHDFWXDOJRDORIWKHH[SHULPHQWDQG DVLWXDWLRQLQZKLFKSDUWLFLSDQWVSDLGPLQLPDODWWHQWLRQWRWKH PRQLWRULQJRIVSHHFK FI>@ 7KHFRQYHUVDWLRQVDUHWKXVLQD FDVXDOVW\OHZKLFK/DERYFDOOVWKHYHUQDFXODU FI>@ )XU WKHU DXWKHQWLF HPRWLRQV ZHUH HYRNHG LQ WKH SDUWLFLSDQWV HPRWLRQV WKDW UHVXOWHG VROHO\ IURP WKH LQWHUDFWLRQ DQG QRW IURP H[WUDQHRXV LQIOXHQFHV $V WKH VSHDNHUV ZHUH VHDWHG LQ VHSDUDWH VRXQGSURRI URRPV DQG FRPPXQLFDWHG ZLWK RQH DQ RWKHUYLDPLFURSKRQHDQGKHDGSKRQHVWKH\FRXOGEHUHFRUGHG VHSDUDWHO\RQGLIIHUHQWFKDQQHOVRIDGLJLWDODXGLRWDSH(YHU\ XWWHUDQFH ± LQFOXGLQJ RYHUODSV ± FRXOG WKXV EH SUHFLVHO\ DFRXVWLFDOO\DQDO\VHG  $QDO\VHV 2QWKHEDVLVRIERWKWKHUHFRUGLQJVDQGWUDQVFULSWV JHQHUDWHG DFFRUGLQJ WR D VWDQGDUGLVHG WUDQVFULSWLRQ V\VWHP IRU FRQYHU VDWLRQ DQDO\VLV *$7  FI >@  WKUHH LQGLYLGXDOV LGHQWLILHG WKH HPRWLRQDO XWWHUDQFHV SRLQW RI RFFXUUHQFH DQG HPRWLRQDO TXDOLW\  LQ HDFK RI WKH ILYH FRQYHUVDWLRQV 2QO\ WKRVH XWWHU DQFHV IRU ZKLFK DW OHDVW WZR RI WKH FRQWURO OLVWHQHUV ZHUH DJUHHG RQ WKH FODVVLILFDWLRQ ZHUH LQFOXGHG LQ WKH QH[W VWDJHV RI DQDO\VLV 1R FRQWUDGLFWRU\ FODVVLILFDWLRQV ZHUH UHFRUGHG &RQYHUVDWLRQDQDO\WLFPHWKRGVZHUHWKHQXVHGWRGHVFULEHLQ FRQWH[WWKHXWWHUDQFHV LQVWDQFHVRILQGLYLGXDOHPR WLRQV WKDWSDVVHGWKHLQWHUVXEMHFWLYHILOWHUDQGWKHVRXUFHVRI WKHSHUFHLYHGHPRWLRQVZHUHGHGXFHG)ROORZLQJZKDW,WHUP ³WKH SULQFLSOH RI KROLVWLF SHUFHSWLRQ´ DOO WKH VLJQDOOLQJ V\V WHPV DYDLODEOH WR WKH LQWHUDFWDQWV DQG REVHUYHUV YHUEDO V\V WHPV DQG SURVRG\  SOXV WKH FRQWH[W RI RFFXUUHQFH ZHUH V\V WHPDWLFDOO\ WDNHQ LQWR DFFRXQW +HQFH WKH SURVRG\ RI WKH HPRWLRQDOXWWHUDQFHVZDVDQDO\VHGERWKDXGLWRULO\DQGDFRXV WLFDOO\ ZLWK WKH 3UDDW SURJUDP FI >@  DQG WKH IROORZLQJ DFRXVWLF SDUDPHWHUV ZHUH PHDVXUHG ) PHDQ ) RQVHW )

 5HVXOWV :LWKLQ WKH FRQWH[W RI DQ LQWHUDFWLRQ WKH DWWULEXWLRQ RI HPR WLRQVLVLQWHUVXEMHFWLYHO\FRQVLVWHQW7KHSHUFHSWLRQRIGLVFUHWH HPRWLRQV DV VHPDQWLFDOO\ FRPSOH[ SKHQRPHQD LV EDVHG RQ D FRPELQDWLRQRIDOOWKHVLJQDOOLQJV\VWHPVDYDLODEOHGXULQJWKH FRPPXQLFDWLYH HYHQW LQ FRQWH[W 'LVFUHWH HPRWLRQV DUH WKXV FRPSRVLWHV WKH LQGLYLGXDO VHPDQWLF HOHPHQWV RI ZKLFK DUH WUDQVPLWWHG YLD WKH LQGLYLGXDO VLJQDOOLQJ V\VWHPV VSHHFK SURVRG\ DQG ± LQ RWKHU VLWXDWLRQV ± JHVWXUHV PLPLFU\ DQG RWKHUERG\ODQJXDJH ,WSURYHGSRVVLEOHWRFRQILUPWKHH[LV WHQFHRIHPRWLRQDOGLPHQVLRQVZLGHO\UHFRJQL]HGLQSV\FKRO RJ\DVUHOHYDQWVHPDQWLFFRPSRQHQWV7KHVHLQFOXGHYDOHQFH ZKLFK LQYROYHV WKH LQWULQVLF SOHDVDQWQHVV RU XQSOHDVDQWQHVV RI DQHYHQWRUVLWXDWLRQFI>@>@±,GLVWLQJXLVKEHWZHHQ ³SRVLWLYH´ DQG ³QHJDWLYH´ VHPDQWLF FRPSRQHQWV  DFWLYDWLRQ WKLVGLPHQVLRQFRQFHUQVZKHWKHUDVWLPXOXVSXWVDQRUJDQLVP LQWR D VWDWH RI LQFUHDVHG RU UHGXFHG DFWLYLW\ ± KHUH , GUDZ D GLVWLQFWLRQ EHWZHHQ ³H[FLWHG´ DQG ³FDOP´ VHPDQWLF FRPSR QHQWV  GRPLQDQFH HVVHQWLDOO\ WKLV LQYROYHV ZKHWKHU RU QRW LQGLYLGXDOVFRQVLGHUWKHPVHOYHVDEOHWRGHDOZLWKDSDUWLFXODU VLWXDWLRQ RU FKDQJH DQG LWV FDXVH ± , VHSDUDWH WKH VHPDQWLF FRPSRQHQWVLQWR³VWURQJGRPLQDQW´DQG³ZHDNVXEPLVVLYH´ KHUH DVZHOODVWKH>XQH[SHFWHGH[SHFWHG@TXDOLW\ WKHODWWHU UHFRUGV ZKHWKHU WKH VLWXDWLRQ RU HYHQW WKDW HOLFLWHG WKH HPRWLRQ ZDV VXGGHQ DQG XQH[SHFWHG RU SUHGLFWDEOH FI >@ >@  8QLWV RI WKH VLJQDOOLQJ V\VWHP RI SURVRG\ WUDQVSRUW LQGLYLGXDO VHPDQWLF FRPSRQHQWV RQ DOO RI WKHVH GLPHQVLRQV (PSLULFDO HYLGHQFH IRU WKHVH XQLWV LQ RUGHU RI IXQFWLRQ  PHDQLQJ LVRIIHUHGEHORZ IRUIXUWKHUFRQFUHWHH[DPSOHVVHH >@   >XQH[SHFWHG@ 3URVRGLFDOO\ WKLV VHPDQWLF FRPSRQHQW FDQ EH H[SUHVVHG WKURXJKDFRQWLQXRXVXQLWDUDLVHG)PD[LPXP7KHVWUHQJWK RIWKHVHPDQWLFFRPSRQHQW³XQH[SHFWHG´LVGHSHQGHQWRQWKH GHJUHH WR ZKLFK WKH ) PD[LPXP LV UDLVHG UHODWLYH WR WKH VSHDNHUVSHFLILF UHIHUHQFH YDOXH  7KH UDLVLQJ RI WKH ) PD[LPXPFDQEHLQWKHIRUPRIDVWHHSULVHRURIDQ)MXPS ZLWK D FRUUHVSRQGLQJ DXGLWRU\ VKLIW LQ SLWFK 7KH IROORZLQJ H[DPSOHLOOXVWUDWHVWKHIRUPRIWKLVSURVRGLFXQLW WKHVSHDNHU ZDVSHUFHLYHGWREHVKRFNHGDQGVXUSULVHG 

700 500

300 260

Pitch (Hz)

RIIVHW ) UDQJH ) PD[LPXP ) PLQLPXP DQG V\OODEOHV SHUVHFRQG7KHFULWHULDIRUWKHVHOHFWLRQRIWKHVHSDUDPHWHUV ZHUH   WKHLU SRWHQWLDO UHOHYDQFH LQ WKH OLJKW RI SUHYLRXV VWXGLHV IRU DQ RYHUYLHZ VHH >@  DQG   WKHLU ³WUDQVODWDELO LW\´LQWRDXGLWRU\TXDOLWLHV UHODWLQJDFRXVWLFIHDWXUHVEDFNWR DXGLWRU\TXDOLWLHVLVDSUREOHPLQPDQ\VWXGLHVFI>@>@ ,W ZDVGHFLGHGQRWWRFDOFXODWHDQDYHUDJHLQWHQVLW\VLQFHYDULD WLRQV LQ WKLV SDUDPHWHU FDQ EH WKH UHVXOW RI D QXPEHU RI IDF WRUV HJ WKH GLVWDQFH RI WKH VXEMHFW IURP WKH PLFURSKRQH 6LQFH HDUOLHU LQYHVWLJDWLRQV LQGLFDWH WKDW GHYLDWLRQV IURP D ³QRUPDO´ SURVRG\ DUH SRWHQWLDOO\ UHOHYDQW IRU WKH SHUFHSWLRQ RIHPRWLRQV \HWXVXDOO\EDVHWKLVQRUPRQDVLQJOHHPRWLRQ DOO\ QHXWUDO YDULDQW RI D VWDQGDUG XWWHUDQFH  DQ LQGHSHQGHQW FRUSXV ZDV XVHG KHUH WR FDOFXODWH WKH DYHUDJH YDOXHV IRU WKH DFRXVWLFSDUDPHWHUVPHQWLRQHGDERYHIRUHDFKRIP\WHQVXE MHFWVDQGSURYLGHDEDVLVIRUFRPSDULVRQ

200 173 150 100

.hhh

70 50

äh:

huch 0

ja:

Time (s)

4



)LJXUH$FRXVWLFDQDO\VLVRIXWWHUDQFH0$± 7KHLOOXVWUDWHGXWWHUDQFHKKKKXFKLVWKHVSHDNHU¶V 0$ UH DFWLRQ WR KHU /HJR EULFNV IDOOLQJ RYHU D FRPSOHWHO\ XQH[ SHFWHG HYHQW 7KLV HYRNHV ZKDW SV\FKRORJLVWV UHIHU WR DV D ³VWDUWOHUHDFWLRQ´ FI>@ &RPSDULQJWKH)PD[LPXPDWWKH LQWHUMHFWLRQKXFKZLWKWKHXSSHUKRUL]RQWDOGRWWHGOLQH DYHU DJH ) PD[LPXP IRU 0$  FOHDUO\ VKRZV WKH GHYLDWLRQ IURP WKH UHIHUHQFH YDOXH ,Q WKH FRUSXV WKH SURVRGLF XQLW ORFDOO\ UDLVHG)PD[LPXPLVSUHVHQWLQXWWHUDQFHVLQZKLFKVSHDNHUV DUHSHUFHLYHGDVEHLQJVWDUWOHGVXUSULVHGRUKRUULILHG2WKHU HPRWLRQDO TXDOLWLHV HJ EHLQJ LQFUHGXORXV RU GHOLJKWHG FDQ RFFXUVLPXOWDQHRXVO\  $FWLYDWLRQ H[FLWHG±FDOP  ,Q WHUPV RI SURVRG\ WKH VHPDQWLF FRPSRQHQWV RI HPRWLRQ UHOHYDQW WR WKH DFWLYDWLRQ GLPHQVLRQ OLQNLQJ ³H[FLWHG´ DQG ³FDOP´DUHH[SUHVVHGWKURXJKDFRQWLQXRXVJOREDOXQLWVSHHFK UDWH 7KH IDVWHU WKH SDFH RI VSHHFK LV WKH PRUH H[FLWHG WKH VSHDNHULVSHUFHLYHGWREHWKHVORZHUWKHSDFHWKHPRUHFDOP KHRUVKHLVSHUFHLYHGDVEHLQJ7KHVSHHFKUDWHLVPHDVXUHG LQV\OODEOHVSHUVHFRQGSDXVHVZKLFKPLJKWRFFXUGXULQJWKH XWWHUDQFH DUH GLVUHJDUGHG $FFRUGLQJ WR YDQ %H]RRLMHQ WKLV YDOXH EHVW FRUUHVSRQGV WR WKH DXGLWRU\ LPSUHVVLRQ RI VSHHFK UDWH FI>@ $FOHDULQFUHDVHLQVSHHFKUDWHFDQEHREVHUYHG ZKHUHVSHDNHUVDUHSHUFHLYHGWREHH[FLWHGDJLWDWHGXQFHU WDLQ HDJHU RU DQJU\ 7KH PD[LPXP YDOXH IRXQGLQWKHFRU SXV ZDV IRU DQ XWWHUDQFH LQ ZKLFK WKH VSHDNHU SURGXFHG  V\OODEOHV SHU VHFRQG DOWKRXJK KHU DYHUDJH VSHHFK UDWH ZDV RQO\V\OODEOHVSHUVHFRQG,QFRQWUDVWWRWKLVFRQVSLFXRXV UHGXFWLRQV LQ VSHHFK UDWH FRQWULEXWH WR D SHUFHSWLRQ RI WKH VSHDNHU DV FDOP  UHOD[HG FRQWHQW EXW DOVR DV LUNHG LQ WKH VHQVH RI GHPRWLYDWHG  2QH RI WKH SHDN YDOXHV IRU D VORZ VSHHFK UDWH LQ WKH FRUSXV LV  V\OODEOHV SHU VHFRQG FRP SDUHGWRDVSHDNHUVSHFLILFDYHUDJHRIV\OODEOHV   'RPLQDQFH VWURQJ±ZHDN  (PRWLRQDOVWUHQJWKRUZHDNQHVVFDQEHH[SUHVVHGSURVRGLFDOO\ LQWHUPVRIDJOREDOXQLW,PSOLFDWHGKHUHLVDFOHDUDQGJOREDO LQFUHDVHRUUHGXFWLRQLQWKHSURPLQHQFHRIDV\QWDFWLFSUDJ PDWLFEDVHXQLW7KHDXGLWRU\SURVRGLFIHDWXUHRISURPLQHQFH LVQRWXQSUREOHPDWLFLQSURVRG\VWXGLHVDVLWVDFRXVWLFFRUUH ODWHVKDYHQRW\HWEHHQGHILQLWLYHO\HVWDEOLVKHGIRUHLWKHUORFDO DFFHQWV  RU JOREDO FKDQJHV LQ YROXPH $FFRUGLQJ WR P\ DQDO\VHVWKHUHLVDFRUUHODWLRQEHWZHHQDSHUFHLYHGLQFUHDVH GHFUHDVH LQ SURPLQHQFH DQG D ULVH  IDOO LQ WKH DFRXVWLF SD UDPHWHUV RI ) UDQJH UHODWLYH WR D VSHDNHUVSHFLILF DYHUDJH 

DQG LQWHQVLW\ UHODWLYH WR DGMDFHQW XWWHUDQFHV  7KH IROORZLQJ WZRH[DPSOHVLOOXVWUDWHUHVSHFWLYHO\DQLQFUHDVHDQGDUHGXF WLRQLQWKHJOREDOSURPLQHQFHRIDQXWWHUDQFH 75.11

500

300 255 200

157 150 rechts

70

stan

kon

un

ze

so

zwar

1

det

dass

ee

von

schie zur

ner

ne

dern

an

500 geht

300 5

Time (s)



)LJXUH$FRXVWLFDQDO\VLVRIXWWHUDQFH*(±± ,Q WKLV XWWHUDQFH WKH VSHDNHU ZDV SHUFHLYHG DV HQHUJHWLF FHUWDLQDQGDQJU\DQQR\HG LHDWWULEXWHVZKLFKLQFOXGHWKH VHPDQWLF FRPSRQHQW ³VWURQJ´  ZKLFK LV DWWULEXWDEOH DPRQJ RWKHUWKLQJVWRWKHJOREDOO\HQKDQFHGSURPLQHQFH2IWKHFRQ VWLWXWLYH DFRXVWLF SDUDPHWHUV WKH LQFUHDVH LQ WKH ) UDQJH LV FOHDUO\DSSDUHQWLQWKHILJXUH&RPSDUHGWRWKLVVSHDNHU¶VDY HUDJH)UDQJHRI+] EHWZHHQWKHKRUL]RQWDOGRWWHGOLQHV ZKLFKVKRZWKH)PLQLPXPDQGPD[LPXP WKHUDQJHLVDO PRVWWZLFHDVKLJK +] LQWKHXWWHUDQFHGHSLFWHG*ORE DOO\ HQKDQFHG SURPLQHQFH DOVR IHDWXUHV ZKHQ VSHDNHUV DUH SHUFHLYHGDVGHOLJKWHG 76.1

500 40.16

Intensity (dB)

700

Pitch (Hz)

300 285 200 150 137 100 ver 70 50

das

steh 0



nich

mal

sechs

punk

acht

soll

tn

die

ich

Intensity (relative)

700

100

50

7R GDWH LW KDV EHHQ SRVVLEOH WR GHPRQVWUDWH WKH H[LVWHQFH RI RQH GLVFUHWH ORFDO SURVRGLF XQLW IRU WKH VHPDQWLF FRPSRQHQWV O\LQJ RQWKHYDOHQFHGLPHQVLRQZLWKZKLFKVSHDNHUVFDQH[ SUHVV D SRVLWLYH DWWLWXGH 7KHUH LVFXUUHQWO\QRHYLGHQFHIRUD SURVRGLF XQLW VLJQLI\LQJ D ³QHJDWLYH DWWLWXGH  IHHOLQJ´ 7KH SURVRGLFXQLWWKDWKDVEHHQIRXQGLVDIRUPDOO\FRPSOH[LQWR QDWLRQ SDWWHUQ ZKRVH FRQVWLWXWLYH FKDUDFWHULVWLFV FDQ EH H[ SODLQHGWKURXJKWKHIROORZLQJILJXUH

jetz

Time (s)

4



)LJXUH$FRXVWLFDQDO\VLVRIXWWHUDQFH58± ,Q WKH VHFRQG RI WKH XWWHUDQFHV VKRZQ KHUH WKH GHYLDWLRQ LQ ERWKDFRXVWLFSDUDPHWHUVLVFOHDUO\YLVLEOHERWKWKH)UDQJH DQG WKH LQWHQVLW\ DUH PDUNHGO\ UHGXFHG LQ FRPSDULVRQ WR WKH UHIHUHQFH YDOXHV WKH ) UDQJH RI WKH VHFRQG XWWHUDQFH LV  +]FRPSDUHGWRDQDYHUDJHYDOXHIRUWKLVVSHDNHURI+] WKHGLIIHUHQFHLQLQWHQVLW\EHWZHHQWKHWZRXWWHUDQFHVVKRZQ LVVLPLODUO\HYLGHQW 7KHSURVRG\RIWKHVHFRQGXWWHUDQFHOHG WR WKH VHPDQWLF FRPSRQHQW EHLQJ FRGHG DV ³ZHDN´ DQG WKH VSHDNHU ZDV DFFRUGLQJO\ SHUFHLYHG DV XQFHUWDLQ KHUH 7KLV SURVRGLF XQLW DOVR DFFRPSDQLHV RWKHU SHUFHLYHG HPRWLRQDO TXDOLWLHV ZKLFK FDQ EH DVVLJQHG WR WKH ³ZHDN´ HQG RI WKH GRPLQDQFH GLPHQVLRQ SHUSOH[HG DSRORJHWLF UHVLJQHG IUXV WUDWHGGLVDSSRLQWHG 

Pitch (Hz)

Pitch (Hz)

48.51

Intensity (dB)

700

 9DOHQFH SRVLWLYH±QHJDWLYH 

200 150 100 70 50 0

ge

nau

Time (s)

1.5



)LJXUH$FRXVWLFDQDO\VHVRIXWWHUDQFHV,6± HPRWLRQDOXWWHUDQFHVROLGOLQHV DQG,6± XQHPRWLRQDOXWWHUDQFHGRWWHGOLQHV  7KLVILJXUHGHSLFWVWZRXWWHUDQFHVE\DVLQJOHVSHDNHUZKLFK DUHVHJPHQWDOO\LGHQWLFDOEXWSURVRGLFDOO\GLVWLQFW±WRDFHU WDLQH[WHQWDSURVRGLFPLQLPDOSDLU,QERWKFDVHVJHQDXµH[ DFWO\¶ LV SURGXFHG DV DQ LQGHSHQGHQW V\QWDFWLF  SUDJPDWLF EDVHXQLWZLWKDJOREDOO\IDOOLQJLQWRQDWLRQSDWWHUQ7KHGRWWHG OLQHVVKRZWKHSURVRG\RIDQXQHPRWLRQDOXWWHUDQFHZKLOVWLQ ,6± VROLGOLQHV WKHVSHDNHULVSHUFHLYHGDVGHOLJKWHG,WLV RQWKHVHFRQGV\OODEOHRIWKLVODWWHUXWWHUDQFHWKDWWKHVSHDNHU SURGXFHV WKH GLVFUHWH ORFDO LQWRQDWLRQ SDWWHUQ VLJQLI\LQJ D ³SRVLWLYH DWWLWXGH  IHHOLQJ´ 7KH FRQVWLWXWLYH DFRXVWLF  SUR VRGLF IHDWXUHV RI WKLV LQWRQDWLRQ SDWWHUQ DUH  WHPSRUDO GLOD WLRQ RI WKH V\OODEOH SHUFHLYHG DV VWUHWFKLQJ   DQ ) SHDN FRQWRXU ZLWK D KLJK ) PD[LPXP SHUFHLYHG DV D SHDN LQ SLWFK  DQG  DQ LQWHQVLW\ FRQWRXU UXQQLQJFRXQWHUWRWKDWRI WKH IXQGDPHQWDO IUHTXHQF\ LH D GLS LQ LQWHQVLW\ FRLQFLGHQW ZLWK WKH ) SHDN IROORZHG E\ D UHWXUQ WR D KLJKHU LQWHQVLW\ 7KLV VLQJOH GLVFUHWH SURVRGLF XQLW ZLWK LWV VSHFLILF DQG FRP SOH[ IRUP KDV DOVR EHHQ IRXQG LQ RWKHU VWXGLHV VXFK DV SHU FHSWLRQ H[SHULPHQWV  DQG IRU RWKHU YHUEDO HOHPHQWV ,Q P\ FRUSXV WKH ORFDO LQWRQDWLRQ SDWWHUQ LV DVVRFLDWHG ZLWK WKH PHDQLQJ RI ³SRVLWLYH DWWLWXGH  IHHOLQJ´ RQO\ ZKHQ VSHDNHUV DUHSHUFHLYHGDVGHOLJKWHG,WLVQRQHWKHOHVVQRWD³SURVRG\RI GHOLJKW´ VLQFH LQ WKH RWKHU VWXGLHV PHQWLRQHG WKH LQWRQDWLRQ SDWWHUQFRQWULEXWHVWRWKHH[SUHVVLRQRIVSHDNHUDWWLWXGHVVXFK DV DSSURYDO ³*UHDW´  RU JDVWURQRPLF SOHDVXUH ³'HOL FLRXV´ &RPPRQWRDOORIWKHVHXVHVRIWKHLQWRQDWLRQSDWWHUQ LVWKHIXQGDPHQWDOPHDQLQJRI³SRVLWLYHDWWLWXGHIHHOLQJ´

 &RQFOXVLRQV ,QFRQWH[WSDUWLFXODUDWWLWXGHVIHHOLQJVDUHLPSXWHGWRFRP PXQLFDWLRQ SDUWQHUV DQG REVHUYHG VXEMHFWV ZLWK LQWHUVXEMHF WLYH FRQVWDQF\ :KLOVW HPRWLRQV DUH SHUFHLYHG DV GLVFUHWH SKHQRPHQD WKHLU H[SUHVVLRQ XVXDOO\ LQYROYHV WKH LQWHUDFWLRQ

RI YDULRXV VLJQDOOLQJ V\VWHPV ZKLFK FRPELQH WR FUHDWH VH PDQWLF FRPSRVLWHV 6RPH RI WKHVH LQGLYLGXDO VHPDQWLF FRP SRQHQWVDUHH[SUHVVHGWKURXJKSURVRGLFXQLWV7KLV³FRPSRVL WLRQDO DSSURDFK WR HPRWLRQDO PHDQLQJ´ WKH SDUDOOHO WR WKH ³FRPSRVLWLRQDO DSSURDFK WR WXQH PHDQLQJ´ RI 3LHUUHKXPEHUW DQG +LUVFKEHUJ FI >@  LV GHOLEHUDWH  LV MXVWLILHG E\ WKH IDFW WKDWLQGLYLGXDOSURVRGLFXQLWVFRQWULEXWHWRWKHFRQVWLWXWLRQRI D YDULHW\ RI SHUFHLYHG HPRWLRQV )RU H[DPSOH DQ LQFUHDVHG VSHHFKUDWHLVIRXQGQRWMXVWZKHUHVSHDNHUVDUHSHUFHLYHGWR EH H[FLWHG  DJLWDWHG EXW DOVR ZKHUH WKH HPRWLRQV XQFHUWDLQ DQGDQJU\DUHLPSXWHG7KHGLIIHUHQWLDWLRQEHWZHHQWKHVHSHU FHLYHGFDWHJRULHVLVGHSHQGHQWXSRQERWKWKHFRQFXUUHQWYHU EDO HOHPHQWV DQG WKH FRQWH[W RI WKH LQWHUDFWLRQ 7KH VDPH LV DOVRWUXHRIWKHSURVRGLFXQLWVUHGXFHGVSHHFKUDWH SHUFHLYHG DV FDOP FRQWHQW EXW DOVR DV LUNHG DQG GHPRWLYDWHG  DQG HQ KDQFHGSURPLQHQFH SHUFHLYHGDVDQJU\HQHUJHWLFEXWDOVRDV GHOLJKWHG  DQG H[SODLQV KRZ LQ HPRWLRQDO H[SUHVVLRQ UH VHDUFK WR GDWH WKH VDPH XWWHUDQFHV FRXOG HYHQ EH VLPXOWD QHRXVO\FODVVLILHGDVDQJU\DQGGHOLJKWHGLQGHFRQWH[WXDOL]HG UDWLQJV 0HWKRGRORJLFDOO\ LW WKXV EHFRPHV DSSDUHQW WKDW WKH DVVHVVPHQWRIHPRWLRQVFDQRQO\EHUHOLDEO\GRQHLQFRQWH[W 2QFH WKH UROH RI SURVRG\ LQ WKH FRPPXQLFDWLRQ RI HPR WLRQV KDV EHHQ DGHTXDWHO\ H[SODLQHG WKH FRQWULEXWLRQ RI IXU WKHUYRFDOSDUDPHWHUVRIWKHVSHHFKVLJQDO±WKRVHZKRVHVSH FLILF IRUPV DUH EDVHG RQ LQYROXQWDU\ QHXURSK\VLRORJLFDO FKDQJHV IRU H[DPSOH ± PXVW WKHQ EH V\VWHPDWLFDOO\ LQYHVWL JDWHGIURPWKLVEDVLVLQIXWXUHVWXGLHV

 5HIHUHQFHV >@ %H]RRLMHQ5$0*YDQ&KDUDFWHULVWLFVDQGUHF RJQL]DELOLW\RIYRFDOH[SUHVVLRQVRIHPRWLRQ'RUGUHFKW &LQQDPLQVRQ)RULV >@ %RHUVPD 3 QG 3UDDW 'RLQJ 3KRQHWLFV E\ &RPSXWHU KWWSZZZIRQKXPXYDQOSUDDW! >@ .HKUHLQ 5 LQ SUHVV 3URVRGLH XQG (PRWLRQHQ 7ELQ JHQ1LHPH\HU 5HLKH*HUPDQLVWLVFKH/LQJXLVWLN  >@ /DERY :  7KH 6RFLDO 6WUDWLILFDWLRQ RI (QJOLVK LQ 1HZ @ 6FKHUHU.59RFDO$IIHFW([SUHVVLRQ$5HYLHZ DQGD0RGHOIRU)XWXUH5HVHDUFK3V\FKRORJLFDO%XOOHWLQ   ± >@ 6FKHUHU .5 &HVFKL *  &ULWHULD IRU (PRWLRQ 5HFRJQLWLRQ )URP 9HUEDO DQG 1RQYHUEDO ([SUHVVLRQ 6WXG\LQJ %DJJDJH /RVV LQ WKH $LUSRUW 3HUVRQDOLW\ DQG 6RFLDO3V\FKRORJ\%XOOHWLQ  ± >@ 6FKPLGW -(  %DXVWHLQH GHU ,QWRQDWLRQ" *HUPD QLVWLVFKH /LQJXLVWLN ± 1HXH :HJH GHU ,QWRQD WLRQVIRUVFKXQJ6FKPLGW-(HG ± >@6HOWLQJ0HWDO*HVSUlFKVDQDO\WLVFKHV7UDQVNULS WLRQVV\VWHP *$7 /LQJXLVWLVFKH%HULFKWH± >@=HQWQHU056FKHUHU.53DUWLNXOlUHXQGLQWH JUDWLYH$QVlW]H,Q(PRWLRQVSV\FKRORJLH(LQ+DQGEXFK 2WWR -+ HW DO HGV :HLQKHLP %HOW] 3V\FKRORJLH 9HUODJV8QLRQ±