ISCA Special Session: Hot Topics in Speech Synthesis - Speech data

9 downloads 0 Views 81KB Size Report
Institut de la Communication Parlee, INPG/Universite stendhal, Grenoble, France ... Institute of Natural Language Processing, University of stuttgart, Germany.
,6&$6SHFLDO6HVVLRQ+RW7RSLFVLQ6SHHFK6\QWKHVLV *HUDUG%DLOO\1LFN&DPSEHOO DQG%HUQG0RELXV

 ,QVWLWXWGHOD&RPPXQLFDWLRQ3DUOHH,13*8QLYHUVLWH6WHQGKDO*UHQREOH)UDQFH

$75+XPDQ,QIRUPDWLRQ6FLHQFH/DEV.HLKDQQD6FLHQFH&LW\.\RWR-DSDQ

,QVWLWXWHRI1DWXUDO/DQJXDJH3URFHVVLQJ8QLYHUVLW\RI6WXWWJDUW*HUPDQ\

EDLOO\#LFSLQSJIUQLFN#DWUFRMSEHUQGPRELXV#LPVXQLVWXWWJDUWGH  WKH LGHD RI SKRQHDVHQWHUWDLQPHQW  ZDV SUREDEO\ QHYHU $EVWUDFW VHULRXVO\FRQVLGHUHGDVDQDFWLYHUHVHDUFKDUHD :KDWDUHWKH+RW7RSLFVIRUVSHHFKV\QWKHVLV"+RZZLOOWKH\ 7KHJRDORIWKLVSDSHUDQGRI6\Q6,*LVWRTXHVWLRQVRPHRI GLIIHU LQ \HDUV WLPH" ,6&$¶V 6\Q6,* SUHVHQWV D IHZ WKH IXQGDPHQWDOV RI VSHHFK V\QWKHVLV VR WKDW ZH PLJKW VXJJHVWLRQV7KLVSDSHUDWWHPSWVWRLGHQWLI\WKHWRS ILYH KRW EHFRPHPRUHDEOHWRPDNHWKHLPDJLQDWLYHMXPSVUHTXLUHGWR WRSLFVEDVHGQRWRQDQDQDO\VLVRIZKDWLVEHLQJSUHVHQWHGDW DQWLFLSDWH VRPH RI WKH IXWXUH VXUSULVHV  7HQ \HDUV DJR IRU FXUUHQWZRUNVKRSVDQGFRQIHUHQFHVEXWUDWKHURQDQDQDO\VLV H[DPSOHLWZDVFRQVLGHUHGXQWKLQNDEOHWRXVHUDZZDYHIRUP RI ZKDW LV 127  ,W ZLOO EH DFFRPSDQLHG E\ UHVXOWV IURP D LQ DQ\ EXW WKH PRVW SULPLWLYH RI VWDWLRQDQQRXQFHPHQW W\SH TXHVWLRQQDLUHSROOLQJ6\Q6,*PHPEHUV¶YLHZVDQGRSLQLRQV V\QWKHVLVV\VWHPV1RZWKHOHDGLQJSURGXFHUVDUHDOO JRLQJ FRQFDWHQDWLYH %XWGRHVWKLVPHDQWKDWZHPXVWWKURZDZD\  ,QWURGXFWLRQ DOOWKHROGWKLQNLQJWRMXPSRQWKHFRQFDWHQDWLYHEDQGZDJRQ" ,Q D UHFHQW LVVXH RI WKH ,((( PDJD]LQH 6SHFWUXP >@ WKHUH 3HUKDSV QRW  7KHUH LV VWLOO IRU H[DPSOH PXFK QHHG IRU DQ ZDV DQ DUWLFOH E\ 5 : /XFN\ HQWLWOHG :KDW ZHUH ZH XQGHUVWDQGLQJRIWKHDUWLFXODWRU\V\VWHPVWKRXJKQRWSHUKDSV WKLQNLQJ" LQ ZKLFK WKH DXWKRU TXHVWLRQHG WKH SUHYDLOLQJ LQ WKH ZD\ WKDW WKH RULJLQDO UHVHDUFKHUV RI WKRVH WHFKQLTXHV PRGHOV RI WKRXJKW ZKLFK OHG WR WKH GHVLJQ RI VRPH PDMRU DQWLFLSDWHG WHFKQRORJLHV2QHH[DPSOHZDV YLGHRRQGHPDQG DQRWKHU :KDW RWKHU IRUPV RI NQRZOHGJH PLJKW ZH EH OHDYLQJ WKHPDLQIUDPH FRPSXWHU  ,Q WKH OLJKW RI SUHVHQW NQRZOHGJH XQH[SORLWHG":KDWDVSHFWVRIVSHHFKV\QWKHVLVGRZHWDNHIRU KHDUJXHVWKDWERWKZHUHPLVJXLGHGEHFDXVHWKH\ZHUHEDVHG JUDQWHG DV XQFKDQJHDEOH" *LYHQ WKH UDSLG UDWH RI FKDQJH RI XSRQSULQFLSOHVKHOGWREHIXQGDPHQWDODWWKHWLPHEXWZKLFK WKHWHFKQRORJ\LWZRXOGEHIRROLVKWRDWWHPSWWRSUHGLFWZKDW ZHUHODWHUUHSODFHGE\XQIRUHVHHQWHFKQRORJLFDOGHYHORSPHQWV V\QWKHVLVUHVHDUFKZLOOEHOLNHLQWHQ\HDUVIURPQRZ,QVWHDG 7KH NH\ FRQFHSW RI YLGHRRQGHPDQG ZDV WKH FHQWUDO VHUYHU ZHZLOOOLPLWRXUVSHFXODWLRQWRDILYH\HDUWLPHIUDPH:KDW ZKLFK SURYLGHG DOO WKH LQIRUPDWLRQ DQG ZKLFK ZRXOG EH SUHGLFWLRQVFDQZHPDNHDERXWWKHNH\UHVHDUFKLVVXHVIRUWKH PDQDJHGE\WKHUHVRXUFHKROGHU7KLVEHFDPHUHGXQGDQWZLWK \HDU" WKH JURZWK RI WKH LQWHUQHW DQG LWV GLVWULEXWHG NQRZOHGJH :HZLOOSUHVHQWVRPHPRUHFRPSOHWHDQVZHUVWRWKDWTXHVWLRQ VRXUFHVWKDWFRXOGUHDGLO\EHDFFHVVHGE\WKHLQGLYLGXDOXVHUV LQWKHRUDOSUHVHQWDWLRQRIWKLVSDSHUDWWKH,6&$+RW7RSLFV ZLWKRXW DQ\ FHQWUDO FRQWURO  7KH PDLQIUDPH FRPSXWHU 6SHFLDO 6HVVLRQ EDVHG RQ WKH UHVXOWV RI D TXHVWLRQQDLUH VLPLODUO\ ZDV UHSODFHG E\ D KRVW RI SHUVRQDO FRPSXWHUV LQ D FLUFXODWHG DPRQJ VSHHFK V\QWKHVLV UHVHDUFKHUV DQG 6\Q6,* SURFHVV WKDW ZDV DOPRVW FRPSOHWHO\ XQDQWLFLSDWHG E\ WKH PHPEHUV  $W WKH ULVN RI EHLQJ SURYHQ LPPHGLDWHO\ ZURQJ PDMRU FRPSDQLHV  7KH SUHYDLOLQJ ORJLF  ZDV WKDW VXFK DQGDVDSUHOLPLQDU\WRWKDWTXHVWLRQQDLUHZHSUHVHQWKHUHDV GLVWULEXWHG FRPSXWLQJ ZDV ZDVWHIXO RI UHVRXUFHV  DQG DQH[DPSOHVRPHRIRXURZQWKRXJKWVDERXWWKHFXUUHQWVWDWH

LQHIILFLHQW 7KHDUWLFOHFRQFOXGHGZLWKDTXHVWLRQ:KDWZLOO RIWKHVSHHFKV\QWKHVLVDUWDQGVRPHVSHFXODWLRQVRQKRZ LW SHRSOH WZHQW\ \HDUV IURP QRZ EH ORRNLQJ EDFN RQ ZLWK PD\HYROYHLQWKHFRPLQJ\HDUV DPXVHPHQW"  :KDW DVSHFWV RI WKH WHFKQRORJ\ GR ZH WDNH VR PXFKIRUJUDQWHGWKDWWKH\DUHEOLQGLQJXVIURPDYLVLRQRIWKH ZD\IRUZDUG"

$ UHFXUULQJ WKHPH LQ WKH DUWLFOH LV WKDW RI FHQWUDOLVDWLRQ  ZKLFK LV FRQWUDVWHG ZLWK GLVWULEXWHG XVHUHPSRZHUHG VROXWLRQV LH KRZ WR DYRLG RU DW OHDVW UHFRJQLVH WKH PRQROLWKLF FRQFHSWV ZKLFK IRU WKH HQJLQHHUV RI WKH WLPH VHHPHG VR EDVLF DQG IXQGDPHQWDO WKDW WKH\ FRXOG QR ORQJHU VHH WKH ZRRG IRU WKH WUHHV   ,Q WKH DUHD RI WHOHSKRQ\ IRU H[DPSOH WKH SUHGRPLQDQW WKLQNLQJ ZDV RI EXVLQHVV XVH +HQFH WKH DGKHUHQFH WR ZLUH DQG D IDLOXUH LQ PDQ\ SDUWV RI WKH LQGXVWU\ WR DQWLFLSDWH WKH GHYHORSPHQW RI SHUVRQDO WHOHSKRQHVZLWKVRPXFKFRPSXWLQJSRZHUDQGDGGRQVVXFK DV FDPHUDV DQG IODVK PHPRU\ WKDW KDYH UHFHQWO\ EHFRPH VR

LQGLVSHQVDEOH 7KHUHZDVQRFRQFHSWDWWKHWLPHRIDSKRQH WKDWFRXOGDOVREHDFRPSXWHURUDFRPSXWHUWKDWFRXOG DOVR EH D SKRQH WKRXJK LQ UHWURVSHFW WKH HYROXWLRQDO PHUJLQJ RI WKHVHWHFKQRORJLHVVHHPVERWKREYLRXVDQGQDWXUDO+RZHYHU

 $EULHIKLVWRU\RI,6&$ V6\Q6,* 7KH ,QWHUQDWLRQDO 6SHHFK &RPPXQLFDWLRQ $VVRFLDWLRQ >@ ,6&$  PDLQWDLQV D FRUH RI VSHFLDO LQWHUHVW JURXSV 6,*V  WR HQFRXUDJHLQWHUHVWDQGDFWLYLW\LQVSHFLILFDUHDVRIUHVHDUFKE\ PHDQV RI VSHFLDOLVW ZRUNVKRSV VSHFLDO FRQIHUHQFH VHVVLRQV GHGLFDWHGZHESDJHVGLVFXVVLRQDQGPDLOLQJOLVWV7KH6,*V DUH UHTXLUHG WR PDNH DYDLODEOH WR WKH PHPEHUV DQG WR ,6&$ WH[W DQG VSHHFK FRUSRUD DQDO\VLV WRROV DQDO\VLV DQG JHQHUDWLRQVRIWZDUHUHVHDUFKSDSHUVDQGJHQHUDWHGGDWD 7KH6SHFLDO,QWHUHVW*URXSRQ6SHHFK6\QWKHVLV 6\Q6,*>@  ZDV WKH ILUVW ,6&$ 6,* IRXQGHG LQ  DQG DULVLQJ IURP DFWLYLWLHV RI WKH &2&26'$ :RUNLQJ *URXS RQ 6SHHFK 6\QWKHVLV IRUPHG LQ  DW WKH &KDYLDUL &2&26'$ PHHWLQJ DIWHU (XURVSHHFK LQ QRUWKHUQ ,WDO\ 6\Q6,* ZDV MRLQHGVKRUWO\DIWHUZDUGVE\$9,6$>@DQ,6&$6,*ZKLFK

IRFXVHV RQ WKH FORVHO\UHODWHG DUHD RI DXGLRYLVXDO VSHHFK SURFHVVLQJ 7KHSULPDU\JRDOVRI6\Q6,*DUHWRLGHQWLI\WKHXVHUQHHGVRI HDFK FRPPXQLW\ DQG WR SURYLGH HGXFDWLRQ UHVRXUFHV UHIHUHQFHPDWHULDOVDQGWUDLQLQJVRWKDWWKHVFLHQFHRIVSHHFK V\QWKHVLVFDQEHHQFRXUDJHGWRGHYHORSLQGLUHFWLRQVWKDWZHUH QRW SUHYLRXVO\ DQWLFLSDWHG  7KH NH\ HQJLQHHULQJ LVVXHV PD\ DOUHDG\EHEHLQJWDFNOHGE\WKHPDQXIDFWXUHUVEXWLQWLPHVRI LQFUHDVLQJ SUHVVXUH RQ UHVHDUFK IXQGLQJ LW LV WKH GXW\ RI YROXQWHHU JURXSV WR SURYLGH WKH HQHUJ\ IRU PRUH EDVLF IXQGDPHQWDOUHVHDUFKDQGIRUWKHLQWHJUDWLRQRIWHFKQRORJLHV WKDWPD\RWKHUZLVHEHVHHQDVXQUHODWHG 7KH ILUVW LQWHUQDWLRQDO UHVHDUFK ZRUNVKRS UHODWHG WR 6\Q6,* DFWLYLWLHV ZDV WKH 6SHHFK ,QSXW2XWSXW $VVHVVPHQW DQG 6SHHFK 'DWDEDVHV 5HVHDUFK :RUNVKRS KHOG LQ  DW 1RRUGZLMNHUKRXWLQWKH1HWKHUODQGVXQGHUWKHRUJDQLVDWLRQRI 3URI /&:3ROV  7KLV IRUPHG WKH LPSHWXV IRU &2&26'$ WKH ,QWHUQDWLRQDO &RRUGLQDWLQJ &RPPLWWHH IRU 6SHHFK ,QSXW2XWSXW'DWDEDVHVDQG(YDOXDWLRQZKLFKDIWHUDQLQLWLDO PHHWLQJLQ.REH IROORZLQJ,&6/3 ZDVIRUPDOO\LQLWLDWHG DW WKH &KDYLDUL PHHWLQJ PHQWLRQHG DERYH  7KH 6\QWKHVLV 5HFRJQLWLRQ DQG &RUSRUD ZRUNLQJ JURXSV FRQYHQHG IRU WKH ILUVW WLPH DW WKH &2&26'$ PHHWLQJ IROORZLQJ WKH %DQII ,&6/3LQ 7KH ILUVW (6&$ 6SHHFK 6\QWKHVLV :RUNVKRS  ZDV KHOG LQ $XWUDQV )UDQFH LQ 6HSWHPEHU  KRVWHG E\ %HQRLW DQG %DLOO\ DQG ZDV DWWHQGHG E\ PRUH WKDQ  UHVHDUFKHUV IURP DURXQGWKHZRUOG7KH QG6SHHFK6\QWKHVLV:RUNVKRS ZDV KHOGIRXU\HDUVODWHUDWWKH0RKRQN0RXQWDLQ+RXVHLQ1HZ 3DOW]1@ /XFN\ 5 : :KDW ZHUH ZH WKLQNLQJ" S ,((( 6SHFWUXP5HIOHFWLRQV0D\ >@,6&$ZZZLVFDVSHHFKRUJ >@6\Q6,*ZZZVOWDWUFRMSFRFRVGDV\QVLJ ZLOOFKDQJH  >@$9,6$ZZZXZVHGXDXPDUFV$9,6$ >@&2&26'$ZZZFRFRVGDRUJ >@$75ZZZDWUFRMS >@/'&ZZZOGFXSHQQHGX >@5D\PRQG(67KH&DWKHGUDODQGWKH%D]DDU2 5HLOO\