ACCESS MULTILINGUAL INFORMATION OPINIONS - AMIS 1
2
3
LORIA ,1 AGH ,2 DEUSTO AND LIA 3 F RANCE -
I NTRODUCTION
E XTRACTING THE MAIN IDEA
• AMIS is a Human Language Understanding: Grounding Language Learning
– France: University of Lorraine (LORIA), University of Avignon (LIA)
M AIN OBJECTIVES Two major goals: • Understanding the main idea of a foreign language video by summarizing the video input • Comparing the opinions of two videos in two different languages using their summaries
D ETAILED OBJECTIVES • The goal is to propose a multilingual help understanding system language independent and without any human being intervention. • How to allow the information presented in a foreign language to be accessible and easy to understand by everyone? • Accessing to information in foreign languages would permit to discover the other side of a story • Due to political, socio-cultural or religion reasons, divergence of opinions may exist within two medias from two different sources. • The purpose of AMIS is to work on the summary of a media: video, audio or text
A RCHITECTURE
Tahrir Square after the movement of controversial images on social networks
Q UESTIONNAIRE • The objective of this questionnaire is to get feedback from potential end-users of solutions elaborated in the project. • The questionnaire is anonymous, the requested information will only be used for research purposes.
Between security forces and protesters in Cairo’s
– Poland: University of Science and Technology Krakòw (AGH)
• Starting date: December 2015
S PAIN
á á Ï ú ¯ j . JjÜ @ð áÓ B@ H@ñ¯ K. P ñ É® J K Yª K. èQë A®ËAK . QK Q jJË@ à@ YJ Ó Q ú « AÒJ k. B @ É@ñJË@ éºJ. úΫ È Yj.ÊË è J Ó
• The consortium is composed of partners from three countries:
– Spain: University of DEUSTO (Bilbao)
P OLAND -
1
• A pipeline system: Video summarization, Overlaid Text Extraction, Speech Recognition, Machine Translation, Speech synthesis
C ROSS - LINGUAL OPINION STUDY
• 100 people from different countries and of different ages completed the questionnaire
S TATISTICS
• Let V1 a video in language A • Let V2 a video in language B concerning the same topic • V1 is summarized into a language B to achieve V1s • V2 is summarized to achieve V2s •
V1s
V2s
and are compared in terms of opinions (objectivity, polarity, anger, sadness, joy, disgust, fear and surprise)
• A parallel system: 1. Speech recognition and summarization of text 2. Video summarization
Application A press review but in terms of opinions. This is useful when there is a difference in terms of culture, foreign policy, religion, etc.
• Fusion of media information to get a well summarized video
E XAMPLE
• Supported Languages: Arabic, English and French • 100 hours per language and other necessary data • Two types of TV programs: Newscast and Reports • The potential TV channels: BBC, Euronews, France24, Aljazeera, Russian TV • Topics for Cross-Lingual Opinion Study:
D ATA
– – – –
War in Syria Real Madrid – FC Barcelona (football) Women’s rights Taboo subjects (same-sex marriage, drug liberalization)
C ONTRIBUTION OF PARTNERS
C ONTACT I NFORMATION LORIA
[email protected] AGH
[email protected] DEUSTO
[email protected] LIA
[email protected] http://deustotechlife.deusto.es/amis
