LingTour.ppt

LingTour Outline Rationale for Lingtour Objectives Lingtour partners Technical developments Application architecture Objectives: 3 scenarios Accessing information: the Virtual Guide Facilitating communication: the Communication Assistant Finding local information: the Orientation Assistant Rationale for Lingtour A more user-friendly assistant Multimedia (text, speech, image, video) Multimodal access (text, speech, pen, visual I/O) Initially targeted for tourist applications Accessing information: the Virtual Guide Convenient and rapid way to access useful information, locally or from a remote server Hotel / restaurant (location/style/pricing), Travel (possibilities/hours/fares), City transportation (routes/time/fares/traffic), Places to go / visit (location/hours/fees/route) Multimodal Combining speech, text, map/image browsing Interactive (dialogues, question refinement) Zoomable User Interfaces (ZUIs) + 2D Control menus Tap and talk Embodied Conversational Agents (ECAs) Facilitating communication: the Communication Assistant Visual display to mediate the dialogue Translation assistant browsable sets of questions / answers focused on useful situations : taxi, hotel, haggling over… browsable lexicon to help communication for speech training thanks to the includes ASR and TTS Access to a remote server / operator for difficult tasks Multimodal Speech + text + sketching Interactive 2D Control menus Tap and talk ECA + TTS for speech and gestural training The Communication Assistant: modes of operation Tourist-to-local communication, or Local-to-tourist communication Speech / text / menu-selected input Menus for refinement / correction of ASR Translation Display and speech synthesis of translation Pronunciation practice From lexicon or virtual guide items Training modules Downloaded from a server situation-specific (hotel, restaurant, taxi…) Finding local information: the Orientation Assistant Collecting input around the device to Help localize the user int