自然用户界面.ppt

TowardsaNaturalUserInterface

Kai-FuLeeCorporateVicePresidentNaturalInteractiveServicesDivisionMicrosoftCorporation

TalkOutlineTheNUIrevolutionThevision.Theingredientsandtechnologies.5challengestogettingNUIstarted10stepstoovercomechallengesConclusion

Graphical

UserInterfaceUserInterfaceEvolutionCommandline1985PC1990GUIMultipleWindowsMenus1995InternetHyperlinksSearchEngines

UserInterfaceEvolution

GraphicalUserInterfaceGUIInteraction

Useristheexpertand?knowsWhatfunctionsexistWheretogoWhattoclick(andinwhatorder)WhattotypeGUITechnology

DirectmanipulationMouse/keyboardinputMouseinputmappedtoWindows,menus,etc.Keyboardinput(search)mappedtotextindexEnables

Graphical

UserInterfaceNatural

UserInterfaceUserInterfaceEvolutionCommandline1985PC1990GUIMultipleWindowsMenus1995InternetHyperlinksSearchEnginesXML

WebServicenyplace,Anytime,AnydeviceNaturalLanguageMultimodal(speech,ink…)PersonalAssistant

NUI–“DoWhatIMean”UIUsersnaturallyarticulatewhattheymean,onanydevice,toanyapplicationorwebservice,andhavetheirintentioninterpretedandexecutedaccurately.WhyNUI?Expressive.Natural.Scalable.

NaturalUserInterface

Motivatedbyhuman-humaninteraction“WhoknowsabouttravelingtoChicago?”Books,magazines,other?libraries…Presentchoices“InformationaboutChicago”“Chicagothecity,collegeormusicgroup?”“City”“Historyortravelinformation?”“Travel”InteractingwithaLibrarian

Userasksnaturally

“Findinformationabout?Chicago”NUITechnologyNaturalUserInterface(NUI)TextNUITechnologyHearwhatyousayTyped,spoken,written2. Knowwhatyoumean

Analyzetext

ConsidercontextClarifyusingdialog

3. Dowhatyouwant

Brokerandexecuteby

findingcontent/servicesUsersays/types:“Informationabout?Chicago”“Iwanttotravelto?Chicago”“BookmyflighttoChicagousing?Expedia”EnablesNUIInteraction

NUI:HearWhatYouSayTextNUITech