A survey of context-aware applications and systems in use today

818G Justin Wagner

Overview

Apple Siri Case Study

eatures !evelopment "istory Google #ow$ S%erpa$ Gro&r Context 'sed Context #ot 'sed (et Gim)al S!* Anticipatory Computing +ngine

Current Context-Aware Applications

Context-Aware Analysis

uture !evelopment

Comparison to Weiser,s vision

Apple Siri Case Study

Apple Siri

-oice-Activated .ersonal Assistant Allows a user to manage p%one resources

Communication

-oice and /ext

#avigation .lanning

Calendar 0eeting Setup Sports Scores 1estaurant 1eviews

Searc%

Apple Siri

'ses context to respond to re2uests wit% )etter results Context reduces searc% space

Geograp%ic area for navigation and finding attractions is confined Activity %istory is used to reduce information searc% space

Overall$ ena)les easy interaction wit% p%one services

"istory of Siri

0ilitary 'ser Scenario

Commander receives a warning a)out an event All resources availa)le to respond to t%at event are presented

.ersonal Assistant t%at 3earns 4.A35 pro6ect started at S17 7nternational wit% support from !A1.A around 8991 !ata gat%ering and data analysis system !A1.A re2uested an office assistant )ecause of developer familiarity wit% pro)lem

.A3

:7f you told .A3 w%at information you needed$ and it o)served w%at you did wit% t%at information$ it would figure out a more efficient pat% to ac2uiring and sorting relevant information t%e next time around;<

igure couresy of> %ttps>??pal;sri;com?.lone?framewor&?framewor&?arc%ite cture

=uote from> %ttp>??www;wired;com?dangerroom?8911?19?siri-darpa-ip%one?

Siri Commerciali@ation

After !A1.A pro6ect$ S17 loo&ed to commerciali@e t%e product 7dentified as a way to improve mo)ile data usage

Act as an interface for a user to ma&e use of t%e dataintensive services of t%e emerging mo)ile devices 7mproved capa)ilities of mo)ile devices

Several points contri)uted to success

.rocessing .ower G.S and Wi- i for location AG networ& speeds

7mprovements in natural-language processing

7n 8919$ Apple purc%ased Siri

Current Context-Aware Applications

Google #ow

-oice-Activated interface to services

Google -oice Searc%

General searc% #avigation -oice$ text$ and email

1e2uest and manage p%one services manually

Automated Activity 0anagement

1eceive weat%er at %ome and wor& location in morning Get traffic for way to wor& wit% alternate route recommendations .re-fetc% airline )oarding pass Get activity summary for given time period

Google #ow

Automatically maintained connection to ot%er services

Billow> automatic 2uery for property listing )ased on location andango> 1eminder to leave for t%eater given t%at user purc%ased a tic&et

!isplay relevant news articles 1eceive pu)lic alerts

S%erpa

Android App Attempts to predict w%at information a user will need next Anticipates important events )ased on context

3ocation Communication %istory Calendar W%en close to a favorite coffee s%op$ will as& if you want t%e regular and place t%e order

Cool eature

Gro&r

i.%one App .redictive Searc%

As opposed to interface for services$ 2uery services in advance on users )e%alf Software agent

Suggests routes to wor& )ased on traffic conditions S%ows sports scores #otifies a)out upcoming events

Context-Aware Analysis

Context 'tili@ed

3ocation

G.S$ Wi- i location$ and Cell-tower proximity Commercial /ransactions /ransportation style Calendar /ies to location and activity %istory Call and /ext log +mail

'ser Activity and 0ovement

0eeting and sc%edule information

'ser Communication "istory

Context #ot 'tili@ed (et

+xact location wit%in )uildings

3i&ely due to mapping constraints 0ore t%an %alf of all communication is non-ver)al 'ser emotional reaction would )e &ey to user preferences

'ser p%ysical gestures and non-ver)al cues

Conversation context

uture !evelopment

Gim)al S!*

Context-Aware S!* developed )y =ualcomm .rovides context-aware development framewor& for mo)ile platform

0easurement of user activity and application usage 3ocation and movement trac&ing .us% notification to specific users .rivacy framewor&

Anticipatory Computing +ngine

!etermine context of a user,s conversation !isplay information relevant to t%e conversation #ext step is ma&ing decisions )ased on conversational context .otential downsides are privacy concerns and tec%nology t%at is intrusive

Comparison to Weiser,s -ision

Comparison

Connection to ot%er devices

Wireless connection to printers and ot%er computer perip%erals 1estaurant ordering$ flig%t reminders$ movies purc%ases$ etc;

!eep connection to external services

#ot as muc% control over p%ysical environment as envisioned

+nvironmental control of lig%ts and temperature

1eferences

%ttp>??www;google;com?landing?now? %ttp>??www;itworld;com?mo)ile-wireless?88CA99?explainer-w%at-googlenow-actually-does %ttp>??www;apple;com?ios?siri? %ttp>??www;newscientist;com?article?mg81888ADE;A99-%ow-innovativeis-apples-new-voice-assistant-siri;%tml %ttp>??www;xconomy;com?san-francisco?8919?9D?1F?t%e-story-of-sirifrom-)irt%-at-sri-to-ac2uisition-)y-apple-virtual-personal-assistants-gomo)ile?GsingleHpageItrue %ttp>??www;@dnet;com?psyc%ic-siri-tec%-gets-cas%-in6ection-fromsamsung-intel-telefonica-J99991FJFC?

%ttps>??developer;2ualcomm;com?mo)ile-development?mo)ile-tec%nologies?co