IYOUIT Matthias Wagner

Size: px

Start display at page:

Download "IYOUIT Matthias Wagner"

Simon Berry
6 years ago
Views:

1 IYOUIT Matthias Wagner Smart & Secure Services RG, DOCOMO Euro-Labs Luxembourg, May 11, 2009 Laboratories Europe GmbH

2 Imagine your phone knows Colleague whom whom you you are are with with where where you you are are your your habits habits and and favorites Family what what the the weather is is like like your your past past Friend Laboratories Europe GmbH 2

the same bus, sharing the same friend Family learns about

3 what intertwines lives Context connects people Same favorite holiday destination, hobbies or habits Waiting for the same bus, sharing the same friend Family learns about your work Colleagues learn about your life Laboratories Europe GmbH 3

0 services Your digital life recorder Facilitating context awareness on

4 Introducing IYOUIT A mobile community service Prototype application to pioneer a digital lifestyle Connected to emerging Web 2.0 services Your digital life recorder Facilitating context awareness on standard phones Integration of key Semantic Web technologies Laboratories Europe GmbH 4

5 Use Cases Real time context sharing Life blogging and widgets Automatic photo & video tagging Laboratories Europe GmbH 5

6 Photo Tagging & Sharing Laboratories Europe GmbH 6

7 Photo Tagging & Sharing Laboratories Europe GmbH 7

8 Smart context activity output privacy control, context model privacy control, context model location inputs Segments my day: acceleration sleep com mute work lunch meet work com mute dine family time club zzz Laboratories Europe GmbH 8

Context Management Framework (CMF) Distributed service infrastructure Heterogeneous data sources Open API Qualitative context abstractions Embedded semantic mappings Applied ontologybased reasoning

9 Context Management Framework (CMF) Distributed service infrastructure Heterogeneous data sources Open API Qualitative context abstractions Embedded semantic mappings Applied ontologybased reasoning Identity Manager Privacy Manager Relation Manager Ontology Manager Context Broker Context Harvester Context Correlator Location Provider Weather Provider Photo Provider Map Provider Component Framework Laboratories Europe GmbH 9

10 Focus 1 Privacy Management & Protection Laboratories Europe GmbH 10

11 Privacy Management Access control to personal data Group directives based on social relationships Buddy specific definitions overwrite group directives Laboratories Europe GmbH 11

Access Control Privacy & access control Different levels of abstraction Based on social relationships and context information Dynamic adaptation of changing service infrastructure No

12 Access Control Privacy & access control Different levels of abstraction Based on social relationships and context information Dynamic adaptation of changing service infrastructure No application-specific dependencies Distributed privacy decision point PrivacyManager ContextProvider(s) IdentityManager Manage directives Evaluate, translate & store directives Retrieve/provide Privacy directives decision point Filter context information Provide data Laboratories Europe GmbH 12

13 Social Networking & Privacy Context Types Privacy Directives Social Network i Family members may know all my context information, except for... i Colleagues may have access to my current location and my business schedule, but only while I m working Laboratories Europe GmbH 13

14 Privacy Management & Protection Open Challenges Manageable privacy policies for the individual Privacy management for the mobile user Auditable information disclosure policies Usage control for context data Device security in the personal sphere Laboratories Europe GmbH 14

15 Focus 2 Semantic Layering & Context Abstraction Laboratories Europe GmbH 15

16 Data Aggregation & Semantics E.g., IYOUIT Place recognition Positioning via GPS and cellular information Data mining to determine places of frequent stay Semantic ontology mapping Place Business Office Fair Cell clustering Ontology mapping Personal places Laboratories Europe GmbH 16

17 Embedded Semantic Technology Classification of weather conditions Situational reasoning Context Representation Event recognition <contextelement> <contextprovideradvertisement id="1092"/> <entity id="1079" name="makomo"/> <observer id="1083" name="basti"/> <param name="weather" time=" t14:37"> <param name="temp" ontref="#very_warm"> <param name="tmin" value="3" accuracy="90"/> <param name="tmax" value="9" accuracy="90"/> </param> contact <param name="location" id="4468" accuracy="65"> <param name="city" familyvalue="munich"/> <param name="country" value="germany"/> </param> colleague partner </param> </contextelement> sibling Social network reasoning associate supervisor spouse sister brother wife Laboratories Europe GmbH 17

(Office) DOCOMO (Office) Casa (Home) Kim (CTO) Basti (Colleague) Demo Office hours

18 Event Recognition Night Day Night TW Partly Sunny Rain Sample Event Very warm TW drive walk walk drive Fürstenfeldbruck Munich Fürstenfeldbruck Casa (Home) DOCOMO (Office) DOCOMO (Office) Casa (Home) Kim (CTO) Basti (Colleague) Demo Office hours Fra (Wife) Fra (Wife) Imp. Meeting Remarkable Working Day Laboratories Europe GmbH 18

19 Semantic Layering & Context Abstraction Open Challenges Complete interpretation of data collected in the personal sphere Attention trails and explanations of social history Context-sensitive social networking w.r.t privacy constraints Selection of the right knowledge representation and reasoning methods Design of manageable domain ontologies Laboratories Europe GmbH 19

20 Focus 3 Distributed Development & Deployment Laboratories Europe GmbH 20

CMF Component Interaction Publish Photo Provider

Manager Find Provider Register CP Context Broker

Context Harvester Harvest Context Event Provider

21 CMF Component Interaction Publish Photo Provider Location Provider Relation Manager Privacy Manager Find Provider Register CP Context Broker Log in Identity Manager Authorize Entities Context Harvester Harvest Context Event Provider Update Presence Weather Provider Laboratories Europe GmbH 21

22 3 rd Party Development ContextProvider Concrete Provider Business Logic Generic Provider CMF Library Infrastructure Data Types Reflections and Annotations Query Engine Mapping CMF Mapping WEB Web Service Tools Object Cache OR Mapper SQL Cache JDBC DBMS Laboratories Europe GmbH 22

23 Distributed Development & Deployment Open Challenges Enforcement of access and usage policies in distributed 3 rd party components Long-time distributed querying over distributed sources Novel data encapsulation paradigms such as streambased data bases Visualization of contextual traces aggregated from multiple sources and devices Laboratories Europe GmbH 23

24 Summary IYOUIT is a fully functional R&D prototype Unique through Context Awareness and CMF Embedded Semantic Technology IYOUIT aims at showcasing Life Logging: Personal Sphere & Communities New ways to communicate Work in progress Basic IYOUIT service & developer connection is public Underlying framework and extensions are open for collaborations Challenges ahead! Laboratories Europe GmbH 24

150+ users 10.000+ visited cities 1.500.

25 Feel free to join! User Community* 60+ visited countries 50+ phone models used users visited cities location measurements Developer connection active *Since its public release in June 2008 Laboratories Europe GmbH

26 Laboratories Europe GmbH 26

27 Laboratories Europe GmbH Backup Slides

28 IYOUIT Mobile Laboratories Europe GmbH 28

29 IYOUIT Web Portal Laboratories Europe GmbH 29

Cell Collectors Incentive: ContextKing Role play that

cell-collecting maniacs Conquer kingdoms based on collected

farmer, create areas of resistance Trade context-sensitive

30 Cell Collectors Incentive: ContextKing Role play that connects the physical and a virtual world Started as game for cell-collecting maniacs Conquer kingdoms based on collected cells Game intelligence through roles & objects Start as a farmer, create areas of resistance Trade context-sensitive virtual objects Recover from natural disasters Laboratories Europe GmbH 30

Ontologies & Reasoning Qualitative Context Ontologies

Integration of different context sources W3C Web Ontology

1) Contextual Reasoning Description Logic reasoning

31 Ontologies & Reasoning Qualitative Context Ontologies Representation of high-level qualitative context Integration of different context sources W3C Web Ontology Language (OWL1.1) Contextual Reasoning Description Logic reasoning Specialized reasoning on events Optimized OWLAPI interface to RacerPro Context Ontology CP Laboratories Europe GmbH 31

Location Provider User location tracking &

Location Provider API Authorized API access for

32 Location Provider User location tracking & reasoning on Places Positioning via GPS and cellular information Data mining to determine places of frequent stay Open programming & Location Provider API Authorized API access for IYOUIT components & 3 rd parties Laboratories Europe GmbH 32

Mapping CMF Mapping WEB Web Service Tools

33 Generic Implementations ContextProvider Concrete Provider Business Logic Generic Provider CMF Library Infrastructure Data Types Reflections and Annotations Query Engine Mapping CMF Mapping WEB Web Service Tools Object Cache OR Mapper SQL Cache JDBC DBMS Laboratories Europe GmbH 33

34 Laboratories Europe GmbH Usage Scenario

A day with IYOUIT Read this story to follow Jason and his family to see how IYOUIT simplifies their life. For a while now Jason is working for this Web2.0 start-up with offices in Paris and Munich.

35 A day with IYOUIT Read this story to follow Jason and his family to see how IYOUIT simplifies their life. For a while now Jason is working for this Web2.0 start-up with offices in Paris and Munich. He lives in Paris together with his wife Kelly and his son Bob. For project and business appointments he goes to Munich on a regular basis. Today is one of those days. 1. After an early flight he arrives at Munich airport, which he visited many times in the past. As he frequently comes here, the airport area had been automatically detected as a frequent place of stay by IYOUIT. 2. In IYOUIT, Places can be assigned a name and meaning. Jason is referring to this place as an airport named MUC. This piece of information automatically becomes part of his personal context as he goes through MUC together with other IYOUIT context items that can be acquired (Locations, Places, Experiences, Photos, Sounds, Observations, Products, Weather and Tags). 3. Through the IYOUIT Buddy list personal context items are shared with others as you go. This way Kelly, with a particular buddy view on family members, can observe Jason s arrival in Munich on her mobile phone. It s good to know that he safely arrived! Laboratories Europe GmbH 35

A day with IYOUIT 4. Jason takes a photo of the nice and modern Munich airport in the rising sun while getting on a taxi. He edits as title Arrival and sets his IYOUIT mood to Relaxed. 5.

36 A day with IYOUIT 4. Jason takes a photo of the nice and modern Munich airport in the rising sun while getting on a taxi. He edits as title Arrival and sets his IYOUIT mood to Relaxed. 5. IYOUIT automatically uploads this picture to Jason s Flickr account and adds all available context information. From the picture and the annotated context it s easy to see that he not only safely arrived, he is also in time, everything is fine and the weather is all right. 6. In fact, Jason is early today and the taxi ride towards his office is ever-so smooth. Jason therefore sends a message to his local project team to tell that he is coming a little earlier. He can swiftly do so via the group SMS function of the IYOUIT buddy list, which automatically groups members according to their current context. 7. His team leader at the Munich office receives this SMS and also sees from the IYOUIT buddy list that all required meetings participants are already present. He re-schedules the meeting to start 30min earlier and again uses the buddy group messaging function to notify all parties. 8. The area of the Munich office is again known to IYOUIT as a frequently visited place of Jason. Upon arrival, a couple of personal settings are automatically switched based on rules that were previously defined by Jason and bound to the office context: the profile of his phone switches to Silent, the connectivity is handed over to the office WLAN and his presence is defined to be Busy. Laboratories Europe GmbH 36

37 A day with IYOUIT 9. This was easy! From the timely start the team took it quick and solved all agenda items by early afternoon. Jason is ready for some shopping in downtown Munich before heading back to Paris. He uses IYOUIT for a quick reflection over a map of Munich with POIs displayed to his preferences. In addition, recommended areas of recent high user activity are highlighted on the map. 10. He manually sets his IYOUIT presence to Leisure, his mood to Relaxed and his availability to Reachable. Remembering the promise to his son he posts a Twitter note that he ll be Shopping for Bob in downtown now. 11. Knowing that his son had recently set his mind on team shirts of local Munich soccer teams, he walks up to one of the merchandizing stores. Jason takes a photo of different shirts available at the shop, sets the picture title and a twit to Let me know which and posts both to Flickr and Twitter. 12. Meanwhile Michael, an old friend who now works downtown, notices via IYOUIT that Jason is around. He drops an SMS What about coffee? which is automatically completed with Michael from Downtown, Munich. 13. It s a nice day and the two of them are sitting outside for coffee. Bob who has been following all his Twitter buddies during the afternoon checks out his daddy s postings and promptly replies The red one!. Laboratories Europe GmbH 37

A day with IYOUIT 14. Thus, after coffee, Jason is ready to buy the right shirt for his son. He also scans its barcode with IYOUIT through the build-in phone camera.

From their home in Paris, after observing Jason s IYOUIT presence during the day, Kelly expected an earlier arrival.

38 A day with IYOUIT 14. Thus, after coffee, Jason is ready to buy the right shirt for his son. He also scans its barcode with IYOUIT through the build-in phone camera. This automatically adds the shirt to his personal context as a recently observed product and creates a Twitter message about it. This way, Bob will notice! 15. From their home in Paris, after observing Jason s IYOUIT presence during the day, Kelly expected an earlier arrival. When she finally sees that Jason is back to MUC and ready to catch the earlier flight she decides to pick him up at the airport. 16. Back at home and later that night, Jason takes some time to put together a short daily post for his Blog. He can do this conveniently through the IYOUIT Web portal. Today, he decides to rather drop business-related data, but adds the trip as such together with summaries of the context data and some contextually annotated photos. 17. Kelly looks over his shoulder: Hey, but that s Michael! When was the last time we met him together?. Finding this out is easy through the IYOUIT Web portal. They simply issue a search on the portal and instantly enjoy some memories of the Munich trip back then that they took together. In fact, when they met Michael, they also sat outside a sidewalk café in downtown Munich, just around the coffee shop that Jason visited today. That s why the place looked so familiar! Laboratories Europe GmbH 38

Chris Skorlinski Microsoft SQL Escalation Services Charlotte, NC

Chris Skorlinski Microsoft SQL Escalation Services Charlotte, NC http://blogs.msdn.com/repltalk One of my favorite shows is CarTalk on Public Radio. Those guys always make me laugh. I enjoy listening to