International Journal of Advance Research, IJOAR.org ISSN xxxx-xxxx

Transcription

1 Paper-Link: Physical Notes of Digital World Ajinkya C. Choudhary,BhushanLende, ShrutiShrivastav Bapurao Deshmukh College of Engineering Sevagram MS INDIA KeyWords sticky notes, cloud computing, qr codes, cross platform synchronisation. ABSTRACT The digital information retrieval in today s digital world become device centric activity. Users are bound to devices even though the synchronization in mobile and desktop applications. In the last few years the advancement and development in these mobile and desktop technologies have brought information synchronization at remote location or we often call it cloud storage. In this paper we present Paper- Link Physical notes of digital world, a system for storing, searching and sharing digital information using physical 3M Post-it Notes. It allows people to use physical Post-It notes to instantly capture the moment of interaction with digital information, embed the information with digital object and later retrieve the same or share it with other people. Paper-Link uses embedded Quick-Response code (QR-code) on Post-It note to link digital information with physical Post-It notes providing Paper-Link augmented reality.

2 1. INTRODUCTION The world is rapidly growing with digital gadgets every day and therefore digital information retrieval become device centric activity. Even through these rapid developments in digital world there exist peoples who are not much tech savvy. So there always been a gap between digital and physical world. Developers and researchers are trying to bridge these gaps. In simplest every day activity there is huge difference between buying something online rather than visiting shop itself. Since the introduction of 3M s Post-It notes (1980)[1][2], these sticky notes become an important part of life. Sticky notes help us keeping track of all sort of information. They help us to write reminders, TO-DO list, business meetings, summary of documents, things to buy etc. In short these Post-It notes are everywhere in our day-to-day life. Unlike other modern digital information devices in today s era, Post-It notes are very portable, handy, easy to use and low cost. Figure 1 shows Physical Post-It note in every day use. The Post-It notes links every day task and information together and provides them in contextual manner. Barcodes are fastest, accurate and easiest way for automatic data entry[3]. They enable us keep track of products efficiently and accurately with speed not possible by using manual data entry. However two dimensional barcode readers only be used for such advantages which are expensive. The mobile phone with camera are getting more popular today. Computer vision techniques can be used to recognise barcode in inexpensive way. However damaged barcode cannot recover encoded information in case of computer vision technique and encoded information is lost. In parallel QR-Code (Quick Response Code) is developed in Japan by Denso Corporation in 1994 and sooner it is recognised as standard [3][4][5].These QR-Code are widely used in automatic identification fields. The QR-code can be arbitrary size and carries more information than two dimensional barcodes. Also they are designed in such a manner that damaged QR-code can be completely recovered with 30\% error correction capability [5]. Research states that maximum time required to recognize QR-Code with computer vision technique is 80ms~100ms. Figure 2 shows the Quick Response Code. Fig 1. Regular Post-It Sticky Notes Fig 2. QR-Code In this paper we present a novel approach of using Physical Post-It note with digital information called as Paper-Link Physical Note of Digital World; based on computer vision and embedded Quick Response code (QR-Code) on Post-It note. Paper-Link is a collaborative augmented reality which can be used with desktop or notebook computers and on the go with mobile smartphones. 2. RELATED WORK Developers and researchers have been into the full fillment of gap between physical and digital world. Efforts have been taken to bridge this gap, where a Post-it notes are used in both virtual and physical manner. These efforts are as follows: A. VIRTUAL POST-IT NOTES There exist many solutions of virtual Post-It notes for desktop and mobile platforms such Evernote, Microsoft one note, Google Docs, etc. These applications are more competent solutions that allows many types of data to share between mobile and desktop devices. These applications are massively adopted by the users around the globe. Evernote [6] is a mobile application designed for smartphones like android, apple IOS, blackberry etc. It uses virtual Post-it notes for general to-do list scheduled task reminders. These virtual notes could be a formatted text, webpages, photographs, audible messages or a file as an attachment. The information can be synchronised over a different devices and can be retrieved with the help of clouds.

3 Microsoft One Note[7] is a shareware software by Microsoft available for desktop and mobile platforms. Application allows to create tables, insert pictures, informative text on virtual Post-It notes. It offers collaborative workspace for multi-users working on different devices. It also gathers handwritten notes or drawing and clipboards. One note pages can be arbitrary large, the images can be inserted without quality loss. Google Docs[8] is freeware web-based office suite with cloud storage of up to 15 GB. The features can be accessed from modern browser with JavaScript support that we use today such as: Internet Explorer, Mozilla Firefox, Google Chrome, and Opera etc. Google Docs application is also available for smartphones like Android and Apple IPhone. The application can be used on the go and synchronised with Google Drive account. B. WEBSTICKERS WebStickers [9] is physical bookmark of the internet URL s. It uses physical Post-It notes with pre-embedded barcodes. These barcodes are read by electronics device called as barcode readers. The websites URL s are associated with the barcodes embedded on Post-It notes. When barcodes are rescanned the webpage linked with it can be retrieved on different computers. Therefore WebStickers acts as physical Session retrieving key independent of devices. C. QUIKIES Quickies is the remarkable project of Pranav Mistry[10]; bridges the gap between physical and digital world. Quickies is composed of digital pen embedded with camera, RFID tags, RFID reader and physical Post-It notes. The digital pen is used to write context on Post-It note, the information is simultaneously captured and handwritten text is converted into digital text. This information is stored in personal computer. With the help of computer vision, patterns and handwritings are recognised. The information is then categorised and can be scheduled for reminders in the form of desktop notification, mobile SMS and s. Quickies project is based on people s general behaviour of using physical Post-It notes. 3. PAPER-LINK A. WHAT IS PAPER-LINK? Paper-Link is cross platform application based on existing people s behaviour of using physical Post-It notes in there day to day life. The purpose of Paper-Link is to eliminate the gap between the physical world and digital world. The people who are not much familiar with technical stuff should interact with their existing behaviour of interacting physical world and collaborating digital world within it. Paper-Link uses physical Post-It notes with embedded Quick Response Code (QR-code) for tagging digital information. This information is synchronised with centralized cloud storage. The cloud storage is available to all those authenticated users who are using Paper-Link with their devices. A user can simply scan the Paper-Link Post-it notes with QR code embedded on it. Upon scanning a message on Post-it notes become a tag for digital information containing a state of work. When the use is on the go, he may not have his physical Post-it note, however information stored through scanning the Post-it notes can be retrieved from the cloud. Even a mobile phone application based on android platform can access all the information anywhere anytime. Fig 1. Paper-Link Post-It Note B. TECHNICAL DESCRIPTION

4 Paper-Link uses physical Post-It note with embedded QR-code in it. The system is built around Windows and Android platform. The software incorporates Visual C++ programming language[11] for desktop application with modified Zbar library[12] for QR- Code reorganisation and opencv 2 API image processing library[13]. On the mobile platform Android Developer Tools (ADT SDK) Eclipse IDE [14][15] is used with ZXing library[16] for QR-code detection. We used Apache s web-server[17] and MySQL open source database engine[18] for cloud communication. Textual data is transferred as JSON (Java Script Object Notation) object with the help of PHP[19] server side scripting to Paper-Link android app. Fig 2. Prototype of Paper-Link C. HOW IT WORKS? Figure 4 shows the prototype of Paper-Link system. The system uses physical sticky notes with QR code printed on it. In desktop environment, the user can use a physical sticky note to store the current state of work. User can use a pen to write a short message on the note which may act as tag and QR-code as token, and at the moment of scanning, the digital information is attached to the note. Scanning is done using the camera attached to the computer, which is constantly activated as waiting for a QR code to be scanned. When the code is scanned, the application capture a full sensory view of the computer, takes screenshot, records the URLs of the open tabs of the Internet browser, and records a sound message and the image seen through the camera if any. The same note can be used to restore current state of work, browser tabs, or listen to voice messages on the go with smart phones or in different workspace by simply rescanning. 4. USAGE SCENARIO Paper-Link can be used in day-to-day life. Some of the work scenario of using Paper-Link is as follows: Fig 3. Paper-Link in use 1. Group of colleagues want to design a project. And they want to work simultaneously on the same project. Then each of them

5 can store their state of work at the cloud by scanning sticky notes and paste it there, so next person who want to work further can overview the earlier work or retrieve earlier work by simply scanning the same note. 2. You have important message to deliver which is not feasible just by writing but rather you would like to deliver in your own voice for some reasons. You scan the note record your voice message and the voice message for whom it is, may rescan the note and retrieve it from cloud. 3. Ajinkya saw a camera on flipkart.com, he wrote a note on Post-It note and Linked page URL with Paper-Link on his notebook computer. He left the note at his friend s room to review. When his friend went to market place he scanned the same note with his Paper-Link mobile app and visited the page URL. He then compared the camera in shop and the one available at flipkart.com. Upon comparing he left remark on mobile app, that camera is same as described. This way when Ajinkya saw Paper-Link Post-It library he is happy to place online order. Figure 3 shows the Paper-Link Post-It note with embedded QR-Code. Conclusion Paper-Link is a collaborative system inspired by people s existing behavior and habits of using Post-It notes and mobile devices to bridge gap between physical and digital world. We presented a system for storing, searching, and sharing digital and physical world information using Post-It notes and digital gadgets. It allows the user to not only input information with a physical sticky note but also retrieve information with the same note. In this way, the physical sticky note becomes a physical token, of dynamic information with changing content. References [1]. 3M Company, A century of innovation, the 3m story, [2]. R. Karger, B.Katz, J. Lin, and D. Quan, Sticky notes for the semanticweb, In the Proceeding of International Conference on Intelligent UserInterface, pp , [3]. Y. Liu, J. Yang, and M. Liu, Recognition of qr code with mobilephones, International Conference on Computer Science and NetworkTechnology (ICCSNT), vol. 4, pp , [4]. H. A-Lin, F. Yuan, and G. Ying, Qr code image detection usingrun length coding, International conference on Computer Science andnetwork Technology (ICCSNT), pp , [5]. Qr code, [6]. Evernote, Android virtual notes, [7]. Microsoft, One Note, office.microsoft.com/ en-us/ onenote/. [8]. Google, Google Docs Mobile, [9]. P. Ljungstrand, J. Redstrom, and L. Holmquist, WebStickers: usingphysical tokens to access, manage and share bookmarks to the Web, In proceedings of Designing Augmented Reality Environments (DARE),pp , [10]. P. Mistry and P. Maes, QUICKIES: Intelligent sticky notes. In theproceedings of 4th International Conference on Intelligent Environments(IE08). Seattle, USA, [11]. Visual c , [12]. Zbar barcode reader, [13]. Opencv image processing library by inteltm, [14]. Android Developer Tools (ADT), [15]. Eclipse ide, [16]. Google, Zxing barcode library, zxing/. [17]. Apache, The Apache HTTP Server Project, httpd.apache.org/. [18]. Oracle, MySQL - The world s most popular open source database, [19]. The PHP Group, PHP hypertext preprocessor, php.net/.