{"id":3439,"date":"2010-04-19T06:10:04","date_gmt":"2010-04-19T13:10:04","guid":{"rendered":"http:\/\/palblog.fxpal.com\/?p=3439"},"modified":"2010-09-16T09:30:50","modified_gmt":"2010-09-16T16:30:50","slug":"paper-ui-reseach-at-fxpal","status":"publish","type":"post","link":"https:\/\/blog.fxpal.net\/?p=3439","title":{"rendered":"Paper UI reseach at FXPAL"},"content":{"rendered":"<p>Paper still plays an important role in many tasks even in this age of computers. This phenomenon can be attributed to paper\u2019s unique advantages in display quality, spatial arrangement flexibility, instant accessibility and robustness, which the existing computers can hardly beat. However, paper lacks computational capability and does not render dynamic information. In contrast, cell phones are becoming powerful in computation and communication, providing a convenient access to dynamic information and digital services. Nevertheless, cell phones are constrained by their limited screen size, relatively lower display quality and cumbersome input methods. Combining the merits of paper and cell phones for rich GUI-like interactions on paper has become an active research area.<\/p>\n<p>Here at FXPAL, the Paper UI group currently focuses on cell phone-based  interfaces and their supporting techniques to link paper documents to digital information and enable rich digital interactions on physical paper through content-based image recognition algorithms. We started\u00a0 research in this area several years ago (see our <a title=\"Paper UI | FXPAL\" href=\"http:\/\/www.fxpal.com\/paperui\/\" target=\"_blank\">project page<\/a> for more details), and our recent on-going projects include EMM and PACER.<\/p>\n<h3><!--more-->EMMs (Embedded Media Markers)<\/h3>\n<p>EMMs are nearly transparent iconic marks printed on paper documents that signify the existence of media associated with that part of the document. EMMs also guide users\u2019 camera operations for media retrieval. Users take a picture of an EMM-signified document patch using a cell phone, and the media associated with the EMM-signified document location is displayed on the phone. Unlike bar codes, EMMs are nearly transparent and thus do not interfere with the document appearance. Retrieval of media associated with an EMM is based on image local features of the captured EMM-signified document patch. Our recent <a title=\"Liu, Q., Liao, C., Wilcox, L., Dunnigan, A., and Liew, B. 2010. Embedded media markers: marks on paper that signify associated media. In Proc. IUI '10. ACM, New York, NY, 149-158 \" href=\"http:\/\/doi.acm.org\/10.1145\/1719970.1719992\" target=\"_blank\">paper<\/a> on EMMs won the <strong>Best Paper Award<\/strong> at the ACM Conference on Intelligent User Interface (IUI 2010).<\/p>\n<p>Here are the slides from that presentation<\/p>\n<div id=\"__ss_3753794\" style=\"width: 425px;\"><strong style=\"display: block; margin: 12px 0 4px;\"><a title=\"EMM (Embedded Media Marker)\" href=\"http:\/\/www.slideshare.net\/liaocy\/emm-embedded-media-marker\">EMM (Embedded Media Marker)<\/a><\/strong><object classid=\"clsid:d27cdb6e-ae6d-11cf-96b8-444553540000\" width=\"425\" height=\"355\" codebase=\"http:\/\/download.macromedia.com\/pub\/shockwave\/cabs\/flash\/swflash.cab#version=6,0,40,0\"><param name=\"allowFullScreen\" value=\"true\" \/><param name=\"allowScriptAccess\" value=\"always\" \/><param name=\"src\" value=\"http:\/\/static.slidesharecdn.com\/swf\/ssplayer2.swf?doc=iui2010shared-100416191528-phpapp02&amp;stripped_title=emm-embedded-media-marker\" \/><param name=\"allowfullscreen\" value=\"true\" \/><\/object><\/p>\n<div style=\"padding: 5px 0 12px;\">View more <a href=\"http:\/\/www.slideshare.net\/\">presentations<\/a> from <a href=\"http:\/\/www.slideshare.net\/liaocy\">Chunyuan Liao<\/a>.<\/div>\n<\/div>\n<p>PACER (Paper And Cell phone for Editing and Reading)<\/p>\n<p>In the PACER, we propose a novel augmented-reality-like cell phone interface that is optimized for fine-grained paper document interaction. In contrast to the existing limited point-and-click interaction with pre-defined hotspots on paper, PACER allows users to issue rich hybrid camera-touch gestures to select arbitrary paper document details (e.g. individual Latin words, Chinese\/Japanese characters, math symbols, places on a map and any image regions), and to specify actions to be applied to the selected content. The initial results of PACER have been <a title=\"Liao, C., Liu, Q., Liew, B., and Wilcox, L. 2010. Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone. In Proc. CHI '10. ACM, New York, NY, 2441-2450\" href=\"http:\/\/doi.acm.org\/10.1145\/1753326.1753696\" target=\"_blank\">published<\/a> at CHI 2010.<\/p>\n<p>Here are the slides<\/p>\n<div id=\"__ss_3752093\" style=\"width: 425px;\"><strong style=\"display: block; margin: 12px 0 4px;\"><a title=\"PACER: Fine-grained Interactive Paper via Hybrid Camera and Touch Gestures on a Cell Phone\" href=\"http:\/\/www.slideshare.net\/liaocy\/pacer-finegrained-interactive-paper-via-hybrid-camera-and-touch-gestures-on-a-cell-phone\">PACER: Fine-grained Interactive Paper via Hybrid Camera and Touch Gestures on a Cell Phone<\/a><\/strong><object classid=\"clsid:d27cdb6e-ae6d-11cf-96b8-444553540000\" width=\"425\" height=\"355\" codebase=\"http:\/\/download.macromedia.com\/pub\/shockwave\/cabs\/flash\/swflash.cab#version=6,0,40,0\"><param name=\"allowFullScreen\" value=\"true\" \/><param name=\"allowScriptAccess\" value=\"always\" \/><param name=\"src\" value=\"http:\/\/static.slidesharecdn.com\/swf\/ssplayer2.swf?doc=confpresentationshared-100416164659-phpapp01&amp;stripped_title=pacer-finegrained-interactive-paper-via-hybrid-camera-and-touch-gestures-on-a-cell-phone\" \/><param name=\"allowfullscreen\" value=\"true\" \/><\/object><\/p>\n<div style=\"padding: 5px 0 12px;\">View more <a href=\"http:\/\/www.slideshare.net\/\">presentations<\/a> from <a href=\"http:\/\/www.slideshare.net\/liaocy\">Chunyuan Liao<\/a>.<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>The Paper UI group at FXPAL is exploring cell phone-based interfaces to link paper documents to digital information and to enable rich digital interactions on physical paper through content-based image recognition algorithms.<\/p>\n","protected":false},"author":273,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[24],"tags":[335,198,105,256,200,199,197],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts\/3439"}],"collection":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/users\/273"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3439"}],"version-history":[{"count":8,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts\/3439\/revisions"}],"predecessor-version":[{"id":4608,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=\/wp\/v2\/posts\/3439\/revisions\/4608"}],"wp:attachment":[{"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3439"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3439"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.fxpal.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3439"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}