Monday, September 26, 2011

Blog #11: Enabling Beyond-Surface Interactions for Interactive Surface with An Invisible Projection


Paper Title: Enabling Beyond-Surface Interactions for Interactive Surface with An Invisible Projection


Authors: Li-Wei Chan, Hsiang-Tao Wu, Hui-Shan Kao, Ju-Chun Ko, Home-Ru Lin, Mike Y. Chen, Jane Hsu and Yi-Ping Hung 


Author Bios: 
Li-Wei Chan is a Ph.D student in Image and Vision Lab and iAgent Lab at Graduate Institute of Networking and Multimedia, National Taiwan University in Taiwan. He received his masters and bachelors degree in Computer Science from National Taiwan University in 2004 and from Fu Jen Catholic University in 2002, resp.


Hsiang-Tao Wu is a Ph.D student at Graduate Institute of Networking and Multimedia, National Taiwan University in Taiwan.


Hui-Shan Kao is a student at Graduate Institute of Networking and Multimedia, National Taiwan University in Taiwan.


Home-Ru Lin is a student at Graduate Institute of Networking and Multimedia, National Taiwan University in Taiwan.


Ju-Chun Ko is a Ph.D student at Graduate Institute of Networking and Multimedia, National Taiwan University in Taiwan.


Mike Chen has a profession in the department of computer science at the National Taiwan University.


Jane Hsu is currently a professor at the National Taiwan University in the Computer Science and Information Engineering department.


Yi-Ping Hung is a professor at the National Taiwan University at the Graduate Institute of Networking and Multimedia.




Presentation Venue: This paper was presented at UIST '10 Proceedings of the 23rd annual ACM symposium on User interface software and technology in New York.


Summary:
Hypothesis: This paper presents a programmable infrared (IR) technique that utilizes invisible, programmable markers to support interaction beyond the surface of a diffused-illumination (DI) multi-touch system. The authors combine an IR projector and a standard color projector to simultaneously project visible content and invisible markers. The mobile devices outfitted with IR cameras can compute their 3D positions based on the markers perceived. Markers are selectively turned off to support multi-touch and direct on-surface tangible input. The proposed techniques enable a collaborative multi-display multi-touch tabletop system. The authors also present three interactive tools: i-m-View, i-m-Lamp and i-m-Flashlight, which consists of a mobile tablet and projectors that users can freely interact with, beyond the main display surface.
How the hypothesis was tested: The hypothesis was tested by providing three example applications that took advantages of the proposed techniques to provide intuitive and natural manipulation:
i-m-Lamp: a desk lamp for tabletops

The i-m-Lamp is composed of a pico-projector attached to an IR camera, mimicking the use of a desk lamp for the laptop system. i-m-Lamp provides a solution for multi-resolution that delivers fine details of the content right below the lamp while the overall view of the content is given by the tabletop system. Users can simply manipulate the lamp to  move the high-resolution projection anywhere on teh tabletop without memorizing any gestures. It is very suitable for integration with a personal tabletop system as a working desk.
i-m-Flashlight: a mobile exploration tool

This is a mobile version of the i-m-Lamp designed as an intuitive interface for applications of information exploration. The operations for i-m-Flashlight imitate the use of a handheld flashlight. Users can inspect the fine details of a region of interest by simply focusing the i-m-Flashlight toward that direction. In comparison, i-m-Flashlight facilitates short-term exploration activities where users can quickly explore multiple regions in the projection display. This is used as the interface to appreciate rich details in digital paintings.
i-m-View: an intuitive 3D viewer
i-m-View is composed of a tablet computer attached to an IR camera, featuring an intuitive viewer to explore 3D geographical information. The concept has been proposed and implemented in meraDesk, where a magnetic-field position sensor is used to track an arm-mounted monitor in six degrees of freedom. The i-m-View can be immersive, isolating the user from other users around the table, and from the table system.


This prototype system is composed of a table system and several mobile devices (the three listed above) connected with the table. The table system prototype is implemented on a standard desktop computer. The authors conducted early user testing in order to understand the strengths and limitations of the prototype. The users were told to freely use the three devices available for testing in turn. The task was to navigate the famous buildings and annotated photos shown on the map. Each photo in the table projection is presented as a pin on the map. With i-m-Lamp and i-m-Flashlight, users could see the photo beneath the pin. Therefore, the users had to drag the map or move the  i-m-Lamp or i-m-Flashlight to highlight the pins and to browse through the photos.
Result: All users reported mostly positive feedback regarding the i-m-Lamp. The focus problem was an issue face in the i-m-Flashlight/ This is because i-m-Lamp, when in regular use, is usually at an appropriate distance from the table surface and can hence present a sharp projection. i-m-Flashlight suggers from a severe focus problem, as users tend to move it quickly around, and use it from a wide range of proximities from the table surface.


Discussion:
Effectiveness: This paper presents a new interactive tabletop system that enables interaction beyond the surface using invisible markers while supporting multi-touch and tangible input directly on the surface. Mobile devices outfitted with IR cameras can compute their 3D positions based on the markers perceived. Markers are selectively turned off to support multi-touch and direct on-surface tangible input. The prototype is an excellent way to project a 3D view of things being projected on a surface. It has a few problems but considering the everyday objects that they are using to project this 3D view, I think it is an excellent prototype.
Reasons for being Interesting: This prototype provides various features by using everyday devices that are used at home. For e.g. the i-m-Lamp that is proposed by the authors provides a solution for multi-resolution that delivers fine details of the content right below the lamp and also the overall view of the content is given by the tabletop system. Also, the i-m-Flashlight is used as the interface to appreciate rich details in digital paintings.
Faults: The 3M LCD-based projectors that were used by the authors for the i-m-Lamp and the i-m-Flashlight devices, have lens that need to be manually adjusted to obtain sharp projections. This manual process limits the feasibility of mobile projection applications.


Interesting link: http://www.youtube.com/watch?v=jVwsgZ7ckxk

No comments:

Post a Comment