Monday, October 10, 2011

Blog #13: Combining Multiple Depth Cameras and Projectors for Interactions On, Above and Between Surfaces

Paper Title: Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces


Authors: Andrew D. Wilson and Hrvoje Benko


Author Bios: 
Andrew D. Wilson is a senior researcher at Microsoft. Applications of sensing techniques to enable new styles of HCI is one of his research interests.


Hrvoje Benko is a researcher at the Adaptive Systems and Interaction Group at Microsoft Research. His research interests are related to novel surface computing technologies and their impact on HCI.


Presentation Venue: This paper was presented at UIST '10 Proceedings of the 23rd annual ACM symposium on User interface software and technology in New York


Summary:
Hypothesis: In this paper, the authors introduce the LightSpace, an office-sized room instrumented with projectors and recently available depth cameras. LightSpace draws on aspects of interactive displays, augmented reality, and smart rooms. For example, the user may touch to manipulate a virtual ovject projected on an un-instrumented table, "pick up" the object from the table by moving it with one hand off the table and into the other hand, see the object sitting in their hand as they walk over to an interactive wall display, and place the object on the wall by touching it.
The authors explore the unique capabilities of depth cameras in combination with projectors to make progress towards a vision in which even the smallest corner of our environment is sensed and functions as a display. With LightSpace, they emphasize on the following themes:Surface Everywhere
The room is the computer
Body as display
How the hypothesis was tested: The LightSpace prototype was showcased at a three day demo event to an audience of more than 800 people. This event tested the responsiveness and robustness of the system, and this was how the authors received valuable feedback.
Results: They noticed how more users in the space resulted in more mesh processing. A refresh rate below that of a camera (30Hz) was resulted if two or more users were present in the space.


Discussion:
Effectiveness: The users had no trouble using the interactive surfaces or performing through-body transitions to transfer objects, however picking up and holding objects in the hand required some practice. Occasionally an interaction would fail to be detected because another user or the user's own head occluded the camera's view of the hands or body. Also there were some connections when multiple users were present in the space. This showed that the prototype was not very efficient.
Reasons for being Interesting: This prototype can be used by affluent individuals or groups who require to use an interactive system that allows users to interact on, above and between interactive surfaces in a room-sized environment. I did not really find this prototype very interesting but it definitely has its uses.
Faults: The generally available physics engines do not support animated meshes except in limited cases such as in the simulation of cloth. Hence, this prototype has not effective use.

No comments:

Post a Comment