Paper Reading #11: Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces

Comment 1: http://bjm-csce436.blogspot.com/2011/02/paper-reading-11-combining-multiple.html
Comment 2: http://introductionblogassignment.blogspot.com/2011/02/paper-reading-11-contact-area.html

Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces
Andrew D. Wilson, Hrvoje Benko
User Interface Software and Technology

This paper we are introduced to a design project by a couple Microsoft workers on their new system that they are calling LightSpace. Essentially this is a setup where the whole room becomes a computer and through the use of cameras and other projective devices a user is able to turn every surface in the room into a projective surface and be able to use them all as screens. The user is able to grab, move and do other things to different items in the room as well as transfer items from one surface to another. Essentially the description of the system given was similar to how their Kinect system works tracking the person and giving a simplified visual of the person and then being able to tell how they are moving and where in three dimensional space. The system can also detect flat surfaces and be able to tell when the user is interacting directly with them. This enables the user to touch an item on a surface, and then touch a second surface and then move the item between the two. The person is also able to grab the item and hold it in their hand, the item to the camera looking like a simple red ball and do the user looking like a colored cross and they would be able to move the item to any surface in the room. The room also allows the user to use its individual menu systems of each program, the menu items are displayed in spinning light displays that are projected onto the floor and the user can use them by holding their hand underneath for a period of time and then a new menu is replaced or an action is performed. The system is also able to do all of these actions just not for one user but is seamlessly able to perform these actions with multiple users in the room so that it could be used in a partner setting or for two people giving a presentation. The creators were able to setup a demo during the conference and were able to get feedback about the usability. The users were able to learn the system relatively easy but found that the maximum number of people who were able to be in a room at once was about six. There was also a little bit of delay when the users picked up multiple objects from the display and it would lag a little behind their movements. Overall they said it was a riveting success and the researchers were able to walk away with some valuable insight and free testing.

I think this is another really cool article and actually has some really neat concepts that have to do with HCI and computing in general. I would assume that eventually we might have our entire homes be large computers that can adapt for us and this is the kinds of technology that people would pay money for in order to enhance their home and be able to story memories such as photos and notes. I love the idea that any surface can be used as the screen and that each person is able to move the objects in a variety of ways. I think the most interesting part of this is that the system is not only designed with the user in mind making the interactions very intuitive and easy for the user to learn but also is designed in such a way that there is very little chance for the user to misuse the system. There is something that is so familiar about this system and I could see people instantly knowing how it works and then just grabbing an item off the table and throwing it onto the wall and then adjusting it, playing with it and ultimately putting it where they want. You would also be able to attach the internet and be able to display a cooking recipe web page on your table while you are doing it without having to mess with paper or a large clumsy book. I don't know if it would take awhile to get used to having projecting cameras everywhere but I think this would be an easy trade off for the fun and adaptability of this kind of system. I think this is a great system and I am very curious how much it costs and when I can get one installed.