Thought this might be timely with all the buzz about Microsoft's "Kinect." Here's some much earlier computer vision and interaction work done by Myron Krueger at the University of Connecticut's Artificial Reality Lab. Of course it's comparatively crude, but keep in mind this was built on technology from a quarter century ago!