Wednesday 08 September 2010 00:01 Age: 3 yrs
Joystick Emulation using the DREAM Controller on the Microsoft Surface
New YouTube video just released! Check it out at http://www.youtube.com/user/UMLrobotics?feature=mhum#p/u/0/uyaXGPd_Whw
Not satisfied with simply controlling 120 pound robots with a Microsoft Surface, one of the lead programmers from these videos (http://youtube.com/watch?v=48A8vdJ68lI and http://youtube.com/watch?v=HSOziHgQedA) took a week off and hacked together an amazing on-screen joystick driver for Windows and the Microsoft Surface.
Eric McCann's adaptation of the DREAM Controller is based on Mark Micire's PhD research (http://www.vimeo.com/14543098) and can provide all of the functionality of a physical joystick through multi-touch interaction. By simply placing five fingers on the table, the joystick is dynamically re-sized and oriented to the user's hands automatically on every hand placement. It can also be moved to any position of the screen by dragging the index and middle fingers.
To demonstrate the functionality, this video shows the Microsoft Flight Simulator and Valve Corporation's Portal controlled exclusively through hand interaction on the tabletop.