Put that there!
One of the first multimodal interaction systems, dubbed Put-that-there, was built at the MIT Architecture Machine lab in the late 1970s by Chris Schmandt, who is now the director of the Speech and Mobility Group at MIT Media Labs. Here is a demo from 1979, where you see the integration of speech and gesture recognition to allow users to create and move objects on a screen. That was more than 30 years ago, and it worked pretty well … except … well, watch the video until the end…
Roberto Pieraccini
THE VOICE IN THE MACHINE 