A taxonomy of (real and virtual world) display and control interactions

Interactions between a human operator and objects in his/her world afford a wide range of possible viewing and control options, which can vary with respect to time, space, proximity, and frame of reference. Whereas it is conventionally recognised that essentially any kind of interaction metaphor can in principle be simulated in a virtual environment, modern image processing technology now permits greatly increased flexibility also for real world interactions with indirect viewing, Äî as the common video camera has gone beyond being a simple eye on the (remote) real world to being an instrument that is able to integrate and interpolate real world images spatially and temporally, in real time.