Multimodality and Ambient Intelligence

In this chapter we discuss multimodal interface technology. We present eexamples of multimodal interfaces and show problems and opportunities. Fusion of modalities is discussed and some roadmap discussions on research in multimodality are summarized. This chapter also discusses future developments where, rather tha communicating with a single computer, users communicate with their environment using multimodal interactions and where the environmental interface has perceptual competence that includes being able to interpret what is going on in the environment. We contribute roles to virtual humans in order to allow daily users of future computing environments to establish relationships with the environments, or more in particular, these virtual humans.