Complexity and Scientific Challenges
Résumé
This chapter discusses the topics for which solutions exist, but which still pose scientific challenges and elements of complexity which would be helpful to discuss in detail. It describes physical models to detect collisions and the problem of the virtual human. The chapter then examines naturalness of the interaction, and proposes an analysis of force feedback. It also discusses the 3D interaction loop as the explanatory framework for the scientific challenges surrounding 3D interaction with virtual or mixed environments. This loop comes from the perception‐action loop, which is very often used in the literature to explain the challenges in virtual reality and augmented reality. In order to improve interaction, different sensory modalities of the user are brought into play: not only sight, but also hearing and touch are fundamental sensory modalities. The chapter finally identifies the scientific challenges related to these different sensory modalities.