This paper addresses the notion of “sensory patrimoine,” by questioning our control of the natural elements, and the processes of patrimonialization. It considers this notion according to the sound or smell sensorialities. These thoughts are illustrated by several examples, in Switzerland, France, and Japan. We define under what conditions we can characterize the sound or olfactory identity of a place or an environment. Helped by the works on environmental identity, we thus investigate the modalities for sharing these sensorialities to create a common identity. We then define a key to understand our responsibility toward the environment, and we call for a balance to be found in future works on the inventory of smell and sound characters.