Monitoring techniques are a key technology for examining the conditions in various scenarios, e.g., structural conditions, weather conditions, and disasters. In order to understand such scenarios, the appropriate extr...Monitoring techniques are a key technology for examining the conditions in various scenarios, e.g., structural conditions, weather conditions, and disasters. In order to understand such scenarios, the appropriate extraction of their features from observation data is important. This paper proposes a monitoring method that allows sound environments to be expressed as a sound pattern. To this end, the concept of synesthesia is exploited. That is, the keys, tones, and pitches of the monitored sound are expressed using the three elements of color, that is, the hue, saturation, and brightness, respectively. In this paper, it is assumed that the hue, saturation, and brightness can be detected from the chromagram, sonogram, and sound spectrogram, respectively, based on a previous synesthesia experiment. Then, the sound pattern can be drawn using color, yielding a “painted sound map.” The usefulness of the proposed monitoring technique is verified using environmental sound data observed at a galleria.展开更多
To establish a proper evaluation method for spatial cognitive deficits and a form of developmental disorder, we have used an immersive virtual reality (VR) device to develop a game that involves actually walking throu...To establish a proper evaluation method for spatial cognitive deficits and a form of developmental disorder, we have used an immersive virtual reality (VR) device to develop a game that involves actually walking through a VR space to search for a target object. In this paper, we presented the results of control experiment with 22 healthy elementary school students as participants. The complexity of the VR space was controlled according to the number of pillars present and whether an overall view was possible (controlled by the height of the pillars). For each set of conditions, 24 trials were performed, and the route and time taken to search for the target were recorded. The starting point was changed in each subsequent trial. Results showed that the search time decreased as the number of trials increase, suggesting a process whereby a cognitive map was formed. We also compared the present results to results from our previous experiment with university students using the same experimental conditions, and we discussed the influence of developmental stage on spatial cognition.展开更多
文摘Monitoring techniques are a key technology for examining the conditions in various scenarios, e.g., structural conditions, weather conditions, and disasters. In order to understand such scenarios, the appropriate extraction of their features from observation data is important. This paper proposes a monitoring method that allows sound environments to be expressed as a sound pattern. To this end, the concept of synesthesia is exploited. That is, the keys, tones, and pitches of the monitored sound are expressed using the three elements of color, that is, the hue, saturation, and brightness, respectively. In this paper, it is assumed that the hue, saturation, and brightness can be detected from the chromagram, sonogram, and sound spectrogram, respectively, based on a previous synesthesia experiment. Then, the sound pattern can be drawn using color, yielding a “painted sound map.” The usefulness of the proposed monitoring technique is verified using environmental sound data observed at a galleria.
文摘To establish a proper evaluation method for spatial cognitive deficits and a form of developmental disorder, we have used an immersive virtual reality (VR) device to develop a game that involves actually walking through a VR space to search for a target object. In this paper, we presented the results of control experiment with 22 healthy elementary school students as participants. The complexity of the VR space was controlled according to the number of pillars present and whether an overall view was possible (controlled by the height of the pillars). For each set of conditions, 24 trials were performed, and the route and time taken to search for the target were recorded. The starting point was changed in each subsequent trial. Results showed that the search time decreased as the number of trials increase, suggesting a process whereby a cognitive map was formed. We also compared the present results to results from our previous experiment with university students using the same experimental conditions, and we discussed the influence of developmental stage on spatial cognition.
