Aircraft cockpit display interface （CDI） is one of the most important human-machine interfaces for information perceiving. During the process of aircraft design, situation awareness （SA） is frequently considered t...Aircraft cockpit display interface （CDI） is one of the most important human-machine interfaces for information perceiving. During the process of aircraft design, situation awareness （SA） is frequently considered to improve the design, as the CDI must provide enough SA for the pilot to maintain the flight safety. In order to study the SA in the pilot-aircraft system, a cockpit flight simulation environment is built up, which includes a virtual instrument panel, a flight visual display and the corresponding control system. Based on the simulation environment, a human-in-the-loop experiment is designed to measure the SA by the situation awareness global assessment technique （SAGAT）. Through the experiment, the SA degrees and heart rate （HR） data of the subjects are obtained, and the SA levels under different CDI designs are analyzed. The results show that analyzing the SA can serve as an objective way to evaluate the design of CDI, which could be proved from the consistent HR data. With this method, evaluations of the CDI design are performed in the experimental flight simulation environment, and optimizations could be guided through the analysis.展开更多
With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out ...With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals（SDNN） significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.展开更多
Multidimensional sensing is a highly desired attribute for allowing human-machine interfaces(HMIs)to perceive various types of information from both users and the environment,thus enabling the advancement of various s...Multidimensional sensing is a highly desired attribute for allowing human-machine interfaces(HMIs)to perceive various types of information from both users and the environment,thus enabling the advancement of various smart electronics/applications,e.g.,smartphones and smart cities.Conventional multidimensional sensing is achieved through the integration of multiple discrete sensors,which introduces issues such as high energy consumption and high circuit complexity.These disadvantages have motivated the widespread use of functional materials for detecting various stimuli at low cost with low power requirements.This work presents an overview of simply structured touch interfaces for multidimensional(x-y location,force and temperature)sensing enabled by piezoelectric,piezoresistive,triboelectric,pyroelectric and thermoelectric materials.For each technology,the mechanism of operation,state-of-the-art designs,merits,and drawbacks are investigated.At the end of the article,the author discusses the challenges limiting the successful applications of functional materials in commercial touch interfaces and corresponding development trends.展开更多
With the rapid development of digital and intelligent information systems, display of radar situation interface has become an important challenge in the field of human-computer interaction. We propose a method for the...With the rapid development of digital and intelligent information systems, display of radar situation interface has become an important challenge in the field of human-computer interaction. We propose a method for the optimization of radar situation interface from error-cognition through the mapping of information characteristics. A mapping method of matrix description is adopted to analyze the association properties between error-cognition sets and design information sets. Based on the mapping relationship between the domain of error-cognition and the domain of design information, a cross-correlational analysis is carried out between error-cognition and design information.We obtain the relationship matrix between the error-cognition of correlation between design information and the degree of importance among design information. Taking the task interface of a warfare navigation display as an example, error factors and the features of design information are extracted. Based on the results, we also propose an optimization design scheme for the radar situation interface.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
Flexible and stretchable electronics have shown high potential applied in the electronics world such as wearable electronics[1,2],displays[3,4]and energy harvesting[5,6].Their innovative characteristics are that flexi...Flexible and stretchable electronics have shown high potential applied in the electronics world such as wearable electronics[1,2],displays[3,4]and energy harvesting[5,6].Their innovative characteristics are that flexible electronics own stable function under limited physical deformation(e.g.,bending)[7,8],and stretchable electronics possess the ability to ensure reliable performance under diverse physical deformation modes(e.g.,stretching and twisting)[9,10].However,challenges remain when integrating rigid,flexible substrates into the stretchable substrates,because of a mismatch in their elastic moduli,which causes failing operations when devices are stretching.Several efforts are devoted to enhancing the stretchability,such as the modified geometry by the serpentine and kirigami island[11],and rigid island method by materials and interfacial engineering[12,13],but fully mitigating the strain mismatch,large-scale application and long-term stability are still obstacles to combine flexible and stretchable substrates.展开更多
We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which...We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which are difficult or impossible to reach.It consists of a dynamic global thumbnail,a touchpad widget that drives the screen cursor,and a teleport widget in which interactions are transferred to its target screen region.Javelin can be easily integrated into many programs to optimize their interaction performance in large screens.The experiment and user study show that Javelin can extend user access field and enhance widget manipulation in large displays.展开更多
基金supported by National Basic Research Program of China(No.2010CB734104)
文摘Aircraft cockpit display interface （CDI） is one of the most important human-machine interfaces for information perceiving. During the process of aircraft design, situation awareness （SA） is frequently considered to improve the design, as the CDI must provide enough SA for the pilot to maintain the flight safety. In order to study the SA in the pilot-aircraft system, a cockpit flight simulation environment is built up, which includes a virtual instrument panel, a flight visual display and the corresponding control system. Based on the simulation environment, a human-in-the-loop experiment is designed to measure the SA by the situation awareness global assessment technique （SAGAT）. Through the experiment, the SA degrees and heart rate （HR） data of the subjects are obtained, and the SA levels under different CDI designs are analyzed. The results show that analyzing the SA can serve as an objective way to evaluate the design of CDI, which could be proved from the consistent HR data. With this method, evaluations of the CDI design are performed in the experimental flight simulation environment, and optimizations could be guided through the analysis.
基金supported by the National Basic Research Program of China (No. 2010CB734104)
文摘With respect to the ergonomic evaluation and optimization in the mental task design of the aircraft cockpit display interface, the experimental measurement and theoretical modeling of mental workload were carried out under flight simulation task conditions using the performance evaluation, subjective evaluation and physiological measurement methods. The experimental results show that with an increased mental workload, the detection accuracy of flight operation significantly reduced and the reaction time was significantly prolonged; the standard deviation of R-R intervals（SDNN） significantly decreased, while the mean heart rate exhibited little change; the score of NASA_TLX scale significantly increased. On this basis, the indexes sensitive to mental workload were screened, and an integrated model for the discrimination and prediction of mental workload of aircraft cockpit display interface was established based on the Bayesian Fisher discrimination and classification method. The original validation and cross-validation methods were employed to test the accuracy of the results of discrimination and prediction of the integrated model, and the average prediction accuracies determined by these two methods are both higher than 85%. Meanwhile, the integrated model shows a higher accuracy in discrimination and prediction of mental workload compared with single indexes. The model proposed in this paper exhibits a satisfactory coincidence with the measured data and could accurately reflect the variation characteristics of the mental workload of aircraft cockpit display interface, thus providing a basis for the ergonomic evaluation and optimization design of the aircraft cockpit display interface in the future.
文摘Multidimensional sensing is a highly desired attribute for allowing human-machine interfaces(HMIs)to perceive various types of information from both users and the environment,thus enabling the advancement of various smart electronics/applications,e.g.,smartphones and smart cities.Conventional multidimensional sensing is achieved through the integration of multiple discrete sensors,which introduces issues such as high energy consumption and high circuit complexity.These disadvantages have motivated the widespread use of functional materials for detecting various stimuli at low cost with low power requirements.This work presents an overview of simply structured touch interfaces for multidimensional(x-y location,force and temperature)sensing enabled by piezoelectric,piezoresistive,triboelectric,pyroelectric and thermoelectric materials.For each technology,the mechanism of operation,state-of-the-art designs,merits,and drawbacks are investigated.At the end of the article,the author discusses the challenges limiting the successful applications of functional materials in commercial touch interfaces and corresponding development trends.
基金supported by Jiangsu Province Nature Science Foundation of China (BK20221490)the Key Fundamental Research Funds for the Central Universities (30920041114)+2 种基金the National Natural Science Foundation of China (52175469,71601068)the Key Research and Development (Social Development) Project of Jiangsu Province(BE2019647)Jiangsu Province Social Science Foundation of China (20YSB013)。
文摘With the rapid development of digital and intelligent information systems, display of radar situation interface has become an important challenge in the field of human-computer interaction. We propose a method for the optimization of radar situation interface from error-cognition through the mapping of information characteristics. A mapping method of matrix description is adopted to analyze the association properties between error-cognition sets and design information sets. Based on the mapping relationship between the domain of error-cognition and the domain of design information, a cross-correlational analysis is carried out between error-cognition and design information.We obtain the relationship matrix between the error-cognition of correlation between design information and the degree of importance among design information. Taking the task interface of a warfare navigation display as an example, error factors and the features of design information are extracted. Based on the results, we also propose an optimization design scheme for the radar situation interface.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
文摘Flexible and stretchable electronics have shown high potential applied in the electronics world such as wearable electronics[1,2],displays[3,4]and energy harvesting[5,6].Their innovative characteristics are that flexible electronics own stable function under limited physical deformation(e.g.,bending)[7,8],and stretchable electronics possess the ability to ensure reliable performance under diverse physical deformation modes(e.g.,stretching and twisting)[9,10].However,challenges remain when integrating rigid,flexible substrates into the stretchable substrates,because of a mismatch in their elastic moduli,which causes failing operations when devices are stretching.Several efforts are devoted to enhancing the stretchability,such as the modified geometry by the serpentine and kirigami island[11],and rigid island method by materials and interfacial engineering[12,13],but fully mitigating the strain mismatch,large-scale application and long-term stability are still obstacles to combine flexible and stretchable substrates.
基金Project supported by China Academic Digital Associative Library (CADAL)
文摘We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which are difficult or impossible to reach.It consists of a dynamic global thumbnail,a touchpad widget that drives the screen cursor,and a teleport widget in which interactions are transferred to its target screen region.Javelin can be easily integrated into many programs to optimize their interaction performance in large screens.The experiment and user study show that Javelin can extend user access field and enhance widget manipulation in large displays.
