Many human-machine collaborative support scheduling systems are used to aid human decision making by providing several optimal scheduling algorithms that do not take operator's attention into consideration.However...Many human-machine collaborative support scheduling systems are used to aid human decision making by providing several optimal scheduling algorithms that do not take operator's attention into consideration.However, the current systems should take advantage of the operator's attention to obtain the optimal solution.In this paper, we innovatively propose a human-machine collaborative support scheduling system of intelligence information from multi-UAVs based on eye-tracker. Firstly, the target recognition algorithm is applied to the images from the multiple unmanned aerial vehicles(multi-UAVs) to recognize the targets in the images. Then,the support system utilizes the eye tracker to gain the eye-gaze points which are intended to obtain the focused targets in the images. Finally, the heuristic scheduling algorithms take both the attributes of targets and the operator's attention into consideration to obtain the sequence of the images. As the processing time of the images collected by the multi-UAVs is uncertain, however the upper bounds and lower bounds of the processing time are known before. So the processing time of the images is modeled by the interval processing time. The objective of the scheduling problem is to minimize mean weighted completion time. This paper proposes some new polynomial time heuristic scheduling algorithms which firstly schedule the images including the focused targets. We conduct the scheduling experiments under six different distributions. The results indicate that the proposed algorithm is not sensitive to the different distributions of the processing time and has a negligible computational time. The absolute error of the best performing heuristic solution is only about 1%. Then, we incorporate the best performing heuristic algorithm into the human-machine collaborative support systems to verify the performance of the system.展开更多
This paper discusses some issues on human reliability model of time dependent human behavior. Some results of the crew reliability experiment on Tsinghua training simulator in China are given, Meanwhile, a case of ca...This paper discusses some issues on human reliability model of time dependent human behavior. Some results of the crew reliability experiment on Tsinghua training simulator in China are given, Meanwhile, a case of calculation for human error probability during anticipated transient without scram (ATWS) based on the data drew from the recent experiment is offered.展开更多
Substantial challenges remain in developing fiber devices to achieve uniform and customizable photochromic lighting effects using lightweight hardware.A recent publication in Light Science&Application,spearheaded ...Substantial challenges remain in developing fiber devices to achieve uniform and customizable photochromic lighting effects using lightweight hardware.A recent publication in Light Science&Application,spearheaded by Prof.Yan-Qing Lu and Prof.Guangming Tao presents a methodical approach to surmount the limitations in photochromic fibers.They integrated controllable photochromic fibers into various wearable devices,providing a promising path for future exploration and advancement in the field of human–machine interaction.展开更多
Human–machine interactions using deep-learning methods are important in the research of virtual reality,augmented reality,and metaverse.Such research remains challenging as current interactive sensing interfaces for ...Human–machine interactions using deep-learning methods are important in the research of virtual reality,augmented reality,and metaverse.Such research remains challenging as current interactive sensing interfaces for single-point or multipoint touch input are trapped by massive crossover electrodes,signal crosstalk,propagation delay,and demanding configuration requirements.Here,an all-inone multipoint touch sensor(AIOM touch sensor)with only two electrodes is reported.The AIOM touch sensor is efficiently constructed by gradient resistance elements,which can highly adapt to diverse application-dependent configurations.Combined with deep learning method,the AIOM touch sensor can be utilized to recognize,learn,and memorize human–machine interactions.A biometric verification system is built based on the AIOM touch sensor,which achieves a high identification accuracy of over 98%and offers a promising hybrid cyber security against password leaking.Diversiform human–machine interactions,including freely playing piano music and programmatically controlling a drone,demonstrate the high stability,rapid response time,and excellent spatiotemporally dynamic resolution of the AIOM touch sensor,which will promote significant development of interactive sensing interfaces between fingertips and virtual objects.展开更多
The driver's behavior plays a crucial role in transportation safety.It is widely acknowledged that driver vigilance is a major contributor to traffic accidents.However,the quantitative impact of driver vigilance o...The driver's behavior plays a crucial role in transportation safety.It is widely acknowledged that driver vigilance is a major contributor to traffic accidents.However,the quantitative impact of driver vigilance on driving risk has yet to be fully explored.This study aims to investigate the relationship between driver vigilance and driving risk,using data recorded from 28 drivers who maintain a speed of 80 km/h on a monotonous highway for 2 hours.The k-means and linear fitting methods are used to analyze the driving risk distribution under different driver vigilance states.Additionally,this study proposes a research framework for analyzing driving risk and develops three classification models(KNN,SVM,and DNN)to recognize the driving risk status.The results show that the frequency of low-risk incidents is negatively correlated with the driver's vigilance level,whereas the frequency of moderate-risk and high-risk incidents is positively correlated with the driver's vigilance level.The DNN model performs the best,achieving an accuracy of 0.972,recall of 0.972,precision of 0.973,and f1-score of 0.972,compared to KNN and SVM.This research could serve as a valuable reference for the design of warning systems and intelligent vehicles.展开更多
Three-dimensional(3D) display technology—a cutting-edge medium for human-machine interaction—enhances visual information density via image dimensional expansion and reduces the cognitive load to improve the efficien...Three-dimensional(3D) display technology—a cutting-edge medium for human-machine interaction—enhances visual information density via image dimensional expansion and reduces the cognitive load to improve the efficiency of information exchange [1–3].展开更多
The wearable sensors have recently attracted considerable attentions as communication interfaces through the information perception,decoding,and conveying process.However,it is still challenging to obtain a sensor tha...The wearable sensors have recently attracted considerable attentions as communication interfaces through the information perception,decoding,and conveying process.However,it is still challenging to obtain a sensor that can convert detectable signals into multiple outputs for convenient,e cient,cryptic,and high-capacity information transmission.Herein,we present a capacitive sensor of magnetic field based on a tilted flexible micromagnet array(t-FMA)as the proposed interaction interface.With the bidirectional bending capability of t-FMA actuated by magnetic torque,the sensor can recognize both the magnitude and orientation of magnetic field in real time with non-overlapping capacitance signals.The optimized sensor exhibits the high sensitivity of over 1.3 T-1 and detection limit down to 1 mT with excellent durability.As a proof of concept,the sensor has been successfully demonstrated for convenient,e cient,and programmable interaction systems,e.g.,touchless Morse code and Braille communication.The distinguishable recognition of the magnetic field orientation and magnitude further enables the sensor unit as a high-capacity transmitter for cryptic information interaction(e.g.,encoded ID recognition)and multi-control instruction outputting.We believe that the proposed magnetic field sensor can open up a potential avenue for future applications including information communication,virtual reality device,and interactive robotics.展开更多
Flexible and perceptive sensors represent the pinnacle of wearable technology;nevertheless, most of the current hydrogel-based sensors encounter difficulties in concurrently achieving mechanical durability, biocompati...Flexible and perceptive sensors represent the pinnacle of wearable technology;nevertheless, most of the current hydrogel-based sensors encounter difficulties in concurrently achieving mechanical durability, biocompatibility, high sensitivity, and scalability. This work introduces an innovative multimodal hydrogel–textile composite sensor(WPU–ChCl hydrogel) developed using the free radical polymerization of acrylamide, integrating choline chloride(ChCl), EMIM TFSI ionic liquid, and waterborne polyurethane(WPU) to overcome existing constraints. The resultant hydrogel demonstrates a synergistic network of covalent and dynamic non-covalent connections, with remarkable stretchability(~900%), mechanical toughness(>250 kJ/m^(3)), and ionic conductivity(9.2 m S/cm at 600% strain). Comprehensive morphological and chemical analysis validated uniform structure, increased segmental ordering, and improved heat stability. The hydrogel exhibited swift strain responsiveness(gauge factor = 7.23), quick response/recovery times(~108/114 ms), exceptional durability over 500 cycles, and enhanced selfhealing and adherence to various surfaces. Into textiles, the composite demonstrated exceptional real-time touch and motion detection capabilities and retained sensing accuracy after 20 wash cycles. Code transmission and machine learningbased high-accuracy gesture recognition(93.65%) were examples of advanced uses. The wireless-enabled system demonstrated efficacy in IoT-based health monitoring, soft robotics, and human–machine interactions, representing a substantial advancement in next-generation wearable electronics.展开更多
Hydrogels have emerged as promising candidates for the next generation of flexible electronics for human-machine interaction,owing to their excellent biocompatibility,safety,and flexibility.In this work,a novel hydrop...Hydrogels have emerged as promising candidates for the next generation of flexible electronics for human-machine interaction,owing to their excellent biocompatibility,safety,and flexibility.In this work,a novel hydrophobic/electrostatic dual-crosslinked hydrogel,polyacrylic acid-divinylbenzeneliquid metal(PAAD-LM)hydrogel,was synthesized for the first time by a facile one-stepγ-radiation method.PAAD-LM hydrogel exhibits remarkable stretchability(elongation at break of 5257±170%,areal strain of>7000%without break),self-healing capability,and excellent responsiveness as flexible touch panel and strain sensor.The hydrogel-based device demonstrates versatile functionalities,including painting,keyboard and mouse control applications,high-sensitivity recording of various human body movement signals,and VR smart gloves.The function of the hydrogel-based device is converted successfully through circuit and program design.With its stretchable and self-healing properties,PAAD-LM hydrogel holds great potential for advanced multifunctional wearable electronic devices.This work also provides novel insights into the synthesis of high-tensile,sensitive and multifunctional hydrogels.展开更多
It is only the observable part of the real world that can be stored in data. For such incomplete and ill-structured data, data crystallizing aims at presenting the hidden structure among events including unobservable ...It is only the observable part of the real world that can be stored in data. For such incomplete and ill-structured data, data crystallizing aims at presenting the hidden structure among events including unobservable events. This is realized by data crystallization, where dummy items, corresponding to potential existence ofunobservable events, are inserted to the given data. These dummy items and their relations with observable events are visualized by applying KeyGraph to the data with dummy items, like the crystallization of snow where dusts are involved in the formation of crystallization of water molecules. For tuning the granularity level of structure to be visualized, the tool of data crystallization is integrated with human＇s process of understanding significant scenarios in the real world. This basic method is expected to be applicable for various real world domains where previous methods of chance-discovery lead human to successful decision making. In this paper, we apply the data crystallization with human-interactive annealing （DCHA） to the design of products in a real company. The results show its effect to industrial decision making.展开更多
If a person comes into contact with pathogens on public facilities,there is a threat of contact(skin/wound)infections.More urgently,there are also reports about COVID-19 coronavirus contact infection,which once again ...If a person comes into contact with pathogens on public facilities,there is a threat of contact(skin/wound)infections.More urgently,there are also reports about COVID-19 coronavirus contact infection,which once again reminds that contact infection is a very easily overlooked disease exposure route.Herein,we propose an innovative implantation strategy to fabricate a multi-walled carbon nanotube/polyvinyl alcohol(MWCNT/PVA,MCP)interpenetrating interface to achieve flexibility,anti-damage,and non-contact sensing electronic skin(E-skin).Interestingly,the MCP E-skin had a fascinating non-contact sensing function,which can respond to the finger approaching 0−20 mm through the spatial weak field.This non-contact sensing can be applied urgently to human–machine interactions in public facilities to block pathogen.The scratches of the fruit knife did not damage the MCP E-skin,and can resist chemical corrosion after hydrophobic treatment.In addition,the MCP E-skin was developed to real-time monitor the respiratory and cough for exercise detection and disease diagnosis.Notably,the MCP E-skin has great potential for emergency applications in times of infectious disease pandemics.展开更多
基金the National Natural Science Foundation of China(No.61403410)
文摘Many human-machine collaborative support scheduling systems are used to aid human decision making by providing several optimal scheduling algorithms that do not take operator's attention into consideration.However, the current systems should take advantage of the operator's attention to obtain the optimal solution.In this paper, we innovatively propose a human-machine collaborative support scheduling system of intelligence information from multi-UAVs based on eye-tracker. Firstly, the target recognition algorithm is applied to the images from the multiple unmanned aerial vehicles(multi-UAVs) to recognize the targets in the images. Then,the support system utilizes the eye tracker to gain the eye-gaze points which are intended to obtain the focused targets in the images. Finally, the heuristic scheduling algorithms take both the attributes of targets and the operator's attention into consideration to obtain the sequence of the images. As the processing time of the images collected by the multi-UAVs is uncertain, however the upper bounds and lower bounds of the processing time are known before. So the processing time of the images is modeled by the interval processing time. The objective of the scheduling problem is to minimize mean weighted completion time. This paper proposes some new polynomial time heuristic scheduling algorithms which firstly schedule the images including the focused targets. We conduct the scheduling experiments under six different distributions. The results indicate that the proposed algorithm is not sensitive to the different distributions of the processing time and has a negligible computational time. The absolute error of the best performing heuristic solution is only about 1%. Then, we incorporate the best performing heuristic algorithm into the human-machine collaborative support systems to verify the performance of the system.
文摘This paper discusses some issues on human reliability model of time dependent human behavior. Some results of the crew reliability experiment on Tsinghua training simulator in China are given, Meanwhile, a case of calculation for human error probability during anticipated transient without scram (ATWS) based on the data drew from the recent experiment is offered.
文摘Substantial challenges remain in developing fiber devices to achieve uniform and customizable photochromic lighting effects using lightweight hardware.A recent publication in Light Science&Application,spearheaded by Prof.Yan-Qing Lu and Prof.Guangming Tao presents a methodical approach to surmount the limitations in photochromic fibers.They integrated controllable photochromic fibers into various wearable devices,providing a promising path for future exploration and advancement in the field of human–machine interaction.
基金supported by National Natural Science Foundation of China under Grants (U1805261 and 22161142024)A~*STAR SERC AME Programmatic Fund (A18A7b0058)
文摘Human–machine interactions using deep-learning methods are important in the research of virtual reality,augmented reality,and metaverse.Such research remains challenging as current interactive sensing interfaces for single-point or multipoint touch input are trapped by massive crossover electrodes,signal crosstalk,propagation delay,and demanding configuration requirements.Here,an all-inone multipoint touch sensor(AIOM touch sensor)with only two electrodes is reported.The AIOM touch sensor is efficiently constructed by gradient resistance elements,which can highly adapt to diverse application-dependent configurations.Combined with deep learning method,the AIOM touch sensor can be utilized to recognize,learn,and memorize human–machine interactions.A biometric verification system is built based on the AIOM touch sensor,which achieves a high identification accuracy of over 98%and offers a promising hybrid cyber security against password leaking.Diversiform human–machine interactions,including freely playing piano music and programmatically controlling a drone,demonstrate the high stability,rapid response time,and excellent spatiotemporally dynamic resolution of the AIOM touch sensor,which will promote significant development of interactive sensing interfaces between fingertips and virtual objects.
基金supported by Open Research Fund Program of Chongqing Key Laboratory of Industry and Informatization of Automotive Active Safety Testing Technology(H20220136)the Natural Science Foundation of Chongqing,China(cstc2021jcyjmsxmX0386,cstc2021jcyj-msxmX0766)the Science and Technology Research Program of Chongqing Municipal Education Commission(Grant No.KJ202201381395273).
文摘The driver's behavior plays a crucial role in transportation safety.It is widely acknowledged that driver vigilance is a major contributor to traffic accidents.However,the quantitative impact of driver vigilance on driving risk has yet to be fully explored.This study aims to investigate the relationship between driver vigilance and driving risk,using data recorded from 28 drivers who maintain a speed of 80 km/h on a monotonous highway for 2 hours.The k-means and linear fitting methods are used to analyze the driving risk distribution under different driver vigilance states.Additionally,this study proposes a research framework for analyzing driving risk and develops three classification models(KNN,SVM,and DNN)to recognize the driving risk status.The results show that the frequency of low-risk incidents is negatively correlated with the driver's vigilance level,whereas the frequency of moderate-risk and high-risk incidents is positively correlated with the driver's vigilance level.The DNN model performs the best,achieving an accuracy of 0.972,recall of 0.972,precision of 0.973,and f1-score of 0.972,compared to KNN and SVM.This research could serve as a valuable reference for the design of warning systems and intelligent vehicles.
文摘Three-dimensional(3D) display technology—a cutting-edge medium for human-machine interaction—enhances visual information density via image dimensional expansion and reduces the cognitive load to improve the efficiency of information exchange [1–3].
基金supported by The Science and Technology Development Fund,Macao SAR(File No.0037/2018/A1,0026/2020/AGJ)MultiYear Research Grant funded by University of Macao(File No.MYRG2017-00089-FST,MYRG2018-00063-IAPME)。
文摘The wearable sensors have recently attracted considerable attentions as communication interfaces through the information perception,decoding,and conveying process.However,it is still challenging to obtain a sensor that can convert detectable signals into multiple outputs for convenient,e cient,cryptic,and high-capacity information transmission.Herein,we present a capacitive sensor of magnetic field based on a tilted flexible micromagnet array(t-FMA)as the proposed interaction interface.With the bidirectional bending capability of t-FMA actuated by magnetic torque,the sensor can recognize both the magnitude and orientation of magnetic field in real time with non-overlapping capacitance signals.The optimized sensor exhibits the high sensitivity of over 1.3 T-1 and detection limit down to 1 mT with excellent durability.As a proof of concept,the sensor has been successfully demonstrated for convenient,e cient,and programmable interaction systems,e.g.,touchless Morse code and Braille communication.The distinguishable recognition of the magnetic field orientation and magnitude further enables the sensor unit as a high-capacity transmitter for cryptic information interaction(e.g.,encoded ID recognition)and multi-control instruction outputting.We believe that the proposed magnetic field sensor can open up a potential avenue for future applications including information communication,virtual reality device,and interactive robotics.
文摘Flexible and perceptive sensors represent the pinnacle of wearable technology;nevertheless, most of the current hydrogel-based sensors encounter difficulties in concurrently achieving mechanical durability, biocompatibility, high sensitivity, and scalability. This work introduces an innovative multimodal hydrogel–textile composite sensor(WPU–ChCl hydrogel) developed using the free radical polymerization of acrylamide, integrating choline chloride(ChCl), EMIM TFSI ionic liquid, and waterborne polyurethane(WPU) to overcome existing constraints. The resultant hydrogel demonstrates a synergistic network of covalent and dynamic non-covalent connections, with remarkable stretchability(~900%), mechanical toughness(>250 kJ/m^(3)), and ionic conductivity(9.2 m S/cm at 600% strain). Comprehensive morphological and chemical analysis validated uniform structure, increased segmental ordering, and improved heat stability. The hydrogel exhibited swift strain responsiveness(gauge factor = 7.23), quick response/recovery times(~108/114 ms), exceptional durability over 500 cycles, and enhanced selfhealing and adherence to various surfaces. Into textiles, the composite demonstrated exceptional real-time touch and motion detection capabilities and retained sensing accuracy after 20 wash cycles. Code transmission and machine learningbased high-accuracy gesture recognition(93.65%) were examples of advanced uses. The wireless-enabled system demonstrated efficacy in IoT-based health monitoring, soft robotics, and human–machine interactions, representing a substantial advancement in next-generation wearable electronics.
基金support from National Natural Science Foundation of China(No.12375336,11875078).
文摘Hydrogels have emerged as promising candidates for the next generation of flexible electronics for human-machine interaction,owing to their excellent biocompatibility,safety,and flexibility.In this work,a novel hydrophobic/electrostatic dual-crosslinked hydrogel,polyacrylic acid-divinylbenzeneliquid metal(PAAD-LM)hydrogel,was synthesized for the first time by a facile one-stepγ-radiation method.PAAD-LM hydrogel exhibits remarkable stretchability(elongation at break of 5257±170%,areal strain of>7000%without break),self-healing capability,and excellent responsiveness as flexible touch panel and strain sensor.The hydrogel-based device demonstrates versatile functionalities,including painting,keyboard and mouse control applications,high-sensitivity recording of various human body movement signals,and VR smart gloves.The function of the hydrogel-based device is converted successfully through circuit and program design.With its stretchable and self-healing properties,PAAD-LM hydrogel holds great potential for advanced multifunctional wearable electronic devices.This work also provides novel insights into the synthesis of high-tensile,sensitive and multifunctional hydrogels.
文摘It is only the observable part of the real world that can be stored in data. For such incomplete and ill-structured data, data crystallizing aims at presenting the hidden structure among events including unobservable events. This is realized by data crystallization, where dummy items, corresponding to potential existence ofunobservable events, are inserted to the given data. These dummy items and their relations with observable events are visualized by applying KeyGraph to the data with dummy items, like the crystallization of snow where dusts are involved in the formation of crystallization of water molecules. For tuning the granularity level of structure to be visualized, the tool of data crystallization is integrated with human＇s process of understanding significant scenarios in the real world. This basic method is expected to be applicable for various real world domains where previous methods of chance-discovery lead human to successful decision making. In this paper, we apply the data crystallization with human-interactive annealing （DCHA） to the design of products in a real company. The results show its effect to industrial decision making.
基金Zhejiang Provincial Natural Science Key Foundation of China(No.LZ20E030003)National Science Foundation of China(No.51673121)+1 种基金Candidates of Young and Middle Aged Academic Leader of Zhejiang Province,the Young Elite Scientists Sponsorship Program by CAST(No.2018QNRC001)Excellent Doctoral Thesis Cultivation Fund(No.2019D01).
文摘If a person comes into contact with pathogens on public facilities,there is a threat of contact(skin/wound)infections.More urgently,there are also reports about COVID-19 coronavirus contact infection,which once again reminds that contact infection is a very easily overlooked disease exposure route.Herein,we propose an innovative implantation strategy to fabricate a multi-walled carbon nanotube/polyvinyl alcohol(MWCNT/PVA,MCP)interpenetrating interface to achieve flexibility,anti-damage,and non-contact sensing electronic skin(E-skin).Interestingly,the MCP E-skin had a fascinating non-contact sensing function,which can respond to the finger approaching 0−20 mm through the spatial weak field.This non-contact sensing can be applied urgently to human–machine interactions in public facilities to block pathogen.The scratches of the fruit knife did not damage the MCP E-skin,and can resist chemical corrosion after hydrophobic treatment.In addition,the MCP E-skin was developed to real-time monitor the respiratory and cough for exercise detection and disease diagnosis.Notably,the MCP E-skin has great potential for emergency applications in times of infectious disease pandemics.
