Human-machine interfaces(HMI)are of paramount importance as they serve as essential conduits between humans and the digital realm.However,contemporary designs suffer from the following issues:large number of electrode...Human-machine interfaces(HMI)are of paramount importance as they serve as essential conduits between humans and the digital realm.However,contemporary designs suffer from the following issues:large number of electrodes,complex wiring,redundant data,and high power consumption.This work proposes a body-coupled minimalist human-machine interface for multifunctional touch detection(BM-HMI).The configuration of gradient resistive elements in the S-shape,in conjunction with a detection strategy founded upon the ratio of relative signal amplitudes,facilitates the effective detection of signals across a range of touch and sliding operations utilizing a mere two sensing electrodes.The experimental results demonstrate that the BM-HMI requires no battery,has remarkable stability(over 400,000 cycles),structural simplicity,rapid response time(approximately 5 ms),ultra-low detection threshold(below 0.04 N),robustness,and high scalability.This work presents a novel concept,demonstrating considerable potential for application in smart wearable devices,mixed reality systems,and ubiquitous sensing terminals.展开更多
A method is presented to convert any display screen into a touchscreen by using a pair of cameras. Most state of art touchscreens make use of special touch-sensitive hardware or depend on infrared sensors in various c...A method is presented to convert any display screen into a touchscreen by using a pair of cameras. Most state of art touchscreens make use of special touch-sensitive hardware or depend on infrared sensors in various configurations. We describe a novel computer-vision-based method that can robustly identify fingertips and detect touch with a precision of a few millimeters above the screen. In our system, the two cameras capture the display screen image simultaneously. Users can interact with a computer by the fingertip on the display screen. We have two important contributions： first, we develop a simple and robust hand detection method based on predicted images. Second, we determine whether a physical touch takes places by the homography of the two cameras. In this system, the appearance of the display screen in camera images is inherently predictable from the computer output images. Therefore, we can compute the predicted images and extract human hand precisely by simply subtracting the predicted images from captured images.展开更多
基金supported by the National Natural Science Foundation of China(No.52505071,No.52475071,No.52475072,No.52305308)the Yanzhao’s Young Scientist Project(2023203258)+5 种基金the Hebei Natural Science Foundation(E2022203002,and E2024203067)the Funded by Science Research Project of Hebei Education Department(QN2025183)the Shijiazhuang Science and Technology Planning Project(241790727A)the Opening Project of the Key Laboratory of Bionic Engineering(Ministry of Education,Jilin UniversityGrant Number KF2023003)The Fundamental Innovative Research Development Project of Yanshan University(2024LGQN008).
文摘Human-machine interfaces(HMI)are of paramount importance as they serve as essential conduits between humans and the digital realm.However,contemporary designs suffer from the following issues:large number of electrodes,complex wiring,redundant data,and high power consumption.This work proposes a body-coupled minimalist human-machine interface for multifunctional touch detection(BM-HMI).The configuration of gradient resistive elements in the S-shape,in conjunction with a detection strategy founded upon the ratio of relative signal amplitudes,facilitates the effective detection of signals across a range of touch and sliding operations utilizing a mere two sensing electrodes.The experimental results demonstrate that the BM-HMI requires no battery,has remarkable stability(over 400,000 cycles),structural simplicity,rapid response time(approximately 5 ms),ultra-low detection threshold(below 0.04 N),robustness,and high scalability.This work presents a novel concept,demonstrating considerable potential for application in smart wearable devices,mixed reality systems,and ubiquitous sensing terminals.
文摘A method is presented to convert any display screen into a touchscreen by using a pair of cameras. Most state of art touchscreens make use of special touch-sensitive hardware or depend on infrared sensors in various configurations. We describe a novel computer-vision-based method that can robustly identify fingertips and detect touch with a precision of a few millimeters above the screen. In our system, the two cameras capture the display screen image simultaneously. Users can interact with a computer by the fingertip on the display screen. We have two important contributions： first, we develop a simple and robust hand detection method based on predicted images. Second, we determine whether a physical touch takes places by the homography of the two cameras. In this system, the appearance of the display screen in camera images is inherently predictable from the computer output images. Therefore, we can compute the predicted images and extract human hand precisely by simply subtracting the predicted images from captured images.
