Objective:This study aimed to explore the applications of three-dimensional (3D) technology, including virtual reality, augmented reality (AR), and 3D printing system, in the field of medicine, particularly in renal i...Objective:This study aimed to explore the applications of three-dimensional (3D) technology, including virtual reality, augmented reality (AR), and 3D printing system, in the field of medicine, particularly in renal interventions for cancer treatment.Methods:A specialized software transforms 2D medical images into precise 3D digital models, facilitating improved anatomical understanding and surgical planning. Patient-specific 3D printed anatomical models are utilized for preoperative planning, intraoperative guidance, and surgical education. AR technology enables the overlay of digital perceptions onto real-world surgical environments.Results:Patient-specific 3D printed anatomical models have multiple applications, such as preoperative planning, intraoperative guidance, trainee education, and patient counseling. Virtual reality involves substituting the real world with a computer-generated 3D environment, while AR overlays digitally created perceptions onto the existing reality. The advances in 3D modeling technology have sparked considerable interest in their application to partial nephrectomy in the realm of renal cancer. 3D printing, also known as additive manufacturing, constructs 3D objects based on computer-aided design or digital 3D models. Utilizing 3D-printed preoperative renal models provides benefits for surgical planning, offering a more reliable assessment of the tumor's relationship with vital anatomical structures and enabling better preparation for procedures. AR technology allows surgeons to visualize patient-specific renal anatomical structures and their spatial relationships with surrounding organs by projecting CT/MRI images onto a live laparoscopic video. Incorporating patient-specific 3D digital models into healthcare enhances best practice, resulting in improved patient care, increased patient satisfaction, and cost saving for the healthcare system.展开更多
This research studies the process of 3D reconstruction and dynamic concision based on 2D medical digital images using virtual reality modelling language (VRML) and JavaScript language, with a focus on how to realize t...This research studies the process of 3D reconstruction and dynamic concision based on 2D medical digital images using virtual reality modelling language (VRML) and JavaScript language, with a focus on how to realize the dynamic concision of 3D medical model with script node and sensor node in VRML. The 3D reconstruction and concision of body internal organs can be built with such high quality that they are better than those obtained from the traditional methods. With the function of dynamic concision, the VRML browser can offer better windows for man-computer interaction in real-time environment than ever before. 3D reconstruction and dynamic concision with VRML can be used to meet the requirement for the medical observation of 3D reconstruction and have a promising prospect in the fields of medical imaging.展开更多
Artificial intelligence(AI)is the study of algorithms that enable machines to analyze and execute cognitive activities including problem solving,object and word recognition,reduce the inevitable errors to improve the ...Artificial intelligence(AI)is the study of algorithms that enable machines to analyze and execute cognitive activities including problem solving,object and word recognition,reduce the inevitable errors to improve the diagnostic accuracy,and decision-making.Hepatobiliary procedures are technically complex and the use of AI in perioperative management can improve patient outcomes as discussed below.Three-dimensional(3D)reconstruction of images obtained via ultrasound,computed tomography scan or magnetic resonance imaging,can help surgeons better visualize the surgical sites with added depth perception.Preoperative 3D planning is associated with lesser operative time and intraoperative complications.Also,a more accurate assessment is noted,which leads to fewer operative complications.Images can be converted into physical models with 3D printing technology,which can be of educational value to students and trainees.3D images can be combined to provide 3D visualization,which is used for preoperative navigation,allowing for more precise localization of tumors and vessels.Nevertheless,AI enables surgeons to provide better,personalized care for each patient.展开更多
In response to the construction needs of “Real 3D China”, the system structure, functional framework, application direction and product form of block level augmented reality three-dimensional map is designed. Those ...In response to the construction needs of “Real 3D China”, the system structure, functional framework, application direction and product form of block level augmented reality three-dimensional map is designed. Those provide references and ideas for the later large-scale production of augmented reality three-dimensional map. The augmented reality three-dimensional map is produced based on skyline software. Including the map browsing, measurement and analysis and so on, the basic function of three-dimensional map is realized. The special functional module including housing management, pipeline management and so on is developed combining the need of residential quarters development, that expands the application fields of augmented reality three-dimensional map. Those lay the groundwork for the application of augmented reality three-dimensional map. .展开更多
The application of helicopter emergency rescue is becoming increasingly widespread,but the flight crew training in this area is still difficult due to high cost and risk.Nevertheless,with the development of Virtual Re...The application of helicopter emergency rescue is becoming increasingly widespread,but the flight crew training in this area is still difficult due to high cost and risk.Nevertheless,with the development of Virtual Reality(VR)technology,virtual simulation has become a significant role in crew training of helicopter rescue.During the implementation of VR-based training,how to transform complex real tasks into VR scenarios and how to evaluate the performance of crew are of great importance.To address these issues,a novel VR-based R-E-A-D(Report,Evaluate,Agree,Do)evaluation model for training is proposed,which is suitable for complex missions with multiple tasks,multiple scenarios,and multiple people.Then,a mapping method of VR scenarios is put forward,which can transform the real tasks into virtual scenarios to serve the virtual simulation training.Finally,an experiment is carried out to verify the feasibility of the evaluation method and virtual scenario mapping method.展开更多
BACKGROUND Primary retroperitoneal tumor is a rare type of tumor with insidious onset,large tumor size at the time of diagnosis,and often extensive involvement of surrounding tissues and blood vessels in the retroperi...BACKGROUND Primary retroperitoneal tumor is a rare type of tumor with insidious onset,large tumor size at the time of diagnosis,and often extensive involvement of surrounding tissues and blood vessels in the retroperitoneum.Surgery for primary retroperitoneal tumors is technically challenging.Preoperative imaging evaluation is critical for the selection of the optimal surgical approach and can influence complete resection and recurrence rates.Three-dimensional model reconstruction combined with virtual reality is useful for preoperative assessment.CASE SUMMARY A 17-year-old female patient was admitted for abdominal pain lasting for half a year that had been worsening for half a month.Abdominopelvic enhanced helical computed tomography revealed a retroperitoneal space-occupying lesion about 11.3 cm×9.1 cm in size,with well-defined borders in the upper left quadrant of the abdomen.The lesion compressed the left renal artery and vein resulting in vascular displacement and deformation.A multidisciplinary team decided on the optimal treatment approach.Preoperative three-dimensional visualization and virtual reality technology were used to assess and simulate the surgical procedure.Then,retroperitoneal tumor resection along with renal artery reconstruction was decided as the treatment.Complete resection of the retroperitoneal tumor was performed.Stable blood flow was established after renal artery reconstruction.The tumor was diagnosed as mature cystic teratoma(retroperitoneal tumor)by postoperative pathologic analysis.The patient,who recovered well,was discharged after 2 wk and maintains regular follow-ups.CONCLUSION A combination of three-dimensional reconstruction and virtual reality technology before surgery improves the rate of complete resection of retroperitoneal teratoma.展开更多
Virtual reality technology is a brand new comprehensive information technology emerging during the end of 21 st century. In recent years in particular, it gains rapid development, involving industries like education, ...Virtual reality technology is a brand new comprehensive information technology emerging during the end of 21 st century. In recent years in particular, it gains rapid development, involving industries like education, industry, military, entertainment and medicine. Combined with the characteristics of railway maintenance training, this thesis proposes the application of virtual reality in courseware, distance education, locomotive simulation driving, locomotive overhauling oil and breakdown processing, and illustrates key technology and solution of the exploitation of virtual reality technology.展开更多
Three-dimensional visualization technology converts engineering design drawings and data into graphics or images, realizes virtual reality perception of simulated users in future construction scene, enhances the inter...Three-dimensional visualization technology converts engineering design drawings and data into graphics or images, realizes virtual reality perception of simulated users in future construction scene, enhances the interaction between project management and technical personnel and engineering construction achievement, and provides intuitive, flexible and strong realistic experience for project management. It can effectively improve the level of project communication, and assist the needs of project construction planning management, training, exhibition, etc. As a tool to help improve project management skills, it has good application effect and prospects.展开更多
随着科技的不断进步和社会的发展,地理信息系统(Geographic Information System,GIS)在地理测绘中的应用变得愈加广泛和重要,其通过集成和分析各种地理数据,为城市规划、环境保护、灾害应急、资源管理等领域提供了强有力的支持。GIS高...随着科技的不断进步和社会的发展,地理信息系统(Geographic Information System,GIS)在地理测绘中的应用变得愈加广泛和重要,其通过集成和分析各种地理数据,为城市规划、环境保护、灾害应急、资源管理等领域提供了强有力的支持。GIS高效的数据分析、精确的空间分析和多层次的数据可视化等优势使其在提升地理信息的利用效率和决策科学性方面发挥了关键作用。研究GIS在地理测绘中的具体应用,并重点探讨了数据采集、虚拟现实技术、测绘应急数据快速处理等方面的应用实例,能够更好地展示GIS在不同领域的应用效果和实际价值。展开更多
Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as...Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as they provide interaction platforms between users and virtual environments.However,traditional VR HMIs based on handheld devices or keyboards cannot recognize diverse three-dimensional(3D)gestures,which results in limited freedom of VR interactions.Here,we report a noncontact VR HMI enabled by an electret-nanofiber-based triboelectric sensor(ETS),which is fabricated by the electrospun polylactic acid/thermoplastic polyurethane(PLA/TPU)electret nanofiber film.The nanofiber structure of PLA/TPU electret enhanced the charge retention ability of triboelectric sensor and thus significantly improved its signal strength and stability.Integrated with a deep learning-based multilayer perceptron neural network,the ETS realizes the recognition of 18 different types of 3D gestures with a high average accuracy of 97.3%.An intelligent noncontact VR interactive system based on the ETS is further developed,which is used to manipulate game characters for performing different actions by 3D gestures.Compared with traditional VR HMIs,the proposed VR HMI based on PLA/TPU electret nanofiber film can detect various 3D gestures and offers a superior interaction freedom.This work for the first time introduces the triboelectric 3D gesture recognition method to the VR HMIs,and could make the interaction between human and virtual environments become more efficient and fascinating.展开更多
文摘Objective:This study aimed to explore the applications of three-dimensional (3D) technology, including virtual reality, augmented reality (AR), and 3D printing system, in the field of medicine, particularly in renal interventions for cancer treatment.Methods:A specialized software transforms 2D medical images into precise 3D digital models, facilitating improved anatomical understanding and surgical planning. Patient-specific 3D printed anatomical models are utilized for preoperative planning, intraoperative guidance, and surgical education. AR technology enables the overlay of digital perceptions onto real-world surgical environments.Results:Patient-specific 3D printed anatomical models have multiple applications, such as preoperative planning, intraoperative guidance, trainee education, and patient counseling. Virtual reality involves substituting the real world with a computer-generated 3D environment, while AR overlays digitally created perceptions onto the existing reality. The advances in 3D modeling technology have sparked considerable interest in their application to partial nephrectomy in the realm of renal cancer. 3D printing, also known as additive manufacturing, constructs 3D objects based on computer-aided design or digital 3D models. Utilizing 3D-printed preoperative renal models provides benefits for surgical planning, offering a more reliable assessment of the tumor's relationship with vital anatomical structures and enabling better preparation for procedures. AR technology allows surgeons to visualize patient-specific renal anatomical structures and their spatial relationships with surrounding organs by projecting CT/MRI images onto a live laparoscopic video. Incorporating patient-specific 3D digital models into healthcare enhances best practice, resulting in improved patient care, increased patient satisfaction, and cost saving for the healthcare system.
基金Postdoctoral Fund of China (No. 2003034518), Fund of Health Bureau of Zhejiang Province (No. 2004B042), China
文摘This research studies the process of 3D reconstruction and dynamic concision based on 2D medical digital images using virtual reality modelling language (VRML) and JavaScript language, with a focus on how to realize the dynamic concision of 3D medical model with script node and sensor node in VRML. The 3D reconstruction and concision of body internal organs can be built with such high quality that they are better than those obtained from the traditional methods. With the function of dynamic concision, the VRML browser can offer better windows for man-computer interaction in real-time environment than ever before. 3D reconstruction and dynamic concision with VRML can be used to meet the requirement for the medical observation of 3D reconstruction and have a promising prospect in the fields of medical imaging.
文摘Artificial intelligence(AI)is the study of algorithms that enable machines to analyze and execute cognitive activities including problem solving,object and word recognition,reduce the inevitable errors to improve the diagnostic accuracy,and decision-making.Hepatobiliary procedures are technically complex and the use of AI in perioperative management can improve patient outcomes as discussed below.Three-dimensional(3D)reconstruction of images obtained via ultrasound,computed tomography scan or magnetic resonance imaging,can help surgeons better visualize the surgical sites with added depth perception.Preoperative 3D planning is associated with lesser operative time and intraoperative complications.Also,a more accurate assessment is noted,which leads to fewer operative complications.Images can be converted into physical models with 3D printing technology,which can be of educational value to students and trainees.3D images can be combined to provide 3D visualization,which is used for preoperative navigation,allowing for more precise localization of tumors and vessels.Nevertheless,AI enables surgeons to provide better,personalized care for each patient.
文摘In response to the construction needs of “Real 3D China”, the system structure, functional framework, application direction and product form of block level augmented reality three-dimensional map is designed. Those provide references and ideas for the later large-scale production of augmented reality three-dimensional map. The augmented reality three-dimensional map is produced based on skyline software. Including the map browsing, measurement and analysis and so on, the basic function of three-dimensional map is realized. The special functional module including housing management, pipeline management and so on is developed combining the need of residential quarters development, that expands the application fields of augmented reality three-dimensional map. Those lay the groundwork for the application of augmented reality three-dimensional map. .
文摘The application of helicopter emergency rescue is becoming increasingly widespread,but the flight crew training in this area is still difficult due to high cost and risk.Nevertheless,with the development of Virtual Reality(VR)technology,virtual simulation has become a significant role in crew training of helicopter rescue.During the implementation of VR-based training,how to transform complex real tasks into VR scenarios and how to evaluate the performance of crew are of great importance.To address these issues,a novel VR-based R-E-A-D(Report,Evaluate,Agree,Do)evaluation model for training is proposed,which is suitable for complex missions with multiple tasks,multiple scenarios,and multiple people.Then,a mapping method of VR scenarios is put forward,which can transform the real tasks into virtual scenarios to serve the virtual simulation training.Finally,an experiment is carried out to verify the feasibility of the evaluation method and virtual scenario mapping method.
文摘BACKGROUND Primary retroperitoneal tumor is a rare type of tumor with insidious onset,large tumor size at the time of diagnosis,and often extensive involvement of surrounding tissues and blood vessels in the retroperitoneum.Surgery for primary retroperitoneal tumors is technically challenging.Preoperative imaging evaluation is critical for the selection of the optimal surgical approach and can influence complete resection and recurrence rates.Three-dimensional model reconstruction combined with virtual reality is useful for preoperative assessment.CASE SUMMARY A 17-year-old female patient was admitted for abdominal pain lasting for half a year that had been worsening for half a month.Abdominopelvic enhanced helical computed tomography revealed a retroperitoneal space-occupying lesion about 11.3 cm×9.1 cm in size,with well-defined borders in the upper left quadrant of the abdomen.The lesion compressed the left renal artery and vein resulting in vascular displacement and deformation.A multidisciplinary team decided on the optimal treatment approach.Preoperative three-dimensional visualization and virtual reality technology were used to assess and simulate the surgical procedure.Then,retroperitoneal tumor resection along with renal artery reconstruction was decided as the treatment.Complete resection of the retroperitoneal tumor was performed.Stable blood flow was established after renal artery reconstruction.The tumor was diagnosed as mature cystic teratoma(retroperitoneal tumor)by postoperative pathologic analysis.The patient,who recovered well,was discharged after 2 wk and maintains regular follow-ups.CONCLUSION A combination of three-dimensional reconstruction and virtual reality technology before surgery improves the rate of complete resection of retroperitoneal teratoma.
文摘Virtual reality technology is a brand new comprehensive information technology emerging during the end of 21 st century. In recent years in particular, it gains rapid development, involving industries like education, industry, military, entertainment and medicine. Combined with the characteristics of railway maintenance training, this thesis proposes the application of virtual reality in courseware, distance education, locomotive simulation driving, locomotive overhauling oil and breakdown processing, and illustrates key technology and solution of the exploitation of virtual reality technology.
文摘Three-dimensional visualization technology converts engineering design drawings and data into graphics or images, realizes virtual reality perception of simulated users in future construction scene, enhances the interaction between project management and technical personnel and engineering construction achievement, and provides intuitive, flexible and strong realistic experience for project management. It can effectively improve the level of project communication, and assist the needs of project construction planning management, training, exhibition, etc. As a tool to help improve project management skills, it has good application effect and prospects.
文摘随着科技的不断进步和社会的发展,地理信息系统(Geographic Information System,GIS)在地理测绘中的应用变得愈加广泛和重要,其通过集成和分析各种地理数据,为城市规划、环境保护、灾害应急、资源管理等领域提供了强有力的支持。GIS高效的数据分析、精确的空间分析和多层次的数据可视化等优势使其在提升地理信息的利用效率和决策科学性方面发挥了关键作用。研究GIS在地理测绘中的具体应用,并重点探讨了数据采集、虚拟现实技术、测绘应急数据快速处理等方面的应用实例,能够更好地展示GIS在不同领域的应用效果和实际价值。
基金supported by the National Natural Science Foundation of China(No.52303112)the Henan Province Science and Technology Research and Development Program Joint Fund Advantageous Discipline Cultivation Project(No.232301420033)+1 种基金the China Postdoctoral Science Foundation(Nos.2022TQ0281 and 2023M733213)the Key R&D and Promotion Special(Scientific Problem Tackling)Project of Henan Province(No.242102231014).
文摘Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as they provide interaction platforms between users and virtual environments.However,traditional VR HMIs based on handheld devices or keyboards cannot recognize diverse three-dimensional(3D)gestures,which results in limited freedom of VR interactions.Here,we report a noncontact VR HMI enabled by an electret-nanofiber-based triboelectric sensor(ETS),which is fabricated by the electrospun polylactic acid/thermoplastic polyurethane(PLA/TPU)electret nanofiber film.The nanofiber structure of PLA/TPU electret enhanced the charge retention ability of triboelectric sensor and thus significantly improved its signal strength and stability.Integrated with a deep learning-based multilayer perceptron neural network,the ETS realizes the recognition of 18 different types of 3D gestures with a high average accuracy of 97.3%.An intelligent noncontact VR interactive system based on the ETS is further developed,which is used to manipulate game characters for performing different actions by 3D gestures.Compared with traditional VR HMIs,the proposed VR HMI based on PLA/TPU electret nanofiber film can detect various 3D gestures and offers a superior interaction freedom.This work for the first time introduces the triboelectric 3D gesture recognition method to the VR HMIs,and could make the interaction between human and virtual environments become more efficient and fascinating.
