In fields such as science and engineering, virtual environment is commonly used to provide replacements for practical hands-on laboratories. Sometimes, these environments take the form of a remote interface to the phy...In fields such as science and engineering, virtual environment is commonly used to provide replacements for practical hands-on laboratories. Sometimes, these environments take the form of a remote interface to the physical laboratory apparatus and at other times, in the form of a complete software implementation that simulates the laboratory apparatus. In this paper, we report on the use of a semi-immersive 3D mobile Augmented Reality (mAR) interface and limited simulations as a replacement for practical hands-on laboratories in science and engineering. The 3D-mAR based interfaces implementations for three different experiments (from micro-electronics, power and communications engineering) are presented;the discovered limitations are discussed along with the results of an evaluation by science and engineering students from two different institutions and plans for future work.展开更多
This paper proposes an outdoor guide system using vision-based augmented reality(AR) on mobile devices.Augmented reality provides a virtual-real fusion display interface for outdoor guide.Vision-based methods are more...This paper proposes an outdoor guide system using vision-based augmented reality(AR) on mobile devices.Augmented reality provides a virtual-real fusion display interface for outdoor guide.Vision-based methods are more accurate than GPS or other hardware-based methods.However,vision-based methods require more resources and relatively strong computing power of mobile devices.A C/S framework for vision based augmented reality system is introduced in this paper.In a server,a vocabulary tree is used for location recognition.In a mobile device,BRISK feature is combined with optical flow methods to track the offline keyframe.The system is tested on UKbench datasets and in real environment.Experimental results show that the proposed vision-based augmented reality system works well and yields relatively high recognition rate and that the mobile device achieves realtime recognition performance.展开更多
In the digital age,museums are becoming increasingly integrated with media technology.The interactive mode of museum education brought about by new digital communication technology can increase the audience’s partici...In the digital age,museums are becoming increasingly integrated with media technology.The interactive mode of museum education brought about by new digital communication technology can increase the audience’s participation and interest in museum education content.This paper attempts to use Mobile Augment Reality(MAR)technology to design museum education content under the guidance of the principle of abstraction hierarchy from the theory of education optimization.With the help of MAR technology,museum education content can move up and down at different levels of information abstraction.The purpose is to help the audience move between perceptual knowledge and rational knowledge and improve their ability to understand.The evaluation results show that this style of interactive teaching content can promote visitors’understanding,thinking and interest in the cultural content of museum exhibits.It is also can helps visitors use a more professional-level vocabulary and more detailed descriptions about the cultural content of museum exhibits.The design and implementation method detailed in this paper has a certain guiding value for museum education development as well as utilization of MAR technology.展开更多
With the development of computation technology,the augmented reality(AR)is widely applied in many fields as well as the image recognition.However,the AR application on mobile platform is not developed enough in the pa...With the development of computation technology,the augmented reality(AR)is widely applied in many fields as well as the image recognition.However,the AR application on mobile platform is not developed enough in the past decades due to the capability of the mobile processors.In recent years,the performance of mobile processors has changed rapidly,which makes it comparable to the desktop processors.This paper proposed and realized an AR system to be used on the Android mobile platform based on the image recognition through EasyAR engine and Unity 3D development tools.In this system,the image recognition could be done locally and/or using cloud recognition.Test results show that the cloud-based recognition is more efficient and accuracy than the local recognition for the mobile AR when there are more images to be recognized at the same time.展开更多
Many augmented reality(AR)systems are developed for entertainment,but AR and particularly mobile AR potentially have more application possibilities in other fields.For example,in civil engineering or city planning,AR ...Many augmented reality(AR)systems are developed for entertainment,but AR and particularly mobile AR potentially have more application possibilities in other fields.For example,in civil engineering or city planning,AR could be used in combination with CityGML building models to enhance some typical workflows in planning,execution and operation processes.A concrete example is the geo-referenced on-site visualization of planned buildings or building parts,to simplify planning processes and optimize the communication between the participating decision-makers.One of the main challenges for the visualization lies in the pose tracking,i.e.the real-time estimation of the translation and rotation of the mobile device to align the virtual objects with reality.In this paper,we introduce a proof-of-concept fine-grained mobile AR CityGML-based pose tracking system aimed at the mentioned applications.The system estimates poses by combining 3D CityGML data with information derived from 2D camera images and an inertial measurement unit and is fully self-sufficient and operates without external infrastructure.The results of our evaluation show that CityGML and low-cost off-the-shelf mobile devices,such as smartphones,already provide performant and accurate mobile pose tracking for AR in civil engineering and city planning.展开更多
Mobile Edge Computing(MEC)and 5G technology allow clients to access computing resources at the network frontier,which paves the way for applying Mobile Augmented Reality(MAR)applications.Under the MEC paradigm,MAR cli...Mobile Edge Computing(MEC)and 5G technology allow clients to access computing resources at the network frontier,which paves the way for applying Mobile Augmented Reality(MAR)applications.Under the MEC paradigm,MAR clients can offload complex tasks to the MEC server and enhance the human perception of the world by merging the received virtual information with the real environment.However,the resource allocation problem arises as a critical challenge in circumstances where several MAR clients compete for limited resources at the network frontier.In this paper,we aim to design an online resource allocation scheme on the MEC server that takes both high quality of experience and good fairness performance for MAR clients into consideration.We first formulate this problem as a Markov decision process and tackle the challenge of applying the deep reinforcement learning paradigm.Then,we propose DRAM,a Deep reinforcement learning-based Resource allocation scheme for mobile Augmented reality service in MEC.We also propose a self-adaptive algorithm on the MAR client that is derived based on the analysis of the MAR service to tackle client adaptation problems.The simulation results demonstrated that DRAM can provide high quality of experience and simultaneously achieve good fairness performance by coordinating with clients’adaptation algorithms.展开更多
文摘In fields such as science and engineering, virtual environment is commonly used to provide replacements for practical hands-on laboratories. Sometimes, these environments take the form of a remote interface to the physical laboratory apparatus and at other times, in the form of a complete software implementation that simulates the laboratory apparatus. In this paper, we report on the use of a semi-immersive 3D mobile Augmented Reality (mAR) interface and limited simulations as a replacement for practical hands-on laboratories in science and engineering. The 3D-mAR based interfaces implementations for three different experiments (from micro-electronics, power and communications engineering) are presented;the discovered limitations are discussed along with the results of an evaluation by science and engineering students from two different institutions and plans for future work.
基金Supported by the National Science and Technology Major Project(No.2012ZX03002004)the National High Technology Research and Development Programme of China(No.2013AA013802)
文摘This paper proposes an outdoor guide system using vision-based augmented reality(AR) on mobile devices.Augmented reality provides a virtual-real fusion display interface for outdoor guide.Vision-based methods are more accurate than GPS or other hardware-based methods.However,vision-based methods require more resources and relatively strong computing power of mobile devices.A C/S framework for vision based augmented reality system is introduced in this paper.In a server,a vocabulary tree is used for location recognition.In a mobile device,BRISK feature is combined with optical flow methods to track the offline keyframe.The system is tested on UKbench datasets and in real environment.Experimental results show that the proposed vision-based augmented reality system works well and yields relatively high recognition rate and that the mobile device achieves realtime recognition performance.
基金Supported by Jiangxi Educational Committee with grant No.GJJ151282.
文摘In the digital age,museums are becoming increasingly integrated with media technology.The interactive mode of museum education brought about by new digital communication technology can increase the audience’s participation and interest in museum education content.This paper attempts to use Mobile Augment Reality(MAR)technology to design museum education content under the guidance of the principle of abstraction hierarchy from the theory of education optimization.With the help of MAR technology,museum education content can move up and down at different levels of information abstraction.The purpose is to help the audience move between perceptual knowledge and rational knowledge and improve their ability to understand.The evaluation results show that this style of interactive teaching content can promote visitors’understanding,thinking and interest in the cultural content of museum exhibits.It is also can helps visitors use a more professional-level vocabulary and more detailed descriptions about the cultural content of museum exhibits.The design and implementation method detailed in this paper has a certain guiding value for museum education development as well as utilization of MAR technology.
文摘With the development of computation technology,the augmented reality(AR)is widely applied in many fields as well as the image recognition.However,the AR application on mobile platform is not developed enough in the past decades due to the capability of the mobile processors.In recent years,the performance of mobile processors has changed rapidly,which makes it comparable to the desktop processors.This paper proposed and realized an AR system to be used on the Android mobile platform based on the image recognition through EasyAR engine and Unity 3D development tools.In this system,the image recognition could be done locally and/or using cloud recognition.Test results show that the cloud-based recognition is more efficient and accuracy than the local recognition for the mobile AR when there are more images to be recognized at the same time.
文摘Many augmented reality(AR)systems are developed for entertainment,but AR and particularly mobile AR potentially have more application possibilities in other fields.For example,in civil engineering or city planning,AR could be used in combination with CityGML building models to enhance some typical workflows in planning,execution and operation processes.A concrete example is the geo-referenced on-site visualization of planned buildings or building parts,to simplify planning processes and optimize the communication between the participating decision-makers.One of the main challenges for the visualization lies in the pose tracking,i.e.the real-time estimation of the translation and rotation of the mobile device to align the virtual objects with reality.In this paper,we introduce a proof-of-concept fine-grained mobile AR CityGML-based pose tracking system aimed at the mentioned applications.The system estimates poses by combining 3D CityGML data with information derived from 2D camera images and an inertial measurement unit and is fully self-sufficient and operates without external infrastructure.The results of our evaluation show that CityGML and low-cost off-the-shelf mobile devices,such as smartphones,already provide performant and accurate mobile pose tracking for AR in civil engineering and city planning.
基金supported by the National Key R&D Program of China(2020YFB1807804,2020YFB1807800)the National Nat-ural Science Foundation of China(NSFC)(62001087,62072079,U20A20156).
文摘Mobile Edge Computing(MEC)and 5G technology allow clients to access computing resources at the network frontier,which paves the way for applying Mobile Augmented Reality(MAR)applications.Under the MEC paradigm,MAR clients can offload complex tasks to the MEC server and enhance the human perception of the world by merging the received virtual information with the real environment.However,the resource allocation problem arises as a critical challenge in circumstances where several MAR clients compete for limited resources at the network frontier.In this paper,we aim to design an online resource allocation scheme on the MEC server that takes both high quality of experience and good fairness performance for MAR clients into consideration.We first formulate this problem as a Markov decision process and tackle the challenge of applying the deep reinforcement learning paradigm.Then,we propose DRAM,a Deep reinforcement learning-based Resource allocation scheme for mobile Augmented reality service in MEC.We also propose a self-adaptive algorithm on the MAR client that is derived based on the analysis of the MAR service to tackle client adaptation problems.The simulation results demonstrated that DRAM can provide high quality of experience and simultaneously achieve good fairness performance by coordinating with clients’adaptation algorithms.
