In the area of computer vision, deep learning has produced a variety of state-of-the-art models that rely on massive labeled data. However, collecting and annotating images from the real world is too demanding in term...In the area of computer vision, deep learning has produced a variety of state-of-the-art models that rely on massive labeled data. However, collecting and annotating images from the real world is too demanding in terms of labor and money investments, and is usually inflexible to build datasets with specific characteristics, such as small area of objects and high occlusion level. Under the framework of Parallel Vision, this paper presents a purposeful way to design artificial scenes and automatically generate virtual images with precise annotations.A virtual dataset named Parallel Eye is built, which can be used for several computer vision tasks. Then, by training the DPM(Deformable parts model) and Faster R-CNN detectors, we prove that the performance of models can be significantly improved by combining Parallel Eye with publicly available real-world datasets during the training phase. In addition, we investigate the potential of testing the trained models from a specific aspect using intentionally designed virtual datasets, in order to discover the flaws of trained models. From the experimental results, we conclude that our virtual dataset is viable to train and test the object detectors.展开更多
Virtual assembly is a Virtual Reality (VR) based engineering application which allows engineers to evaluate, analyze, and plan the assembly of mechanical systems. To model the virtual assembly process, new methodology...Virtual assembly is a Virtual Reality (VR) based engineering application which allows engineers to evaluate, analyze, and plan the assembly of mechanical systems. To model the virtual assembly process, new methodology must be applied. Based on the idea that the virtual assembly system is an event driven system, the interactive behavior and information model is proposed to describe the dynamic process of virtual assembly. Definition of the object-oriented model of virtual assembly is put forward.展开更多
基金supported by the National Natural Science Foundation of China(61533019,71232006)
文摘In the area of computer vision, deep learning has produced a variety of state-of-the-art models that rely on massive labeled data. However, collecting and annotating images from the real world is too demanding in terms of labor and money investments, and is usually inflexible to build datasets with specific characteristics, such as small area of objects and high occlusion level. Under the framework of Parallel Vision, this paper presents a purposeful way to design artificial scenes and automatically generate virtual images with precise annotations.A virtual dataset named Parallel Eye is built, which can be used for several computer vision tasks. Then, by training the DPM(Deformable parts model) and Faster R-CNN detectors, we prove that the performance of models can be significantly improved by combining Parallel Eye with publicly available real-world datasets during the training phase. In addition, we investigate the potential of testing the trained models from a specific aspect using intentionally designed virtual datasets, in order to discover the flaws of trained models. From the experimental results, we conclude that our virtual dataset is viable to train and test the object detectors.
文摘Virtual assembly is a Virtual Reality (VR) based engineering application which allows engineers to evaluate, analyze, and plan the assembly of mechanical systems. To model the virtual assembly process, new methodology must be applied. Based on the idea that the virtual assembly system is an event driven system, the interactive behavior and information model is proposed to describe the dynamic process of virtual assembly. Definition of the object-oriented model of virtual assembly is put forward.
