人脸素描图像生成问题目的是将人脸照片转换为对应的素描图像,已有方法生成的素描图像或缺乏素描纹理,或需要在额外的大规模数据集上进行预训练.针对上述问题,文中基于Lmser(Least Mean Square Error Reconstruction)构建内外嵌套的深...人脸素描图像生成问题目的是将人脸照片转换为对应的素描图像,已有方法生成的素描图像或缺乏素描纹理,或需要在额外的大规模数据集上进行预训练.针对上述问题,文中基于Lmser(Least Mean Square Error Reconstruction)构建内外嵌套的深度双向网络,即Lmser-in-Lmser双向网络,用于人脸素描图像的生成.利用Lmser的神经元对偶特性,即编码神经元和解码神经元之间形成双向短路连接,在内部Lmser子网络的编码器和解码器之间通过前向传递不同网络层进行学习,得到多层级特征,增强素描生成的纹理细节.同时建立具有同样结构的网络,反向建立素描映射到照片的模型.外部通过在2个Lmser子网络上施加一致性约束,实现反馈链接,改善素描特征.在基准数据集上的实验表明,文中方法性能较优,并且不需要在额外的数据集上进行预训练,可应用性较强.展开更多
Advances on bidirectional intelligence are overviewed along three threads,with extensions and new perspectives.The first thread is about bidirectional learning architecture,exploring five dualities that enable Lmser s...Advances on bidirectional intelligence are overviewed along three threads,with extensions and new perspectives.The first thread is about bidirectional learning architecture,exploring five dualities that enable Lmser six cognitive functions and provide new perspectives on which a lot of extensions and particularlly flexible Lmser are proposed.Interestingly,either or two of these dualities actually takes an important role in recent models such as U-net,ResNet,and Dense Net.The second thread is about bidirectional learning principles unified by best yIng-yAng(IA)harmony in BYY system.After getting insights on deep bidirectional learning from a bird-viewing on existing typical learning principles from one or both of the inward and outward directions,maximum likelihood,variational principle,and several other learning principles are summarised as exemplars of the BYY learning,with new perspectives on advanced topics.The third thread further proceeds to deep bidirectional intelligence,driven by long term dynamics(LTD)for parameter learning and short term dynamics(STD)for image thinking and rational thinking in harmony.Image thinking deals with information flow of continuously valued arrays and especially image sequence,as if thinking was displayed in the real world,exemplified by the flow from inward encoding/cognition to outward reconstruction/transformation performed in Lmser learning and BYY learning.In contrast,rational thinking handles symbolic strings or discretely valued vectors,performing uncertainty reasoning and problem solving.In particular,a general thesis is proposed for bidirectional intelligence,featured by BYY intelligence potential theory(BYY-IPT)and nine essential dualities in architecture,fundamentals,and implementation,respectively.Then,problems of combinatorial solving and uncertainty reasoning are investigated from this BYY IPT perspective.First,variants and extensions are suggested for AlphaGoZero like searching tasks,such as traveling salesman problem(TSP)and attributed graph matching(AGM)that are turned into Go like problems with help of a feature enrichment technique.Second,reasoning activities are summarized under guidance of BYY IPT from the aspects of constraint satisfaction,uncertainty propagation,and path or tree searching.Particularly,causal potential theory is proposed for discovering causal direction,with two roads developed for its implementation.展开更多
There has been a framework sketched for learning deep bidirectional intelligence.The framework has an inbound that features two actions:one is the acquiring action,which gets inputs in appropriate patterns,and the oth...There has been a framework sketched for learning deep bidirectional intelligence.The framework has an inbound that features two actions:one is the acquiring action,which gets inputs in appropriate patterns,and the other is A-S cognition,derived from the abbreviated form of words abstraction and self-organization,which abstracts input patterns into concepts that are labeled and understood by self-organizing parts involved in the concept into structural hierarchies.The top inner domain accommodates relations and a priori knowledge with the help of the A-I thinking action that is responsible for the accumulation-amalgamation and induction-inspiration.The framework also has an outbound that comes with two actions.One is called I-S reasoning,which makes inference and synthesis(I-S)and is responsible for performing various tasks including image thinking and problem solving,and the other is called the interacting action,which controls,communicates with,and inspects the environment.Based on this framework,we further discuss the possibilities of design intelligence through synthesis reasoning.展开更多
文摘人脸素描图像生成问题目的是将人脸照片转换为对应的素描图像,已有方法生成的素描图像或缺乏素描纹理,或需要在额外的大规模数据集上进行预训练.针对上述问题,文中基于Lmser(Least Mean Square Error Reconstruction)构建内外嵌套的深度双向网络,即Lmser-in-Lmser双向网络,用于人脸素描图像的生成.利用Lmser的神经元对偶特性,即编码神经元和解码神经元之间形成双向短路连接,在内部Lmser子网络的编码器和解码器之间通过前向传递不同网络层进行学习,得到多层级特征,增强素描生成的纹理细节.同时建立具有同样结构的网络,反向建立素描映射到照片的模型.外部通过在2个Lmser子网络上施加一致性约束,实现反馈链接,改善素描特征.在基准数据集上的实验表明,文中方法性能较优,并且不需要在额外的数据集上进行预训练,可应用性较强.
基金supported by the Zhi-Yuan Chair Professorship Start-up Grant (WF220103010) from Shanghai Jiao Tong University
文摘Advances on bidirectional intelligence are overviewed along three threads,with extensions and new perspectives.The first thread is about bidirectional learning architecture,exploring five dualities that enable Lmser six cognitive functions and provide new perspectives on which a lot of extensions and particularlly flexible Lmser are proposed.Interestingly,either or two of these dualities actually takes an important role in recent models such as U-net,ResNet,and Dense Net.The second thread is about bidirectional learning principles unified by best yIng-yAng(IA)harmony in BYY system.After getting insights on deep bidirectional learning from a bird-viewing on existing typical learning principles from one or both of the inward and outward directions,maximum likelihood,variational principle,and several other learning principles are summarised as exemplars of the BYY learning,with new perspectives on advanced topics.The third thread further proceeds to deep bidirectional intelligence,driven by long term dynamics(LTD)for parameter learning and short term dynamics(STD)for image thinking and rational thinking in harmony.Image thinking deals with information flow of continuously valued arrays and especially image sequence,as if thinking was displayed in the real world,exemplified by the flow from inward encoding/cognition to outward reconstruction/transformation performed in Lmser learning and BYY learning.In contrast,rational thinking handles symbolic strings or discretely valued vectors,performing uncertainty reasoning and problem solving.In particular,a general thesis is proposed for bidirectional intelligence,featured by BYY intelligence potential theory(BYY-IPT)and nine essential dualities in architecture,fundamentals,and implementation,respectively.Then,problems of combinatorial solving and uncertainty reasoning are investigated from this BYY IPT perspective.First,variants and extensions are suggested for AlphaGoZero like searching tasks,such as traveling salesman problem(TSP)and attributed graph matching(AGM)that are turned into Go like problems with help of a feature enrichment technique.Second,reasoning activities are summarized under guidance of BYY IPT from the aspects of constraint satisfaction,uncertainty propagation,and path or tree searching.Particularly,causal potential theory is proposed for discovering causal direction,with two roads developed for its implementation.
基金Project supported by the National New Generation Artificial Intelligence Project,China(No.2018AAA0100700)the Zhiyuan Chair Professorship Start-up Grant from Shanghai Jiao Tong University,China(No.WF220103010)。
文摘There has been a framework sketched for learning deep bidirectional intelligence.The framework has an inbound that features two actions:one is the acquiring action,which gets inputs in appropriate patterns,and the other is A-S cognition,derived from the abbreviated form of words abstraction and self-organization,which abstracts input patterns into concepts that are labeled and understood by self-organizing parts involved in the concept into structural hierarchies.The top inner domain accommodates relations and a priori knowledge with the help of the A-I thinking action that is responsible for the accumulation-amalgamation and induction-inspiration.The framework also has an outbound that comes with two actions.One is called I-S reasoning,which makes inference and synthesis(I-S)and is responsible for performing various tasks including image thinking and problem solving,and the other is called the interacting action,which controls,communicates with,and inspects the environment.Based on this framework,we further discuss the possibilities of design intelligence through synthesis reasoning.
