Molten iron temperature as well as Si, P, and S contents is the most essential molten iron quality （MIQ） indices in the blast furnace （BF） ironmaking, which requires strict monitoring during the whole ironmaking p...Molten iron temperature as well as Si, P, and S contents is the most essential molten iron quality （MIQ） indices in the blast furnace （BF） ironmaking, which requires strict monitoring during the whole ironmaking production. However, these MIQ parameters are difficult to be directly measured online, and large-time delay exists in off-line analysis through laboratory sampling. Focusing on the practical challenge, a data-driven modeling method was presented for the prediction of MIQ using the improved muhivariable incremental random vector functional-link net- works （M-I-RVFLNs）. Compared with the conventional random vector functional-link networks （RVFLNs） and the online sequential RVFLNs, the M-I-RVFLNs have solved the problem of deciding the optimal number of hidden nodes and overcome the overfitting problems. Moreover, the proposed M I RVFLNs model has exhibited the potential for multivariable prediction of the MIQ and improved the terminal condition for the multiple-input multiple-out- put （MIMO） dynamic system, which is suitable for the BF ironmaking process in practice. Ultimately, industrial experiments and contrastive researches have been conducted on the BF No. 2 in Liuzhou Iron and Steel Group Co. Ltd. of China using the proposed method, and the results demonstrate that the established model produces better estima ting accuracy than other MIQ modeling methods.展开更多
In the contemporary era, the proliferation of information technology has led to an unprecedented surge in data generation, with this data being dispersed across a multitude of mobile devices. Facing these situations a...In the contemporary era, the proliferation of information technology has led to an unprecedented surge in data generation, with this data being dispersed across a multitude of mobile devices. Facing these situations and the training of deep learning model that needs great computing power support, the distributed algorithm that can carry out multi-party joint modeling has attracted everyone’s attention. The distributed training mode relieves the huge pressure of centralized model on computer computing power and communication. However, most distributed algorithms currently work in a master-slave mode, often including a central server for coordination, which to some extent will cause communication pressure, data leakage, privacy violations and other issues. To solve these problems, a decentralized fully distributed algorithm based on deep random weight neural network is proposed. The algorithm decomposes the original objective function into several sub-problems under consistency constraints, combines the decentralized average consensus (DAC) and alternating direction method of multipliers (ADMM), and achieves the goal of joint modeling and training through local calculation and communication of each node. Finally, we compare the proposed decentralized algorithm with several centralized deep neural networks with random weights, and experimental results demonstrate the effectiveness of the proposed algorithm.展开更多
The ocean plays an important role in maintaining the equilibrium of Earth’s ecology and providing humans access to a wealth of resources.To obtain a high-precision underwater image classification model,we propose a c...The ocean plays an important role in maintaining the equilibrium of Earth’s ecology and providing humans access to a wealth of resources.To obtain a high-precision underwater image classification model,we propose a classification model that combines an EfficientnetB0 neural network and a two-hidden-layer random vector functional link network(EfficientnetB0-TRVFL).The features of underwater images were extracted using the EfficientnetB0 neural network pretrained via ImageNet,and a new fully connected layer was trained on the underwater image dataset using the transfer learning method.Transfer learning ensures the initial performance of the network and helps in the development of a high-precision classification model.Subsequently,a TRVFL was proposed to improve the classification property of the model.Net construction of the two hidden layers exhibited a high accuracy when the same hidden layer nodes were used.The parameters of the second hidden layer were obtained using a novel calculation method,which reduced the outcome error to improve the performance instability caused by the random generation of parameters of RVFL.Finally,the TRVFL classifier was used to classify features and obtain classification results.The proposed EfficientnetB0-TRVFL classification model achieved 87.28%,74.06%,and 99.59%accuracy on the MLC2008,MLC2009,and Fish-gres datasets,respectively.The best convolutional neural networks and existing methods were stacked up through box plots and Kolmogorov-Smirnov tests,respectively.The increases imply improved systematization properties in underwater image classification tasks.The image classification model offers important performance advantages and better stability compared with existing methods.展开更多
Based on the research of predictingβ-hairpin motifs in proteins, we apply Random Forest and Support Vector Machine algorithm to predictβ-hairpin motifs in ArchDB40 dataset. The motifs with the loop length of 2 to 8 ...Based on the research of predictingβ-hairpin motifs in proteins, we apply Random Forest and Support Vector Machine algorithm to predictβ-hairpin motifs in ArchDB40 dataset. The motifs with the loop length of 2 to 8 amino acid residues are extracted as research object and thefixed-length pattern of 12 amino acids are selected. When using the same characteristic parameters and the same test method, Random Forest algorithm is more effective than Support Vector Machine. In addition, because of Random Forest algorithm doesn’t produce overfitting phenomenon while the dimension of characteristic parameters is higher, we use Random Forest based on higher dimension characteristic parameters to predictβ-hairpin motifs. The better prediction results are obtained;the overall accuracy and Matthew’s correlation coefficient of 5-fold cross-validation achieve 83.3% and 0.59, respectively.展开更多
社交网络中,节点间存在多种关系类型,节点数量会随着时间的推移而变化,这种异质性和动态性给链路预测任务带来极大的挑战。因此,本文提出一种基于增量学习的社交网络链路预测方法(incremental learning social networks link prediction...社交网络中,节点间存在多种关系类型,节点数量会随着时间的推移而变化,这种异质性和动态性给链路预测任务带来极大的挑战。因此,本文提出一种基于增量学习的社交网络链路预测方法(incremental learning social networks link prediction,IL-SNLP)。通过对网络进行分层,使每一层网络只包含一种关系类型,以更好地获取节点在每种关系类型下的语义信息;针对网络的动态性,利用时序随机游走捕获社交网络中的局部结构信息和时序信息;针对增量数据,采用增量式更新随机游走策略对历史随机游走序列进行更新。通过增量式skip-gram模型从随机游走序列中提取新出现节点的特征,并进一步更新历史节点的特征;针对网络的异质性,采用概率模型提取不同关系类型之间的因果关系关联程度,并将其作用于每一层的节点特征,以改善不同关系层下节点特征表现能力;利用多层感知机构建节点相互感知器,挖掘节点间建立连接时的相互贡献,实现更高的链路预测准确率。实验结果表明,在3个真实的社交网络数据集上,IL-SNLP方法的ROC曲线下的面积(AUC)和F1分数比基线方法分别提高了10.08%~67.60%和1.76%~64.67%,提升了预测性能;对于增量数据,只需要少次迭代就能保持预测模型的性能,提高了模型训练的速度;与未采用增量学习技术的IL-SNLP−方法相比,IL-SNLP方法在时间效率上提升了30.78%~257.58%,显著缩短了模型的运行时长。展开更多
针对传统的增量式支持向量机（Incremental Support Vector Machine,ISVM）在处理数据集时易受数据噪声和学习过程中振荡问题影响的缺点,将改进的核函数U-RBF和构造备用集的同心圆方法相结合,提出了基于备用集的增量式支持向量机（Reser...针对传统的增量式支持向量机（Incremental Support Vector Machine,ISVM）在处理数据集时易受数据噪声和学习过程中振荡问题影响的缺点,将改进的核函数U-RBF和构造备用集的同心圆方法相结合,提出了基于备用集的增量式支持向量机（Reserved Set-Incremental Support Vector Machine,RS-ISVM）方法。该方法首先将特征属性的均值和均方差值嵌入到核函数RBF中,并通过同心圆方法将后续学习过程中最有可能成为支持向量的样本划入备用集。入侵检测实验证明RS-ISVM能够降低学习过程的振荡现象,提高了学习的速度,有非常好的性能和可靠性。展开更多
提出一种用最小二乘支持向量机(least squares support vector machine,LS-SVM)构造函数链接型神经网络(functional link artificial neural networks,FLANN)的滚动轴承故障诊断系统。介绍了相关原理和具体算法,并给出了滚动轴承故障诊...提出一种用最小二乘支持向量机(least squares support vector machine,LS-SVM)构造函数链接型神经网络(functional link artificial neural networks,FLANN)的滚动轴承故障诊断系统。介绍了相关原理和具体算法,并给出了滚动轴承故障诊断系统模型。首先,采用LS-SVM模型核函数代替常规FLANN模型的扩展函数,避免了扩展函数选择的任意性;其次,利用LS-SVM学习模型得到FLANN权重系数,避免了BP方法多次迭代寻优存在的耗时长、局部极小及迭代设置初值依赖经验等不足;最后,构造了多层LS-SVM-FLANN结构,对多类滚动轴承故障进行诊断。具体实验表明,用LS-SVM构造FLANN的滚动轴承故障识别系统精度高、鲁棒性好、实现简单。展开更多
Direct online measurement on product quality of industrial processes is difficult to be realized,which leads to a large number of unlabeled samples in modeling data.Therefore,it needs to employ semi-supervised learnin...Direct online measurement on product quality of industrial processes is difficult to be realized,which leads to a large number of unlabeled samples in modeling data.Therefore,it needs to employ semi-supervised learning(SSL)method to establish the soft sensor model of product quality.Considering the slow time-varying characteristic of industrial processes,the model parameters should be updated smoothly.According to this characteristic,this paper proposes an online adaptive semi-supervised learning algorithm based on random vector functional link network(RVFLN),denoted as OAS-RVFLN.By introducing a L2-fusion term that can be seen a weight deviation constraint,the proposed algorithm unifies the offline and online learning,and achieves smoothness of model parameter update.Empirical evaluations both on benchmark testing functions and datasets reveal that the proposed OAS-RVFLN can outperform the conventional methods in learning speed and accuracy.Finally,the OAS-RVFLN is applied to the coal dense medium separation process in coal industry to estimate the ash content of coal product,which further verifies its effectiveness and potential of industrial application.展开更多
基金Item Sponsored by National Natural Science Foundation of China(61290323,61333007,61473064)Fundamental Research Funds for Central Universities of China(N130108001)+1 种基金National High Technology Research and Development Program of China(2015AA043802)General Project on Scientific Research for Education Department of Liaoning Province of China(L20150186)
文摘Molten iron temperature as well as Si, P, and S contents is the most essential molten iron quality （MIQ） indices in the blast furnace （BF） ironmaking, which requires strict monitoring during the whole ironmaking production. However, these MIQ parameters are difficult to be directly measured online, and large-time delay exists in off-line analysis through laboratory sampling. Focusing on the practical challenge, a data-driven modeling method was presented for the prediction of MIQ using the improved muhivariable incremental random vector functional-link net- works （M-I-RVFLNs）. Compared with the conventional random vector functional-link networks （RVFLNs） and the online sequential RVFLNs, the M-I-RVFLNs have solved the problem of deciding the optimal number of hidden nodes and overcome the overfitting problems. Moreover, the proposed M I RVFLNs model has exhibited the potential for multivariable prediction of the MIQ and improved the terminal condition for the multiple-input multiple-out- put （MIMO） dynamic system, which is suitable for the BF ironmaking process in practice. Ultimately, industrial experiments and contrastive researches have been conducted on the BF No. 2 in Liuzhou Iron and Steel Group Co. Ltd. of China using the proposed method, and the results demonstrate that the established model produces better estima ting accuracy than other MIQ modeling methods.
文摘In the contemporary era, the proliferation of information technology has led to an unprecedented surge in data generation, with this data being dispersed across a multitude of mobile devices. Facing these situations and the training of deep learning model that needs great computing power support, the distributed algorithm that can carry out multi-party joint modeling has attracted everyone’s attention. The distributed training mode relieves the huge pressure of centralized model on computer computing power and communication. However, most distributed algorithms currently work in a master-slave mode, often including a central server for coordination, which to some extent will cause communication pressure, data leakage, privacy violations and other issues. To solve these problems, a decentralized fully distributed algorithm based on deep random weight neural network is proposed. The algorithm decomposes the original objective function into several sub-problems under consistency constraints, combines the decentralized average consensus (DAC) and alternating direction method of multipliers (ADMM), and achieves the goal of joint modeling and training through local calculation and communication of each node. Finally, we compare the proposed decentralized algorithm with several centralized deep neural networks with random weights, and experimental results demonstrate the effectiveness of the proposed algorithm.
基金support of the National Key R&D Program of China(No.2022YFC2803903)the Key R&D Program of Zhejiang Province(No.2021C03013)the Zhejiang Provincial Natural Science Foundation of China(No.LZ20F020003).
文摘The ocean plays an important role in maintaining the equilibrium of Earth’s ecology and providing humans access to a wealth of resources.To obtain a high-precision underwater image classification model,we propose a classification model that combines an EfficientnetB0 neural network and a two-hidden-layer random vector functional link network(EfficientnetB0-TRVFL).The features of underwater images were extracted using the EfficientnetB0 neural network pretrained via ImageNet,and a new fully connected layer was trained on the underwater image dataset using the transfer learning method.Transfer learning ensures the initial performance of the network and helps in the development of a high-precision classification model.Subsequently,a TRVFL was proposed to improve the classification property of the model.Net construction of the two hidden layers exhibited a high accuracy when the same hidden layer nodes were used.The parameters of the second hidden layer were obtained using a novel calculation method,which reduced the outcome error to improve the performance instability caused by the random generation of parameters of RVFL.Finally,the TRVFL classifier was used to classify features and obtain classification results.The proposed EfficientnetB0-TRVFL classification model achieved 87.28%,74.06%,and 99.59%accuracy on the MLC2008,MLC2009,and Fish-gres datasets,respectively.The best convolutional neural networks and existing methods were stacked up through box plots and Kolmogorov-Smirnov tests,respectively.The increases imply improved systematization properties in underwater image classification tasks.The image classification model offers important performance advantages and better stability compared with existing methods.
文摘Based on the research of predictingβ-hairpin motifs in proteins, we apply Random Forest and Support Vector Machine algorithm to predictβ-hairpin motifs in ArchDB40 dataset. The motifs with the loop length of 2 to 8 amino acid residues are extracted as research object and thefixed-length pattern of 12 amino acids are selected. When using the same characteristic parameters and the same test method, Random Forest algorithm is more effective than Support Vector Machine. In addition, because of Random Forest algorithm doesn’t produce overfitting phenomenon while the dimension of characteristic parameters is higher, we use Random Forest based on higher dimension characteristic parameters to predictβ-hairpin motifs. The better prediction results are obtained;the overall accuracy and Matthew’s correlation coefficient of 5-fold cross-validation achieve 83.3% and 0.59, respectively.
文摘社交网络中,节点间存在多种关系类型,节点数量会随着时间的推移而变化,这种异质性和动态性给链路预测任务带来极大的挑战。因此,本文提出一种基于增量学习的社交网络链路预测方法(incremental learning social networks link prediction,IL-SNLP)。通过对网络进行分层,使每一层网络只包含一种关系类型,以更好地获取节点在每种关系类型下的语义信息;针对网络的动态性,利用时序随机游走捕获社交网络中的局部结构信息和时序信息;针对增量数据,采用增量式更新随机游走策略对历史随机游走序列进行更新。通过增量式skip-gram模型从随机游走序列中提取新出现节点的特征,并进一步更新历史节点的特征;针对网络的异质性,采用概率模型提取不同关系类型之间的因果关系关联程度,并将其作用于每一层的节点特征,以改善不同关系层下节点特征表现能力;利用多层感知机构建节点相互感知器,挖掘节点间建立连接时的相互贡献,实现更高的链路预测准确率。实验结果表明,在3个真实的社交网络数据集上,IL-SNLP方法的ROC曲线下的面积(AUC)和F1分数比基线方法分别提高了10.08%~67.60%和1.76%~64.67%,提升了预测性能;对于增量数据,只需要少次迭代就能保持预测模型的性能,提高了模型训练的速度;与未采用增量学习技术的IL-SNLP−方法相比,IL-SNLP方法在时间效率上提升了30.78%~257.58%,显著缩短了模型的运行时长。
文摘针对传统的增量式支持向量机（Incremental Support Vector Machine,ISVM）在处理数据集时易受数据噪声和学习过程中振荡问题影响的缺点,将改进的核函数U-RBF和构造备用集的同心圆方法相结合,提出了基于备用集的增量式支持向量机（Reserved Set-Incremental Support Vector Machine,RS-ISVM）方法。该方法首先将特征属性的均值和均方差值嵌入到核函数RBF中,并通过同心圆方法将后续学习过程中最有可能成为支持向量的样本划入备用集。入侵检测实验证明RS-ISVM能够降低学习过程的振荡现象,提高了学习的速度,有非常好的性能和可靠性。
文摘提出一种用最小二乘支持向量机(least squares support vector machine,LS-SVM)构造函数链接型神经网络(functional link artificial neural networks,FLANN)的滚动轴承故障诊断系统。介绍了相关原理和具体算法,并给出了滚动轴承故障诊断系统模型。首先,采用LS-SVM模型核函数代替常规FLANN模型的扩展函数,避免了扩展函数选择的任意性;其次,利用LS-SVM学习模型得到FLANN权重系数,避免了BP方法多次迭代寻优存在的耗时长、局部极小及迭代设置初值依赖经验等不足;最后,构造了多层LS-SVM-FLANN结构,对多类滚动轴承故障进行诊断。具体实验表明,用LS-SVM构造FLANN的滚动轴承故障识别系统精度高、鲁棒性好、实现简单。
基金Projects(61603393,61973306)supported in part by the National Natural Science Foundation of ChinaProject(BK20160275)supported by the Natural Science Foundation of Jiangsu Province,China+1 种基金Projects(2015M581885,2018T110571)supported by the Postdoctoral Science Foundation of ChinaProject(PAL-N201706)supported by the Open Project Foundation of State Key Laboratory of Synthetical Automation for Process Industries of Northeastern University,China
文摘Direct online measurement on product quality of industrial processes is difficult to be realized,which leads to a large number of unlabeled samples in modeling data.Therefore,it needs to employ semi-supervised learning(SSL)method to establish the soft sensor model of product quality.Considering the slow time-varying characteristic of industrial processes,the model parameters should be updated smoothly.According to this characteristic,this paper proposes an online adaptive semi-supervised learning algorithm based on random vector functional link network(RVFLN),denoted as OAS-RVFLN.By introducing a L2-fusion term that can be seen a weight deviation constraint,the proposed algorithm unifies the offline and online learning,and achieves smoothness of model parameter update.Empirical evaluations both on benchmark testing functions and datasets reveal that the proposed OAS-RVFLN can outperform the conventional methods in learning speed and accuracy.Finally,the OAS-RVFLN is applied to the coal dense medium separation process in coal industry to estimate the ash content of coal product,which further verifies its effectiveness and potential of industrial application.
