Designing appropriate loss functions is critical to the success of supervised learning models.However,most conventional losses are fixed and manually designed,making them suboptimal for diverse and dynamic learning sc...Designing appropriate loss functions is critical to the success of supervised learning models.However,most conventional losses are fixed and manually designed,making them suboptimal for diverse and dynamic learning scenarios.In this work,we propose an Adaptive Meta-Loss Network(Adaptive-MLN)that learns to generate taskagnostic loss functions tailored to evolving classification problems.Unlike traditional methods that rely on static objectives,Adaptive-MLN treats the loss function itself as a trainable component,parameterized by a shallow neural network.To enable flexible,gradient-free optimization,we introduce a hybrid evolutionary approach that combines GeneticAlgorithms(GA)for global exploration and Evolution Strategies(ES)for local refinement.This co-evolutionary process dynamically adjusts the loss landscape,improvingmodel generalization without relying on analytic gradients or handcrafted heuristics.Experimental evaluations on synthetic tasks and the CIFAR-10 andMNIST datasets demonstrate that our approach consistently outperforms standard losses such as Cross-Entropy and Mean Squared Error in terms of accuracy,convergence,and adaptability.展开更多
Accurate prediction of formation pore pressure is essential to predict fluid flow and manage hydrocarbon production in petroleum engineering.Recent deep learning technique has been receiving more interest due to the g...Accurate prediction of formation pore pressure is essential to predict fluid flow and manage hydrocarbon production in petroleum engineering.Recent deep learning technique has been receiving more interest due to the great potential to deal with pore pressure prediction.However,most of the traditional deep learning models are less efficient to address generalization problems.To fill this technical gap,in this work,we developed a new adaptive physics-informed deep learning model with high generalization capability to predict pore pressure values directly from seismic data.Specifically,the new model,named CGP-NN,consists of a novel parametric features extraction approach(1DCPP),a stacked multilayer gated recurrent model(multilayer GRU),and an adaptive physics-informed loss function.Through machine training,the developed model can automatically select the optimal physical model to constrain the results for each pore pressure prediction.The CGP-NN model has the best generalization when the physicsrelated metricλ=0.5.A hybrid approach combining Eaton and Bowers methods is also proposed to build machine-learnable labels for solving the problem of few labels.To validate the developed model and methodology,a case study on a complex reservoir in Tarim Basin was further performed to demonstrate the high accuracy on the pore pressure prediction of new wells along with the strong generalization ability.The adaptive physics-informed deep learning approach presented here has potential application in the prediction of pore pressures coupled with multiple genesis mechanisms using seismic data.展开更多
基金supported by the National Natural Science Foundation of China(NSFC)under Grant number:82171965.
文摘Designing appropriate loss functions is critical to the success of supervised learning models.However,most conventional losses are fixed and manually designed,making them suboptimal for diverse and dynamic learning scenarios.In this work,we propose an Adaptive Meta-Loss Network(Adaptive-MLN)that learns to generate taskagnostic loss functions tailored to evolving classification problems.Unlike traditional methods that rely on static objectives,Adaptive-MLN treats the loss function itself as a trainable component,parameterized by a shallow neural network.To enable flexible,gradient-free optimization,we introduce a hybrid evolutionary approach that combines GeneticAlgorithms(GA)for global exploration and Evolution Strategies(ES)for local refinement.This co-evolutionary process dynamically adjusts the loss landscape,improvingmodel generalization without relying on analytic gradients or handcrafted heuristics.Experimental evaluations on synthetic tasks and the CIFAR-10 andMNIST datasets demonstrate that our approach consistently outperforms standard losses such as Cross-Entropy and Mean Squared Error in terms of accuracy,convergence,and adaptability.
基金funded by the National Natural Science Foundation of China(General Program:No.52074314,No.U19B6003-05)National Key Research and Development Program of China(2019YFA0708303-05)。
文摘Accurate prediction of formation pore pressure is essential to predict fluid flow and manage hydrocarbon production in petroleum engineering.Recent deep learning technique has been receiving more interest due to the great potential to deal with pore pressure prediction.However,most of the traditional deep learning models are less efficient to address generalization problems.To fill this technical gap,in this work,we developed a new adaptive physics-informed deep learning model with high generalization capability to predict pore pressure values directly from seismic data.Specifically,the new model,named CGP-NN,consists of a novel parametric features extraction approach(1DCPP),a stacked multilayer gated recurrent model(multilayer GRU),and an adaptive physics-informed loss function.Through machine training,the developed model can automatically select the optimal physical model to constrain the results for each pore pressure prediction.The CGP-NN model has the best generalization when the physicsrelated metricλ=0.5.A hybrid approach combining Eaton and Bowers methods is also proposed to build machine-learnable labels for solving the problem of few labels.To validate the developed model and methodology,a case study on a complex reservoir in Tarim Basin was further performed to demonstrate the high accuracy on the pore pressure prediction of new wells along with the strong generalization ability.The adaptive physics-informed deep learning approach presented here has potential application in the prediction of pore pressures coupled with multiple genesis mechanisms using seismic data.
