内嵌物理知识神经网络(PINN)文献总结

PINN论文集：包含论文链接以及论文笔记链接

PINN介绍

综述论文

• Informed Machine Learning – A Taxonomy and Survey of Integrating Prior Knowledge into Learning Systems
• Integrating physics-based modeling with machine learning: A survey

1 定义问题, 建立工程架构Integrating physics-based modeling with machine learning: A survey

• Physics-informed neural networks: A deep learning framework for solving forward and inverse
  problems involving nonlinear partial differential equations
  用内嵌物理信息的神经网络求解PDE的源头文章，从数据驱动角度提出PINN，求解PDE正逆问题
• DGM: A deep learning algorithm for solving partial differential equations
  对于高维PDE用数值方法不能求解，提出DGM方法即用神经网络求解高维PDE问题，同时提出用Monte Carlo估计方法代替PDE中的二阶导数能够加速学习
• hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decomposition
  采用变分区域的方式对区域内采点，这是一种启发式的踩点方法，在准确性上有所提升.
• Physics-informed neural networks for inverse problems in nano-optics and metamaterials
  用PINN求解材料PDE问题中的参数，求解逆问题，使用的最常规的PINN，主要是结合了材料相关背景.
• Physics-Informed Neural Networks for Cardiac Activation Mapping
• DeepXDE: A deep learning library for solving differential equations
  提出了基于PINN的一个求解各类PDE的库.
• Deep learning-based method coupled with small sample learning for solving partial differential equation
  特意将损失项中的data loss提出来说这是小样本学习，相比于Rassi的PINN增加data loss项，并与其对比，复现了文章中的算例，增加了一项loss后在准确度上有所提高

2 网络结构选择

• Prevention is Better than Cure: Handling Basis Collapse and Transparency in Dense Networks
  对于网络设计的思考，提出了Basis Collapse的概念，提出给损失函数增加一个构造的惩罚项，能够使用lower-weight net实现相同甚至更好的函数拟合效果.
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems
• Weak adversarial networks for high-dimensional partial differential equation

3 不确定性结合

• Adversarial Uncertainty Quantification in Physics-Informed Neural Network
• B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data
• Flow Field Tomography with Uncertainty Quantification using a Bayesian Physics-Informed Neural Network
• Physics-Informed Deep Learning: A Promising Technique for System Reliability Assessment
• Wasserstein Generative Adversarial Uncertainty Quantification in Physics-Informed Neural Networks
  arxiv
• A Physics-Data-Driven Bayesian Method for Heat Conduction Problems

4 超参与元学习

• Learning and Meta-Learning of Stochastic Advection-Diffusion-Reaction Systems from Sparse Measuremen
  用PINN求解随机反应扩散方程，这里主要用了元学习中的贝叶斯优化算法对网络层数和宽度进行优化.
• Bilevel Programming for Hyperparameter Optimization and Meta-Learning
• On First-Order Meta-Learning Algorithms

5 区域划分

• DPINN: Distributed physics informed neural network for data-efficient solution to partial differential equations
  考虑到PINN的较大计算域内梯度极度下降时梯度不够稳健，而且PINN的深度随着PDE阶数的增加而增加，由于会导致出现消失梯度，导致学习速率变慢的问题。

• cPINN: Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems
  同样使用区域划分，直接横着划分成矩形区域，而DPINN横着竖着划分为的矩形区域

• Extended Physics-InformedNeural Networks (XPINNs): A Generalized Space-Time Domain

• Decomposition Based Deep Learning Framework
  提出了更灵活分解域的XPINN方法，比cPINN区域分解更灵活，而且使用与所有方程。

• Conservative physics-informed neural networks on discrete domains for conservation laws: Applications to forward and inverse problems
  对求解区域划分sub-domains，提出conservative physics-informed neural network(cPINN)，这样的好处一个也可以使用深度神经网络在领域，解决方案可能有复杂的结构，而浅层神经网络可以在子领域使用相对简单和平滑的解决方案. 该方法的另一个优点是在优化算法的选择和各种训练参数如残差点、激活函数、网络宽度和深度等方面提供了更多的自由. 本文简要讨论了cPINN中涉及的各种误差形式，如优化误差、泛化误差和近似误差及其来源.

6 逆问题论文阅读

• Neural Network Technique in Some Inverse Problems of Mathematical Physics Vladimir
  损失函数的定义也用到了类似PINN的思路，用了RBF-net，选择Morozov’s condition作为收敛条件（即损失函数中某一项低于界）；增加神经元的方法，看增加了后的损失函数有没有减，有减少说明增加是有益的。
• Deep Neural Network Approach to Forward-Inverse Problems
  主要是对正、逆问题收敛进行了证明，算了几个简单方程
• Estimates on the generalization error of Physics Informed Neural Networks (PINNs) for approximating PDEs II: A class of inverse problems
  对逆问题的泛化误差的界进行了推导，用到的算例方程有真解都可以借鉴。

7 Loss权重修改与优化算法

• DPINN: Distributed physics informed neural network for data-efficient solution to partial differential equations

• A Derivative-Free Method for Solving Elliptic Partial Differential Equations with Deep Neural Networks

• Neural networks catching up with finite differences in solving partial differential equations in higher dimensions

• Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics

• Understanding and mitigating gradient pathologies in physics-informed neural networks.
  回顾了科学机器学习的进展，特别是内嵌物理信息的神经网络在预测物理系统输出以及从噪音数据发现潜在的物理方面信息的有效性. 我们还将识别和分析这种方法的基本失效模式，它与在模型训练过程中导致不平衡的反向传播梯度的数值刚度(stiffness)有关. 为了解决这一局限性，我们提出了一种学习率退火算法，该算法在模型训练期间利用梯度统计量来平衡损失函数中不同项之间的相互影响. 我们还提出了一种新的神经网络结构，它对这种梯度病理(gradient pathologies)更有弹性

• Modified physics-informed neural network method based on the conservation law constraint and its prediction of optical solitons
  arxiv, 提出了基于守恒定律的PINN，主要是针对高阶非线性薛定谔方程，结合这个方程特性，有能量守恒方程和动量守恒方程，将其作为约束加入损失函数中，相比于经典PINN（PDE loss， BC loss，IC loss），能够求得更准。

• Self-adaptive physics-informed neural networks using a soft attention mechanism

• Self-adaptive loss balanced physics-informed neural networks for the incompressible navier-stokes equations
  自适应损失函数权重用于流体方程求解

• Understanding and mitigating gradient pathologies in physics-informwd neural networks

• Multi-objective loss balancing for physics-informed deep learning里面对损失函数自适应权重有综述

8 与迁移学习结合

• Transfer learning based multi-fidelity physics informed deep neural network
  利用多置信度求解PDE，先利用low-fidelity data 训练网络模型，然后再利用high-fidelity对网络最后两层微调.
• Transfer learning enhanced physics informed neural network for phase-field modeling of fracture
  对传统的基于残差的PINN，改变了优化对象通过minimize the variational energy of the system. 与传统的基于残差的PINN相比，该方法有两个主要优点。首先，边界条件的施加相对简单，也更稳健. 其次，变分能量函数形式下的导数的阶数比传统PINN中使用的残差形式下的导数的阶数低，因此网络的训练速度更快

9 与元学习结合

• A novel meta-learning initialization method for physics-informed neural networks
  提出了一种用于PINN加速的元初始化方法，从相关任务中学习能够实现在新任务上快速收敛的结果
• Meta-learning PINN loss functions将元学习的思想用于PINN的损失函数中

10 应用论文

10.1 波场

• Physics-informed neural network for ultrasound nondestructive quantification of surface breaking cracks
  PINN是监督对现实超声表面声波数据的监督学习采集频率为5 MH. 。超声波表面波数据表示为金属板顶表面的表面变形，用激光振动法测量. 利用声波波动方程的物理信息，利用自适应激活函数加速了PINN的收敛. 自适应激活函数在激活函数中使用了一个可伸缩的超参数，该超参数经过优化，可以在网络拓扑结构发生动态变化时获得最佳性能. 主要是利用PINN求解PDE，然后利用自适应激活函数加速（对比之下加速效果也并不明显）
• A physics-informed variational DeepONet for predicting the crack path in brittle materials
  arxiv
• A modified physics-informed neural network with positional encoding
  求解Helmholtz equation，应用领域波场
• WAVEFIELD RECONSTRUCTION INVERSION VIA PHYSICS-INFORMED NEURAL NETWORKS、
  求解Helmholtz equation，应用领域波场

10.2 压力

• Physics-informed neural networks for estimating stress transfer mechanics in single lap joints
  数据驱动求解table的压力和the interphase of a single lap joint

10.3 electromagnetic simulation

• Physics-augmented deep learning for high-speed electromagnetic simulation and
  optimization
  Nature Portfolio Journal preprint

10.4 流体

• FlowDNN: a physics-informed deep neural network for fast and accurate flow prediction
• Physics-informed neural networks for high-speed flows
  隐藏流体力学
• Physics-Informed Neural Networks for Cardiac Activation Mapping
  心脏激活图
• DiscretizationNet: A Machine-Learning based solver for Navier-Stokes Equations using Finite Volume Discretization
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations

10.5 单独涉及求解方程

• Solving Huxley equation using an improved PINN method
• Physics-informed neural networks for solving nonlinear diffusivity and Biot’s equations
  研究如何扩展物理信息神经网络的方法来解决与非线性扩散率和Biot方程有关的正问题和反问题. 我们探讨了具有不同训练样例大小和超参数选择的基于物理的神经网络的准确性. 研究了随机变量对不同训练实现的影响.
• fPINNs: Fractional Physics-Informed Neural Networks
• A Physics Informed Neural Network Approach to Solution and Identification of Biharmonic Equations of Elasticity
  arxiv
• Deep neural network methods for solving forward and inverse problems of time fractional diffusion equations with conformable derivative
  arxiv, 首次提出用pinn来研究conformable time fractional diffusion
• Learn bifurcations of nonlinear parametric systems via equation-driven neural networks
  arxiv，提出了一种新的机器学习方法，通过所谓的方程驱动神经网络(EDNNs)来计算分岔。该网络由两步优化组成:第一步是通过训练经验解数据来逼近参数的解函数；第二步是利用第一步得到的近似神经网络计算bifurcations(分岔)
• Variational Onsager Neural Networks (VONNs): A thermodynamics-based variational learning strategy for non-equilibrium PDEs
  arxiv，基于Onsager’s variational principle
• DiscretizationNet: A Machine-Learning based solver for Navier-Stokes Equations using Finite Volume Discretization
• NSFnets (Navier-Stokes Flow nets): Physics-informed neural networks for the incompressible Navier-Stokes equations
• Self-adaptive loss balanced Physics-informed neural networks for the incompressible Navier-Stokes equations

10.6 医学

• Physics-informed machine learning improves detection of head impacts
• EP-PINNs: Cardiac Electrophysiology Characterisation using Physics-Informed Neural Networks
  arxiv

10.7 地址勘测

• Physics-informed semantic inpainting: Application to geostatistical modeling

10.8 subsurface transport

• Physics-informed neural networks for multiphysics data assimilation with application to subsurface transport
  主要利用PINN解决steady-state advection–dispersion problem

10.9 Fiber Optics和材料

• Physics-informed Neural Network for Nonlinear Dynamics in Fiber Optics
  主要就是解决非线性薛定谔方程，定义了Nonlinear Dynamics in Fiber Optics(由薛定谔方程控制)
• Physics-informed neural network for modelling the thermochemical curing process of composite-tool systems during manufactureCMAME

11 其他

• Discovering Physical Concepts with Neural Networks

11.1 物理知识与数值方法结合

• Physics-informed dynamic mode decomposition
  将物理知识嵌入动态模态求解中提出了physics-informed DMD (piDMD) optimization

12 PINN的加速研究

13 基于PINN的求解库

• DEEPXDE: A DEEP LEARNING LIBRARY FOR SOL VING DIFFERENTIAL EQUATIONS
• IDRLnet: A Physics-Informed Neural Network Library
• PND: Physics-informed neural-network software for molecular dynamics application
  Integrating physics-based modeling with machine learning: A survey

原创不易，转载请带上原文链接，喜欢可关注，后续会不断更新

版权声明：本文为CSDN博主「pinn山里娃」的原创文章，遵循CC 4.0 BY-SA版权协议，转载请附上原文出处链接及本声明。
原文链接：https://blog.csdn.net/weixin_45521594/article/details/120074898