Parand, Kourosh
Advanced Physics-Informed Neural Network with Residuals for Solving Complex Integral Equations
Moghaddam, Mahdi Movahedian, Parand, Kourosh, Kheradpisheh, Saeed Reza
Integral and integro-differential equations are foundational tools in many fields of science and engineering, modeling a wide range of phenomena from physics and biology to economics and engineering systems [1-3]. These equations describe processes that depend not only on local variables but also on historical or spatial factors, making them essential for understanding systems with memory effects, hereditary characteristics, and long-range interactions [4-7]. Despite their importance, solving integral and integro-differential equations is a challenging task due to the complexity of their integral operators, especially when extended to multi-dimensional or fractional forms [2, 8]. Classical numerical methods, such as finite difference [9, 10], finite element [11, 12], and spectral methods [13-15], have long been used to approximate solutions to these equations. However, these methods often suffer from several limitations.
Hermite Neural Network Simulation for Solving the 2D Schrodinger Equation
Parand, Kourosh, Pakniyat, Aida
The Schrodinger equation is a mathematical equation describing the wave function's behavior in a quantum-mechanical system. It is a partial differential equation that provides valuable insights into the fundamental principles of quantum mechanics. In this paper, the aim was to solve the Schrodinger equation with sufficient accuracy by using a mixture of neural networks with the collocation method base Hermite functions. Initially, the Hermite functions roots were employed as collocation points, enhancing the efficiency of the solution. The Schrodinger equation is defined in an infinite domain, the use of Hermite functions as activation functions resulted in excellent precision. Finally, the proposed method was simulated using MATLAB's Simulink tool. The results were then compared with those obtained using Physics-informed neural networks and the presented method.
An Orthogonal Polynomial Kernel-Based Machine Learning Model for Differential-Algebraic Equations
Taheri, Tayebeh, Aghaei, Alireza Afzal, Parand, Kourosh
A system of differential-algebraic equations (DAEs) is a combination of differential equations and algebraic equations, in which the differential equations are related to the dynamical evolution of the system, and the algebraic equations are responsible for constraining the solutions that satisfy the differential and algebraic equations. DAEs serve as essential models for a wide array of physical phenomena. They find applications across various domains such as mechanical systems, electrical circuit simulations, chemical process modeling, dynamic system control, biological simulations, and control systems. Consequently, solving these intricate differential equations has remained a significant challenge for researchers. To address this, a range of techniques including numerical, analytical, and semi-analytical methods have been employed to tackle the complexities inherent in solving DAEs.
Accelerating Fractional PINNs using Operational Matrices of Derivative
Taheri, Tayebeh, Aghaei, Alireza Afzal, Parand, Kourosh
This paper presents a novel operational matrix method to accelerate the training of fractional Physics-Informed Neural Networks (fPINNs). Our approach involves a non-uniform discretization of the fractional Caputo operator, facilitating swift computation of fractional derivatives within Caputo-type fractional differential problems with $0<\alpha<1$. In this methodology, the operational matrix is precomputed, and during the training phase, automatic differentiation is replaced with a matrix-vector product. While our methodology is compatible with any network, we particularly highlight its successful implementation in PINNs, emphasizing the enhanced accuracy achieved when utilizing the Legendre Neural Block (LNB) architecture. LNB incorporates Legendre polynomials into the PINN structure, providing a significant boost in accuracy. The effectiveness of our proposed method is validated across diverse differential equations, including Delay Differential Equations (DDEs) and Systems of Differential Algebraic Equations (DAEs). To demonstrate its versatility, we extend the application of the method to systems of differential equations, specifically addressing nonlinear Pantograph fractional-order DDEs/DAEs. The results are supported by a comprehensive analysis of numerical outcomes.
deepFDEnet: A Novel Neural Network Architecture for Solving Fractional Differential Equations
Firoozsalari, Ali Nosrati, Mazraeh, Hassan Dana, Aghaei, Alireza Afzal, Parand, Kourosh
The primary goal of this research is to propose a novel architecture for a deep neural network that can solve fractional differential equations accurately. A Gaussian integration rule and a $L_1$ discretization technique are used in the proposed design. In each equation, a deep neural network is used to approximate the unknown function. Three forms of fractional differential equations have been examined to highlight the method's versatility: a fractional ordinary differential equation, a fractional order integrodifferential equation, and a fractional order partial differential equation. The results show that the proposed architecture solves different forms of fractional differential equations with excellent precision.
Solving Falkner-Skan type equations via Legendre and Chebyshev Neural Blocks
Aghaei, Alireza Afzal, Parand, Kourosh, Nikkhah, Ali, Jaberi, Shakila
In this paper, a new deep-learning architecture for solving the non-linear Falkner-Skan equation is proposed. Using Legendre and Chebyshev neural blocks, this approach shows how orthogonal polynomials can be used in neural networks to increase the approximation capability of artificial neural networks. In addition, utilizing the mathematical properties of these functions, we overcome the computational complexity of the backpropagation algorithm by using the operational matrices of the derivative. The efficiency of the proposed method is carried out by simulating various configurations of the Falkner-Skan equation.