DeepMartNet – A Martingale based Deep Neural Network Learning Algorithm for Eigenvalue/BVP Problems and Optimal Stochastic Controls

We could define a different generator \mathcal{L} by not including {\mu} ^{\top}\nabla in (?), then the Martingale in (?) will be changed to

(Mini-batch in SGD training and Martingale property) Due to the equivalence between (?) and (?), the loss function defined above ensures that M_{t} of (?) for u_{\theta }(\mathbf{x}) will be a Martingale approximately if the mini-batch A_{i} explores all subsets of the sample space \Omega^{\prime} during the SGD optimization process of the training, and the sample size M=|\Omega^{\prime}| \rightarrow \infty,the time step \max|\Delta t_{i}|\rightarrow0, and the training converges.

Also, if we take A_{i}=\Omega^{\prime} for all i, there will be no stochasticity in the gradient calculation for the loss function, we will have a traditional full gradient descent method and the full Martingale property for u_{\theta }(\mathbf{x}) is not enforced either. Therefore, the mini-batch practice in DNN SGD optimization corresponds perfectly with the Martingale definition (?).

(regularizer l_{reg}(\theta)). due to non-uniqueness of the eigenvalues, we will need to introduce a constrain if we intend to compute the lowest eigen-value (ground state for quantum systems). The Rayleigh energy can be used for this purpose for zero drift and constant diffusion coefficient

where 1-normalization factor for the eigenfunction is also included and the Rayleigh energy integral can be evaluated with a separate and coarse grid.