This paper presents a machine learning framework using Physically Informed Neural Networks (PINNs) for solving nonlinear multiscale differential equations, particularly inverse problems. Key techniques include "multi-head (MH)" training and "unimodular regularization (UR)." MH training trains the network to learn the general space of all solutions to a given equation, rather than a specific solution, while UR regularizes the latent space of solutions. This allows for efficient solutions to nonlinear, coupled, multiscale differential equations and enhances transfer learning.