Technique could efficiently solve partial differential equations for numerous applications

In fields such as physics and engineering, partial differential equations (PDEs) are used to model complex physical processes to generate insight into how some of the most complicated physical and natural systems in the world function.

To solve these difficult equations, researchers use high-fidelity numerical solvers, which can be very time consuming and computationally expensive to run. The current simplified alternative, data-driven surrogate models, compute the goal property of a solution to PDEs rather than the whole solution. Those are trained on a set of data that has been generated by the high-fidelity solver, to predict the output of the PDEs for new inputs. This is data-intensive and expensive because complex physical systems require a large number of simulations to generate enough data.

In a new paper, “Physics-enhanced deep surrogates for partial differential equations,” published in December in Nature Machine Intelligence, a new method is proposed for developing data-driven surrogate models for complex physical systems in such fields as mechanics, optics, thermal transport, fluid dynamics, physical chemistry, and climate models.

The paper was authored by MIT’s professor of applied mathematics Steven G. Johnson along with Payel Das and Youssef Mroueh of the MIT-IBM Watson AI Lab and IBM Research; Chris Rackauckas of Julia Lab; and Raphaël Pestourie, a former MIT postdoc who is now at Georgia Tech. The authors call their method “physics-enhanced deep surrogate” (PEDS), which combines a low-fidelity, explainable physics simulator with a neural network generator. The neural network generator is trained end-to-end to match the output of the high-fidelity numerical solver.

“My aspiration is to replace the inefficient process of trial and error with systematic, computer-aided simulation and optimization,” says Pestourie. “Recent breakthroughs in AI like the large language model of ChatGPT rely on hundreds of billions of parameters and require vast amounts of resources to train and evaluate. In contrast, PEDS is affordable to all because it is incredibly efficient in computing resources and has a very low barrier in terms of infrastructure needed to use it.”

In the article, they show that PEDS surrogates can be up to three times more accurate than an ensemble of feedforward neural networks with limited data (approximately 1,000 training points), and reduce the training data needed by at least a factor of 100 to achieve a target error of 5%. Developed using the MIT-designed Julia programming language, this scientific machine-learning method is thus efficient in both computing and data.

The authors also report that PEDS provides a general, data-driven strategy to bridge the gap between a vast array of simplified physical models with corresponding brute-force numerical solvers modeling complex systems. This technique offers accuracy, speed, data efficiency, and physical insights into the process.

Says Pestourie, “Since the 2000s, as computing capabilities improved, the trend of scientific models has been to increase the number of parameters to fit the data better, sometimes at the cost of a lower predictive accuracy. PEDS does the opposite by choosing its parameters smartly. It leverages the technology of automatic differentiation to train a neural network that makes a model with few parameters accurate.”

“The main challenge that prevents surrogate models from being used more widely in engineering is the curse of dimensionality—the fact that the needed data to train a model increases exponentially with the number of model variables,” says Pestourie. “PEDS reduces this curse by incorporating information from the data and from the field knowledge in the form of a low-fidelity model solver.”

The researchers say that PEDS has the potential to revive a whole body of the pre-2000 literature dedicated to minimal models—intuitive models that PEDS could make more accurate while also being predictive for surrogate model applications.

“The application of the PEDS framework is beyond what we showed in this study,” says Das. “Complex physical systems governed by PDEs are ubiquitous, from climate modeling to seismic modeling and beyond. Our physics-inspired fast and explainable surrogate models will be of great use in those applications, and play a complementary role to other emerging techniques, like foundation models.”

For more such insights, log into our website https://international-maths-challenge.com

Credit of the article given to Sandi Miller, Massachusetts Institute of Technology

 


Global symmetry found to be not completely necessary for the protection of topological boundary states

An international team led by researchers at Nankai University in China and at University of Zagreb in Croatia, along with team at the Institut national de la recherche scientifique (INRS) in Canada, led by Roberto Morandotti has made an important breakthrough in the study of topological phases. Their findings were recently published in Nature Physics.

In the last decade, topological photonics has attracted increasing attention due to the unique prospects to achieve light manipulation with high performance in terms of robustness and stability.

Discoveries in topological photonics have opened the way to the development of a novel generation of photonic devices, such as topological lasers and cavities, featuring topologically protected states that are immune to disorders and defects. The concept of topology in physics is inherited from mathematics, where topology is employed to study geometric properties of an object concerning quantities that are preserved under continuous deformation.

Two objects are topologically identical when the surface of one can be continuously deformed into that of the other one and vice versa, e.g., a coffee cup and a torus are equivalent from a topology viewpoint. In physics, the concept of topology is employed to describe the energy band characteristics, leading to prediction of novel topological states of matter and various topological materials.

Different topological phases (trivial and nontrivial) are distinguished by appropriately introducing quantized topological invariants, which enable establishing a link between the bulk properties and the emergence of the feature at the boundary of these materials, known as the bulk-boundary correspondence. In this regard, the most distinctive feature of a nontrivial topology is the existence of robust topological boundary states protected by specific spatial and/or intrinsic symmetries.

In general, in systems of symmetry-protected topological phase (SPT phase), it is believed that the close relationship between topological boundary states, topological invariants, and one or more overall symmetries is indispensable for maintaining topological protection against perturbations.

As consequence, both topological invariants and topological boundary states are irretrievably affected by any distortion that breaks the underlying symmetry. In this work, the international research team has challenged this traditional common belief, and thus broaden the understanding of SPT boundary states. They found that even if the system no longer has quantized topological invariants and some kinds of global symmetry, the topological boundary states can still exist in the corresponding subspaces, protected by the so-called sub-symmetries.

“Our discovery challenges the common thinking of the symmetry-protected topological phase in topology and renews the correspondence of topological invariant and boundary states,” said Domenico Bongiovanni one of the main investigators, Postdoctoral researcher at INRS-EMT. “Our idea has the potential to explain the topological origin of many unconventional states and can find application in different platforms and physical systems.”

The researchers, by introducing and exploring the concept of sub-symmetry, found that global symmetry in the traditional sense is not completely necessary for the protection of topological boundary states. In this regard, topological boundary states are preserved as long as the symmetries of specific subspaces are satisfied, even when the overall topological invariants no longer exist.

The research team cleverly designed and fabricated photonic lattice structures using a cw-laser writing technique to meet the conditions of different subspace symmetries. The experiments demonstrated a proof of concept with two most typical topological lattices: one-dimensional SSH and two-dimensional Kagome lattices.

In addition, the team innovatively introduced the concept of long-range coupling symmetry into the Kagome lattice model, which resolves the current controversies about the existence and topological protection of higher-order topological states in the Kagome lattice.

This study not only challenges the traditional comprehension of topological states protected by symmetry but also provides new ideas for the research and application of topological states in different physical backgrounds. This impact of this work is expected to further promote the development of topological photonics and its cutting-edge interdisciplinary fields, as well as the research and development of a new generation of topological photonic devices based on sub-symmetry-protected boundary states.

For more such insights, log into our website https://international-maths-challenge.com

Credit of the article given to Institut national de la recherche scientifique – INRS