Curie temperature dataset V0

This is a first draft of a compiled Curie temperature dataset mapping crystal structure (from Materials Project) to Curie temperature. Builds on the work of https://github.com/Songyosk/CurieML. Dataset includes ~6,800 unique materials representing 3,284 unique chemical families.

Machine-Learning Prediction of Curie Temperature from Chemical Compositions of Ferromagnetic Materials

Room-temperature ferromagnets are high-value targets for discovery given the ease by which they could be embedded within magnetic devices. However, the multitude of potential interactions among magnetic ions and their surrounding environments renders the prediction of thermally stable magnetic properties challenging. Therefore, it is vital to explore methods that can effectively screen potential candidates to expedite the discovery of novel ferromagnetic materials within highly intricate feature spaces. To this end, the authors explore machine-learning (ML) methods as a means to predict the Curie temperature (Tc) of ferromagnetic materials by discerning patterns within materials databases. https://pubs.acs.org/doi/10.1021/acs.jcim.4c00947

Atomistic spin model simulations of magnetic nanomaterials

Atomistic modelling of magnetic materials provides unprecedented detail about the underlying physical processes that govern their macroscopic properties, and allows the simulation of complex effects such as surface anisotropy, ultrafast laser-induced spin dynamics, exchange bias, and microstructural effects. Here the authors present the key methods used in atomistic spin models which are then applied to a range of magnetic problems. They detail the parallelization strategies used which enable the routine simulation of extended systems with full atomistic resolution. https://iopscience.iop.org/article/10.1088/0953-8984/26/10/103202/meta

MatterGen paper

This paper presents MatterGen, a model that generates stable, diverse inorganic materials across the periodic table and can further be fine-tuned to steer the generation towards a broad range of property constraints. To enable this, the authors introduce a new diffusion-based generative process that produces crystalline structures by gradually refining atom types, coordinates, and the periodic lattice. https://arxiv.org/abs/2312.03687

Large Language Diffusion Models Paper

This paper introduces LLaDA, a diffusion model trained from scratch under the pre-training and supervised finetuning (SFT) paradigm. LLaDA models distributions through a forward data masking process and a reverse process, parameterized by a vanilla Transformer to predict masked tokens. https://arxiv.org/abs/2502.09992

Animated scatter plots showing latent feature evolutions during heating

Here we showcase a few key latent features and their relationships to each other, points colored by their Tc. We animate from 0 K to ~130 K.

A hairy frog

Generated image from "A hairy frog" using DALL-E 3 from OpenAI.

A marble sculpture of a human male with white background as 3D model

Generated model from an image using the StabilityAI API.

A marble sculpture of a human male with white background

Generated image from "A marble sculpture of a human male with white background" using the StabilityAI API.

Haystack superconductor results

Evaluation results for the MatterGen fine-tuned model candidates, with new superconducting families labeled.

Superconducting chemical families

3DSC dataset grouped by chemical composition, with Tc as our target. For use with MatterGen and the chemical system sampling.

Orb latent space Tc classifier eval parity plot

Interactive plot of predicted vs. true Tc on the evaluation set.

Orb latent space Tc classifier train and eval dataset Tc histogram

Visualizing the counts of materials in the training and evaluation dataset by their Tc. First bin is non-superconductors, the rest are ranges of 20 K increments.

3D latent space exploration with Tc

Using the 256 dimensional latent space output from the Orb model, we visualize the 3DSC(MP) dataset using UMAP with direction from Tc labels. Hover a point to see Tc, formula, and Material Project identifier.

Interactive 3D latent space exploration with Tc

Using the 256 dimensional latent space output from the Orb model, we visualize the 3DSC(MP) dataset using t-SNE and UMAP. The UMAP projection has been given the target for learning a manifold that keeps similar Tc materials close together.

Orb Paper

Authors introduce Orb, a family of universal interatomic potentials for atomistic modeling of materials. Orb models are 3-6 times faster than existing universal potentials, stable under simulation for a range of out of distribution materials and, upon release, represented a 31% reduction in error over other methods on the Matbench Discovery benchmark. https://arxiv.org/abs/2410.22570

MatterSim

Authors present MatterSim, a deep learning model actively learned from large-scale first-principles computations, for efficient atomistic simulations at first-principles level and accurate prediction of broad material properties across the periodic table, spanning temperatures from 0 to 5000 K and pressures up to 1000 GPa. https://arxiv.org/abs/2405.04967

Speed comparasion running MLIP MD on CPU vs GPU

Not exactly the most rigorous test, but this side-by-side comparison shows the difference between running MD locally (M2 Macbook Air) and on a proper server (g4dn.2xl with T4 GPU). Each log is actually 100 simulation steps too.

NaCl trajectories

Molecular dynamics simulation temperature ramping NaCl 3x3x3 supercell from 0 K to 300 K

H2O trajectories

Molecular dynamics simulation temperature ramping H2O 3x3x3 supercell from 0 K to 300 K

Simulated temperature of H2O over 10ps from 0 K to 300 K

H2O MD simulation heating from 0 K to 300 K

Simulating ice into water

mp-697111 H2O

https://next-gen.materialsproject.org/materials/mp-697111

Calculated temperature evolution of NaCl

Langevin temperature ramp over 10ps from 0 K to 300 K on a 3x3x3 supercell of NaCl

Calculated material temperature of NaCl during temperature ramp simulation

Langevin temperature ramp over 10ps from 0 K to 300 K on a 3x3x3 supercell of NaCl

mp-22851 NaCl

https://next-gen.materialsproject.org/materials/mp-22851

Molecular dynamics heating NaCl from 0K to 300K over 10ps

Visualization created using .traj outputs of ASE MD simulation

Materials Design for New Superconductors

Since the announcement in 2011 of the Materials Genome Initiative by the Obama administration, much attention has been given to the subject of materials design to accelerate the discovery of new materials that could have technological implications. Although having its biggest impact for more applied materials like batteries, there is increasing interest in applying these ideas to predict new superconductors. This is obviously a challenge, given that superconductivity is a many body phenomenon, with whole classes of known superconductors lacking a quantitative theory. Given this caveat, various efforts to formulate materials design principles for superconductors are reviewed here, with a focus on surveying the periodic table in an attempt to identify cuprate analogues. https://arxiv.org/abs/1601.00709

vajra

Tibetan-style vajra/dorje. Based on references from https://www.himalayanart.org/search/set.cfm?setID=563. https://sketchfab.com/3d-models/vajra-1bdaddab069f424a95ad9a9a9c8c17ed

Evidence for metastable photo-induced superconductivity in K3C60

Authors make use of a new optical device to drive metallic K3C60 with mid-infrared pulses of tunable duration, ranging between one picosecond and one nanosecond. The same superconducting-like optical properties observed over short time windows for femtosecond excitation are shown here to become metastable under sustained optical driving, with lifetimes in excess of ten nanoseconds. https://www.nature.com/articles/s41567-020-01148-1

Prediction of high-Tc superconductivity in ternary lanthanum borohydrides

The study of superconductivity in compressed hydrides is of great interest due to measurements of high critical temperatures (Tc) in the vicinity of room temperature, beginning with the observations of LaH10 at 170-190 GPa. However, the pressures required for synthesis of these high Tc superconducting hydrides currently remain extremely high. Here we show the investigation of crystal structures and superconductivity in the La-B-H system under pressure with particle-swarm intelligence structure searches methods in combination with first-principles calculations. https://arxiv.org/abs/2107.02553

An invertible crystallographic representation for general inverse design of inorganic crystals with targeted properties

Realizing general inverse design could greatly accelerate the discovery of new materials with user-defined properties. However, state-of-the-art generative models tend to be limited to a specific composition or crystal structure. Herein, we present a framework capable of general inverse design (not limited to a given set of elements or crystal structures), featuring a generalized invertible representation that encodes crystals in both real and reciprocal space, and a property-structured latent space from a variational autoencoder (VAE). https://arxiv.org/abs/2005.07609

A Universal Graph Deep Learning Interatomic Potential for the Periodic Table

Here, we report a universal IAP for materials based on graph neural networks with three-body interactions (M3GNet). The M3GNet IAP was trained on the massive database of structural relaxations performed by the Materials Project over the past 10 years and has broad applications in structural relaxation, dynamic simulations and property prediction of materials across diverse chemical spaces. Chi Chen & Shyue Ping Ong https://www.nature.com/articles/s43588-022-00349-3 Preprint version from arXiv

Predicting superconducting transition temperature through advanced machine learning and innovative feature engineering

This study employs the SuperCon dataset as the largest superconducting materials dataset. Then, we perform various data pre-processing steps to derive the clean DataG dataset, containing 13,022 compounds. In another stage of the study, we apply the novel CatBoost algorithm to predict the transition temperatures of novel superconducting materials. In addition, we developed a package called Jabir, which generates 322 atomic descriptors. We also designed an innovative hybrid method called the Soraya package to select the most critical features from the feature space. These yield R2 and RMSE values (0.952 and 6.45 K, respectively) superior to those previously reported in the literature. Finally, as a novel contribution to the field, a web application was designed for predicting and determining the Tc values of superconducting materials.

3DSC - a dataset of superconductors including crystal structures

Data-driven methods, in particular machine learning, can help to speed up the discovery of new materials by finding hidden patterns in existing data and using them to identify promising candidate materials. In the case of superconductors, the use of data science tools is to date slowed down by a lack of accessible data. In this work, we present a new and publicly available superconductivity dataset (‘3DSC’), featuring the critical temperature Tc of superconducting materials additionally to tested non-superconductors.

Scatter plots of Tc for superconducting materials with family-specific regression predictors

For 4000 “low-Tc” superconductors (i.e., non-cuprate and non-iron-based), Tc is plotted vs. the a) average atomic weight, b) average covalent radius, and c) average number of d) valence electrons. Having low average atomic weight and low average number of d) valence electrons are necessary (but not sufficient) conditions for achieving high Tc in this group. d) Scatter plot of Tc for all known superconducting cuprates vs. the mean number of unfilled orbitals. c), d) suggest that the values of these predictors lead to hard limits on the maximum achievable Tc

SuperCon dataset and classification model performance

a) Histogram of materials categorized by Tc (bin size is 2 K, only those with finite Tc are counted). Blue, green, and red denote low-Tc, iron-based, and cuprate superconductors, respectively. In the inset: histogram of materials categorized by ln(Tc) restricted to those with Tc > 10 K. b) Performance of different classification models as a function of the threshold temperature (Tsep) that separates materials in two classes by Tc. Performance is measured by accuracy (gray), precision (red), recall (blue), and F1 score (purple). The scores are calculated from predictions on an independent test set, i.e., one separate from the dataset used to train the model. In the inset: the dashed red curve gives the proportion of materials in the above-Tsep set. c) Accuracy, precision, recall, and F1 score as a function of the size of the training set with a fixed test set. d) Accuracy, precision, recall, and F1 as a function of the number of predictors

Machine learning modeling of superconducting critical temperature

Superconductivity has been the focus of enormous research effort since its discovery more than a century ago. Yet, some features of this unique phenomenon remain poorly understood; prime among these is the connection between superconductivity and chemical/structural properties of materials. To bridge the gap, several machine learning schemes are developed herein to model the critical temperatures (Tc) of the 12,000+ known superconductors available via the SuperCon database. Materials are first divided into two classes based on their Tc values, above and below 10 K, and a classification model predicting this label is trained. The model uses coarse-grained features based only on the chemical compositions. It shows strong predictive power, with out-of-sample accuracy of about 92%. https://www.nature.com/articles/s41524-018-0085-8

A foundation model for atomistic materials chemistry

Machine-learned force fields have transformed the atomistic modeling of materials by enabling simulations of ab initio quality on unprecedented time and length scales. However, they are currently limited by: (i) the significant computational and human effort that must go into development and validation of potentials for each particular system of interest; and (ii) a general lack of transferability from one chemical system to the next. Here, using the state-of-the-art MACE architecture we introduce a single general-purpose ML model, trained on a public database of 150k inorganic crystals, that is capable of running stable molecular dynamics on molecules and materials.

AIMNet2 Paper

The 2nd generation of our atoms-in-molecules neural network potential (AIMNet2), which is applicable to species composed of up to 14 chemical elements in both neutral and charged states, making it a valuable method for modeling the majority of non-metallic compounds. Using an exhaustive dataset of 2 x 107 hybrid DFT level of theory quantum chemical calculations, AIMNet2 combines ML-parameterized short-range and physics-based long-range terms to attain generalizability that reaches from simple organics to diverse molecules with “exotic” element-organic bonding.

CHGNet as a pretrained universal neural network potential for charge-informed atomistic modelling

Here we present the Crystal Hamiltonian Graph Neural Network (CHGNet), a graph neural network-based machine-learning interatomic potential (MLIP) that models the universal potential energy surface. CHGNet is pretrained on the energies, forces, stresses and magnetic moments from the Materials Project Trajectory Dataset, which consists of over 10 years of density functional theory calculations of more than 1.5 million inorganic structures. https://www.nature.com/articles/s42256-023-00716-3

Equivariant graph neural networks for data-efficient and accurate interatomic potentials

This work presents Neural Equivariant Interatomic Potentials (NequIP), an E(3)-equivariant neural network approach for learning interatomic potentials from ab-initio calculations for molecular dynamics simulations. https://www.nature.com/articles/s41467-022-29939-5

noise_step

Training in 1.58b With No Gradient Memory. Preprint paper by wbrickner