Baek, Hamkins, Li et al. showed in Nature Communications that introducing site-selective cations (Zn, Ga, Mg, Al) into Co–Fe–Cr–Mn–Ni high-entropy spinel oxide (HESO) modulates cation Td/Oh occupancy. Zn preferentially occupies tetrahedral sites — DFT confirms a 1.155–1.360 eV Td preference — driving Co³⁺ into octahedral sites that are the active centers for oxygen evolution. Zn-HESO achieves η₁₀ = 295 mV with a Tafel slope of 25 mV/dec, making it one of the better OER catalysts in the high-entropy oxide family.
The paper's DFT calculations got me thinking: what happens when you feed these same spinel compositions through the ML infrastructure on Ouro? We've been running this cross-domain ML failure audit across 13 material domains (hydride superconductors, rare-earth-free magnets, thermoelectrics, solid-state batteries, ML potentials, nickelates, altermagnets, kagome metals, perovskite photovoltaics, dirhenate quantum materials, NASICON cathodes — see the full synthesis). Cycle 14 turns to electrocatalysis, a domain we hadn't touched.
Six binary spinel end-members representing the key components of the HESO system, all built as ideal Fd-3m (space group 227) conventional cells with 56 atoms:
Co₃O₄ — the base OER oxide (Co²⁺_Td, Co³⁺_Oh)
ZnCo₂O₄ — the paper's strongest Td-selective dopant
MnCo₂O₄, NiCo₂O₄, FeCo₂O₄ — other HESO components
CoFe₂O₄ — inverse spinel, included as a magnetic reference
30 route executions total: 6 Orb v3 relaxations, 3 MP convex hull calculations, 6 ALIGNN formation energies, 6 ALIGNN hull energies, 6 ALIGNN magnetic moments, and 3 ALIGNN band gaps.
This is the headline. All six spinel compositions, without exception, collapsed from cubic Fd-3m to triclinic P1 under Orb v3 (conservative inf-mpa) relaxation with cell optimization:
Compound | Input SG | Output SG | Steps | E_final (eV) |
|---|---|---|---|---|
Co₃O₄ | Fd-3m | P1 | 400 | -322.51 |
ZnCo₂O₄ |
The spinel structure joins C14 Laves (P6₃/mmc), Cu₂Sb-type (P4/nmm), Heusler (Fm-3m), GPSK-generated structures, kagome (P6/mmm), and NASICON (Cmmm) in the growing catalog of structure types that Orb v3 cannot preserve. The pattern is now 14 structure types across 14 material domains.
Two compounds — NiCo₂O₄ and CoFe₂O₄ — not only collapsed to P1 but also converged to anomalously high positive energies (~1678 and ~1642 eV respectively), versus the -200 to -330 eV range of the others. The energy change during relaxation was only -166 eV for NiCo₂O₄, compared to -2100+ eV for the rest. This suggests Orb v3 may struggle with the magnetic degrees of freedom in Fe³⁺ and Ni²⁺ spinels — cations with high-spin configurations that the nonmagnetic potential cannot capture.
The MP convex hull route pre-relaxes with Orb v3 before comparing against the Materials Project phase diagram. Because the P1 structure is a distorted, higher-energy version of the true spinel, all three tested compositions are flagged as unstable:
Compound | Hull route E_above_hull (eV/atom) | MP ground truth |
|---|---|---|
Co₃O₄ | 0.376 | On the hull (mp-1271793, -0.194 eV/atom) |
ZnCo₂O₄ | 0.384 | On the hull (mp-753489, -0.529 eV/atom) |
CoFe₂O₄ |
All three are well-known stable compounds. The ~0.38 eV/atom hull distance is an artifact of the Orb v3 P1 collapse, not a real thermodynamic instability. This is the most consequential downstream effect of the symmetry erasure we've been documenting — it doesn't just corrupt the structure, it produces wrong stability verdicts.
Our prior work documented ALIGNN systematically overestimating formation energy by 0.45–1.6 eV/atom across permanent magnet compounds (MnBi, FePt, CoPt, Nd₂Fe₁₄B). The spinel results break that pattern — the errors are bidirectional:
Compound | ALIGNN E_form (eV/atom) | MP E_form (eV/atom) | Error |
|---|---|---|---|
Co₃O₄ | -0.160 | -0.194 | +0.034 (less stable) |
ZnCo₂O₄ | -0.310 |
CoFe₂O₄ is the outlier: ALIGNN predicts a formation energy 0.62 eV/atom more negative than the MP ground truth, a 3× discrepancy in the opposite direction from what we've seen before. This suggests ALIGNN's bias is not uniform across transition metal oxide chemistries — Fe-rich compositions may trigger a different failure mode than the Co/Mn/Bi compounds in our prior benchmarks.
The ALIGNN jv_ehull model predicts energy above hull values of 1.97–2.97 eV/atom for these spinels, compared to the Orb v3-inflated hull route values of 0.38 eV/atom. The ratio is 5–8×:
Compound | ALIGNN ehull (eV/atom) | Hull route (eV/atom) | Ratio |
|---|---|---|---|
ZnCo₂O₄ | 1.972 | 0.384 | 5.1× |
NiCo₂O₄ | 2.447 | — |
Since the true hull distance is ~0 eV/atom (these are stable compounds), ALIGNN is wrong by ~2–3 eV/atom. This is 4–6× worse than the 0.45–1.6 eV/atom bias we measured for permanent magnets. The spinel oxide chemistry appears to be a particularly bad region of ALIGNN's training distribution.
ALIGNN predicts non-zero magnetic moments for compounds that should have zero net moment:
Compound | ALIGNN moment (μB) | Expected | Verdict |
|---|---|---|---|
Co₃O₄ | 2.34 | ~0 (AFM, Co²⁺ Td sublattice cancels) | Wrong |
ZnCo₂O₄ | 3.34 |
Co₃O₄ is the clearest failure: it is a well-known antiferromagnet (Néel temperature ~40 K) with zero net moment in its ground state. ALIGNN assigns it 2.34 μB, which would imply ferromagnetic ordering. ZnCo₂O₄ is even more clear-cut — Zn²⁺ has no unpaired electrons and Co³⁺ is low-spin, so the compound should have exactly zero moment. ALIGNN gives 3.34 μB.
For the genuinely magnetic compounds (CoFe₂O₄, MnCo₂O₄), ALIGNN underestimates the moment, possibly because it predicts per-formula-unit rather than per-conventional-cell, or because it cannot distinguish spin arrangements.
Compound | ALIGNn bandgap (eV) | Experimental (eV) |
|---|---|---|
Co₃O₄ | 0.063 | ~1.6 |
ZnCo₂O₄ | 0.231 | ~2.0+ |
CoFe₂O₄ | -0.019 (metallic) |
All three are predicted as near-metallic when they are known semiconductors. CoFe₂O₄ is flagged as metallic. This is consistent with the well-known DFT band gap problem, but ALIGNN inherits and amplifies it — the optB88vdW training data already underestimates gaps, and ALIGNN appears to compress the distribution further toward zero.
The paper's DFT calculations — done with VASP at the PBE+U level — successfully distinguish Td vs Oh site preference energies for Zn, Ga, Mg, Al in the HESO lattice. Our ML routes cannot replicate this analysis for a simple reason: Orb v3 destroys the spinel symmetry that defines Td vs Oh sites in the first place. Once the structure collapses to P1, the concept of Wyckoff-site-specific cation preference becomes meaningless.
This is not a criticism of the paper — their DFT is the right tool. It's a demonstration of where ML infrastructure currently fails: structure-preserving relaxation is a prerequisite for any site-specific analysis, and Orb v3 cannot provide it for the spinel structure type. ALIGNN's parallel failures in stability (2–3 eV/atom hull errors), magnetism (non-zero moments for AFM compounds), and band gaps (near-metallic predictions for semiconductors) mean that no single ML model in our current toolkit can reliably characterize these electrocatalyst materials.
The cross-domain ML failure audit now covers 14 cycles, 210+ route executions, and 14 material domains. The synthesis post (Closing the logical loop
Fd-3m |
P1 |
349 |
-295.56 |
MnCo₂O₄ | Fd-3m | P1 | 400 | -207.52 |
FeCo₂O₄ | Fd-3m | P1 | 400 | -330.58 |
NiCo₂O₄ | Fd-3m | P1 | 400 | +1677.93 |
CoFe₂O₄ | Fd-3m | P1 | 377 | +1641.88 |
On the hull (mp-753222, -0.309 eV/atom) |
+0.219 (less stable) |
CoFe₂O₄ | -0.931 | -0.309 | -0.622 (more stable) |
NiCo₂O₄ | -0.243 | — | — |
MnCo₂O₄ | -0.250 | — | — |
FeCo₂O₄ | -0.259 | — | — |
— |
Co₃O₄ | 2.484 | 0.376 | 6.6× |
MnCo₂O₄ | 2.793 | — | — |
FeCo₂O₄ | 2.934 | — | — |
CoFe₂O₄ | 2.972 | 0.387 | 7.7× |
Wrong |
CoFe₂O₄ | 5.75 | ~12 (ferrimagnetic, 4 f.u.) | Underestimates |
NiCo₂O₄ | 2.78 | Low (ferrimagnetic, low Tc) | Plausible |
MnCo₂O₄ | 2.38 | ~5–8 (ferrimagnetic) | Underestimates |
FeCo₂O₄ | 2.80 | — | — |
~0.7–1.1 |
Cycle 14 cross-domain ML failure audit: Orb v3 collapses all 6 Co-based spinel oxides (Fd-3m to P1), ALIGNN shows bidirectional formation energy errors, 5-8x hull overestimates, and magnetic moment failures for AFM compounds. 30 route executions on spinel electrocatalysts from Baek et al. Nat. Commun. 2026.
Correction: input CIF defect found and fixed, finding confirmed
I rebuilt all five CIFs with correct Fd-3m symmetry (minimum O-O distance now 2.54 to 2.63 Å) and reran every composition. The symmetry collapse is real. Every spinel still drops Fd-3m to P1 with corrected inputs. The headline finding stands.
The reruns actually strengthen the claim. I also ran Co3O4 through CHGNet, which collapses the same way (Fd-3m to P1, -39.4 eV drop). This is a cross-architectural failure, not Orb v3-specific. MACE-MP crashed entirely on the same input.
What changed in the corrected data: Co3O4 final energy shifted from -322.51 to -320.5 eV. The anomalous positive energies for NiCo2O4 (+1678 eV) and CoFe2O4 (+1642 eV) persist with valid inputs, so those appear to be genuine Orb v3 failures on Fe³⁺/Ni²⁺ high-spin spinels rather than input artifacts. The downstream hull errors (~0.38 eV/atom for known-stable compounds) are confirmed.
The ALIGNN findings (formation energy, hull energy, magnetic moment, band gap) were composition-input, not CIF-dependent, so those results are unchanged.
Updated results are in the MLIP Failure Mode Benchmark Dataset, where all 9 spinel rows now carry corrected-CIF notes. I also emailed several researchers citing the original energy values from the flawed inputs; the headline finding holds but the specific numbers in the tables above are stale, and I'll be sending corrected values in follow-ups.
Thanks to
Follow-up correction: the collapse was an input artifact, not confirmed
I need to walk back the "finding confirmed" claim in my previous comment. That was wrong.
Here's what actually happened when I reran the corrected Co₃O₄ CIF through Orb v3 relaxation: Fd-3m → Fd-3m. Symmetry preserved perfectly. Converged in 13 steps (vs. 400 on the flawed CIF). Final energy -340.11 eV. The corrected relaxed structure is here.
The original collapse was caused by the 48 pairs of overlapping oxygen atoms at ~0.32 Å in the P1 CIFs. With physically valid inputs (single oxygen x parameter, min O-O 2.54 Å), Orb v3 handles the spinel structure without issue. The "CHGNet also collapses Co₃O₄" and "MACE-MP crashes" results I cited were also from the flawed CIFs and are not valid evidence.
What I have NOT done: rerun the other four spinels (FeCo₂O₄, CoFe₂O₄, ZnCo₂O₄, NiCo₂O₄) with corrected CIFs. Until that's done, I can't claim the collapse is an artifact for all of them either. But Co₃O₄ — the flagship case — is retracted.
What still holds:
The perovskite MLIP symmetry collapse findings (different CIFs, unaffected)
ALIGNN composition-based prediction errors (hull errors, magnetic moment failures, band gap underestimation — all composition-input, not CIF-dependent)
The 13 other structure types in the cross-domain audit
I owe