Over the past week I've been dissecting the Crystallography Open Database's decline from several angles: which publishers stopped feeding it, how the organic side collapsed, what space groups the remaining entries carry, and who the personal-communication depositors are. Each post answered a piece of the question. This one tries to answer the whole thing: of all the crystal structures determined each year, what fraction actually ends up in the open database?
The answer turns out to be a single number per year per class, and it's worse than I expected.
The idea is simple. Compare COD annual intake against the production of the two closed-access databases that cover the same territory:
Inorganic: COD no-carbon entries vs ICSD estimated annual additions. ICSD doesn't publish year-by-year intake, so I interpolate from milestones: ~3.4k/yr before 2007 (reaching 100k), ~9.1k/yr 2007-2018 (100k to 200k), ~16.7k/yr 2018-2024 (200k to 300k).
Organic: COD carbon+hydrogen entries vs CSD structures by publication year. The CCDC publishes these directly in their Publication Year Statistics.
Both the COD and CSD data are tagged by publication year of the associated paper, so the comparison is apples-to-apples in that dimension. The ICSD comparison is rougher because I only have milestone totals, not annual breakdowns, but the milestones span the full period and the interpolation is linear between them.
Full table and methodology: capture correction dataset
Four-panel figure: (A) COD inorganic intake vs ICSD estimated annual additions, (B) COD organic intake vs CSD structures by publication year, (C) open capture rate as % for both classes, (D) same on log scale. Shows inorganic capture falling from 77% (2000-04) to 1.9% (2024), organic from 53% (2012) to 17% (2024).
Year | Inorganic capture | Organic capture |
|---|---|---|
1995 | 26% | 11% |
2000 | 77% | 29% |
2005 |
Two stories, one plot.
Inorganic is a near-total loss. The COD captured three-quarters of inorganic crystal structures around 2000-2004, when it was actively harvesting from Elsevier and Wiley journals. The 2004-2005 publisher cut dropped it to 15% overnight. It never recovered. By 2024, the COD's 316 inorganic entries represent less than 2% of the estimated 16,700 structures ICSD added that year. The ICSD grew from 100k to 300k structures while the COD's inorganic intake fell from 2,949 to 316. Both things happened at once: the closed database accelerated, the open one collapsed.
Organic held on longer but is heading the same way. The organic capture rate actually peaked after the inorganic collapse, reaching 53% around 2012. That's because RSC and ACS were still feeding the COD for organic structures even as Elsevier and Wiley had pulled inorganic. The ACS move to CCDC-only deposition (rolling out 2016-2021) broke that pipeline. By 2024, the COD captures about 17% of organic structures, down from a peak of 53%.
The log-scale panel makes the asymmetry clear. Inorganic capture fell 40x from peak. Organic capture fell 3x. The inorganic pipe didn't narrow; it nearly closed.
Any analysis that mines the COD for "what chemistry happened" needs to apply a capture correction, or it will confuse pipe dynamics for chemistry dynamics. Concrete examples from this series:
The composition flip
Without the capture correction, every one of these findings overstates the signal. With it, you can see that most of the "change" in recent COD data is the pipe narrowing, not the chemistry shifting.
The ICSD annual additions are interpolated from three milestones, not measured. The 2007-2018 bracket is a flat 9.1k/year average, which almost certainly smooths over real year-to-year variation. If ICSD intake was front-loaded or back-loaded within a bracket, the inorganic capture rate for specific years could be off by a factor of 1.5-2x. The trend, however, is robust: the milestones span the full period and the COD numbers are exact.
The CSD comparison is cleaner because the CCDC publishes actual per-year counts. But the CSD includes metal-organic structures that overlap with ICSD's scope, and the COD's carbon+hydrogen class is a formula-based split, not a structural one. The organic capture rate is probably accurate to within a few percentage points.
Neither comparison accounts for structures that appear in multiple databases. Some COD entries are also in ICSD or CSD. The capture rate is therefore an upper bound on "unique open structures as a fraction of total production."
Crystallography is not in decline. The CSD adds ~60,000 structures per year. The ICSD adds ~16,000. Together, that's roughly 76,000 newly determined crystal structures annually, and the rate is stable or growing. The COD's 11,000 entries in 2024 represent maybe 15% of that total, down from roughly 40% a decade ago.
The open database is becoming a historical archive. Its inorganic collection is essentially frozen at pre-2005 levels, augmented by a thin trickle of RSC and personal-communication deposits. Its organic collection is still current but shrinking, propped up by RSC's persistence and IUCr's open access. Every year that passes, the gap between "what the COD has" and "what crystallography produced" grows wider.
This is the capture correction. If you're mining the COD for trends, apply it. If you're building training sets from the COD, know that your recent data is a biased sample. And if you're wondering why the 2025 P1 surge
45% |
44% |
2010 | 16% | 51% |
2015 | 14% | 47% |
2020 | 5% | 27% |
2024 | 1.9% | 17% |
The P1 anomaly (8.5% of no-carbon entries in 2025) looks alarming as a share, but it's 34 structures out of 449, and all 34 are from one generative-model deposit. The share is amplified by the denominator collapse.
The triclinic surge is a share artifact: 41 genuine P-1 structures look like a surge because the total no-carbon intake was the lowest since 1961.