Completeness
Assess whether the catalog offers a consistent enough observational basis for modelling.
Case study 05 — Probabilistic forecasting
A reproducible earthquake forecasting benchmark built around catalog preparation, probabilistic modelling and reliability.
This benchmark approaches earthquake forecasting as a probabilistic and reproducible workflow rather than an exercise in producing single predictions.
Using the JMA catalog, it connects catalog-quality decisions to ETAS modelling, then evaluates forecast behaviour through calibration and reliability-focused validation.
Assess whether the catalog offers a consistent enough observational basis for modelling.
Handle event dependence as part of preparing the catalog for analysis.
Use a framework designed to represent earthquake occurrence and triggering behaviour.
Check whether predicted probabilities match observed frequencies, and report that honestly.
Evaluation note: the validation focus is documented, but numerical benchmark results were not published for this write-up, so no model scores are stated.
Reproducibility and calibration matter most exactly where uncertainty is highest — which is the entire point of a probabilistic benchmark.