TerraPulse Data Inventory
Generated: 2026-03-26 Platform: v0.7.0 — Data Garden
Summary
| Metric | Value |
|---|---|
| Total datasources | 240 |
| Total observations | 22,529,463 |
| Distinct metrics | 107 |
| Scientific domains | 14 (excluding catalog) |
| Research workspaces | 23 |
| Papers (PDF) | 5 |
Datasource Health (2026-03-26)
| Status | Count | Description |
|---|---|---|
| Healthy | 132 | Data flowing in last 24h |
| Stale | 31 | Has data but not recent (backfill, daily, or slow sources) |
| Empty (AutoSense) | 74 | Michael's EPA/data.gov additions awaiting autosense sweep |
| Empty (Core) | 3 | GFW Fires (needs API key), GMN (502), HSS (not implemented) |
Top Sources by Volume
| Source | Observations | Type |
|---|---|---|
| GOES X-ray Flux | 5,453,828 | Core (5min) |
| DSCOVR Solar Wind | 3,885,495 | Core (5min) |
| USGS Water Services | 2,397,352 | Core (5min) |
| Safecast Radiation | 1,179,500 | Core (5min) |
| NWS Alerts | 525,075 | Core (60s) |
| NOAA Tides | 244,640 | Core (6min) + backfill |
| NOAA Space Weather | 205,521 | Core (5min) |
| USGS Earthquake | 174,569 | Core (60s) |
Stale Sources (have data, not recent)
| Source | Observations | Age | Reason |
|---|---|---|---|
| SILSO Sunspots | 76,030 | 2d | Daily refresh, data lags ~1 month |
| SPC Tornado History | 70,022 | 3d | Historical backfill only (1950-2023) |
| SPC Storm Reports | 36,663 | 2d | Daily reports |
| Smithsonian GVP | 6,222 | 2d | Daily catalog refresh |
| NASA POWER | 10,970 | 8d | Daily with 5-day lag |
Solar / Space Weather
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| solar_xray_flux | 3,436,565 | 2026-03-17 | 2026-03-25 | 8d |
| solar_wind_speed | 1,525,155 | 2025-10-10 | 2026-03-25 | 166d |
| solar_wind_bz | 1,337,381 | 2025-10-02 | 2026-03-25 | 174d |
| space_kp_index | 123,976 | 2025-09-15 | 2026-03-25 | 191d |
| space_solar_flux_10cm | 61,849 | 2026-02-15 | 2026-03-25 | 38d |
| sunspot_number | 76,030 | 1817-12-31 | 2026-02-27 | 76029d |
| donki_cme_speed | 15,205 | 2026-03-15 | 2026-03-25 | 10d |
| donki_flare_class | 2,012 | 2025-09-19 | 2026-03-24 | 186d |
| donki_storm_kp | 771 | 2026-03-20 | 2026-03-22 | 2d |
| donki_high_speed_stream | 580 | 2025-09-16 | 2026-03-21 | 186d |
| donki_radiation_belt | 460 | 2026-03-15 | 2026-03-22 | 7d |
Domain total: 6,579,984 observations
Seismology
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| earthquake_magnitude | 171,852 | 2021-04-12 | 2026-03-25 | 1808d |
Domain total: 171,852 observations
Severe Weather (NWS)
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| nws_small_craft_advisory | 305,341 | 2026-03-22 | 2026-03-25 | 3d |
| nws_gale_warning | 50,259 | 2026-03-22 | 2026-03-25 | 3d |
| nws_brisk_wind_advisory | 20,452 | 2026-03-23 | 2026-03-25 | 2d |
| nws_fire_weather_watch | 19,299 | 2026-03-23 | 2026-03-25 | 2d |
| nws_red_flag_warning | 11,139 | 2026-03-24 | 2026-03-25 | 1d |
| nws_wind_advisory | 9,270 | 2026-03-23 | 2026-03-24 | 1d |
| nws_special_weather_statement | 9,243 | 2026-03-23 | 2026-03-25 | 2d |
| nws_gale_watch | 7,642 | 2026-03-23 | 2026-03-25 | 2d |
| nws_flood_warning | 6,543 | 2026-03-21 | 2026-03-25 | 4d |
| nws_rip_current_statement | 3,397 | 2026-03-23 | 2026-03-25 | 2d |
| nws_flood_watch | 3,333 | 2026-03-23 | 2026-03-24 | 1d |
| nws_winter_weather_advisory | 2,807 | 2026-03-23 | 2026-03-24 | 1d |
| nws_flood_advisory | 2,714 | 2026-03-23 | 2026-03-25 | 2d |
| nws_heavy_freezing_spray_warning | 2,619 | 2026-03-20 | 2026-03-20 | 0d |
| nws_high_wind_warning | 2,236 | 2026-03-24 | 2026-03-24 | 0d |
| nws_dense_fog_advisory | 1,976 | 2026-03-23 | 2026-03-25 | 2d |
| nws_special_marine_warning | 1,734 | 2026-03-23 | 2026-03-25 | 2d |
| nws_high_wind_watch | 1,571 | 2026-03-23 | 2026-03-24 | 1d |
| nws_marine_weather_statement | 1,471 | 2026-03-23 | 2026-03-25 | 2d |
| nws_hydrologic_outlook | 1,138 | 2026-03-24 | 2026-03-25 | 1d |
| nws_heat_advisory | 997 | 2026-03-23 | 2026-03-25 | 2d |
| nws_flash_flood_warning | 854 | 2026-03-23 | 2026-03-25 | 2d |
| nws_air_quality_alert | 849 | 2026-03-23 | 2026-03-25 | 2d |
| nws_high_surf_advisory | 720 | 2026-03-23 | 2026-03-23 | 0d |
| nws_lake_wind_advisory | 685 | 2026-03-24 | 2026-03-25 | 1d |
| nws_hazardous_seas_warning | 588 | 2026-03-24 | 2026-03-25 | 1d |
| nws_coastal_flood_statement | 472 | 2026-03-23 | 2026-03-23 | 0d |
| nws_frost_advisory | 387 | 2026-03-24 | 2026-03-25 | 1d |
| nws_child_abduction_emergency | 330 | 2026-03-24 | 2026-03-24 | 0d |
| nws_hazardous_seas_watch | 274 | 2026-03-24 | 2026-03-24 | 0d |
| nws_coastal_flood_advisory | 135 | 2026-03-25 | 2026-03-25 | 0d |
| nws_cold_weather_advisory | 80 | 2026-03-25 | 2026-03-25 | 0d |
| nws_snow_squall_warning | 33 | 2026-03-23 | 2026-03-23 | 0d |
| nws_evacuation_immediate | 11 | 2026-03-25 | 2026-03-25 | 0d |
| nws_fire_warning | 8 | 2026-03-25 | 2026-03-25 | 0d |
Domain total: 470,607 observations
Severe Weather (SPC)
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| spc_tornado | 70,022 | 1950-01-03 | 2023-12-19 | 27013d |
| spc_hail | 29,078 | 2026-03-22 | 2026-03-24 | 2d |
| spc_wind | 7,585 | 2026-03-22 | 2026-03-24 | 2d |
| spc_day1_convective | 45 | 2026-03-23 | 2026-03-25 | 2d |
| spc_day2_convective | 45 | 2026-03-23 | 2026-03-25 | 2d |
| spc_day3_convective | 45 | 2026-03-23 | 2026-03-25 | 2d |
Domain total: 106,820 observations
Meteorology
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| temperature_2m | 54,100 | 2025-09-15 | 2026-03-25 | 191d |
| geosphere_temperature | 6,648 | 2026-03-18 | 2026-03-25 | 7d |
| geosphere_pm25 | 6,648 | 2026-03-18 | 2026-03-25 | 7d |
| nasa_power_t2m | 10,970 | 2022-12-31 | 2026-03-08 | 1163d |
Domain total: 78,366 observations
Air Quality
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| us_aqi | 53,970 | 2025-09-15 | 2026-03-25 | 191d |
Domain total: 53,970 observations
Hydrology / Oceanography
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| streamflow_00060 | 2,332,267 | 2025-09-16 | 2026-03-25 | 190d |
| water_level | 243,387 | 2025-09-15 | 2026-03-25 | 191d |
| river_discharge | 1,440 | 2026-03-15 | 2026-03-24 | 9d |
| wave_height | 19,954 | 2025-09-15 | 2026-03-25 | 191d |
Domain total: 2,597,048 observations
Radiation
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| radiation | 1,051,000 | 1970-06-12 | 2080-01-10 | 40024d |
Domain total: 1,051,000 observations
Volcanology
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| volcanic_eruption | 5,000 | 0009-12-31 | 2026-03-24 | 736412d |
| volcano_info | 4,590 | 2026-03-24 | 2026-03-25 | 1d |
| volcano_alert | 1,917 | 2009-11-18 | 2026-03-25 | 5971d |
| holocene_volcano | 1,222 | 2026-03-24 | 2026-03-24 | 0d |
Domain total: 12,729 observations
Near-Earth Objects
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| neo_fireball | 355 | 1998-01-04 | 2026-03-23 | 10305d |
| neo_close_approach | 10,667 | 2026-03-23 | 2026-03-25 | 2d |
Domain total: 11,022 observations
Gravitational Waves
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| gw_observing_run | 798 | 2026-03-23 | 2026-03-25 | 2d |
| gw_merger | 368 | 2005-11-03 | 2025-01-14 | 7012d |
| gw_detector_h1 | 38 | 2026-03-23 | 2026-03-25 | 2d |
| gw_detector_v1 | 38 | 2026-03-23 | 2026-03-25 | 2d |
| gw_detector_k1 | 38 | 2026-03-23 | 2026-03-25 | 2d |
| gw_detector_l1 | 38 | 2026-03-23 | 2026-03-25 | 2d |
Domain total: 1,318 observations
Optical Transients (ZTF)
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| ztf_sn_candidate | 1,000 | 2026-03-24 | 2026-03-25 | 1d |
| ztf_solar_system_mpc | 900 | 2026-03-24 | 2026-03-25 | 1d |
| ztf_solar_system_candidate | 630 | 2026-03-24 | 2026-03-25 | 1d |
| ztf_unknown | 600 | 2026-03-24 | 2026-03-24 | 0d |
| ztf_kilonova_candidate | 140 | 2026-02-09 | 2026-03-24 | 43d |
Domain total: 3,270 observations
Climate Indices
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| climate_oni | 1,826 | 1949-12-31 | 2025-12-31 | 27759d |
| climate_mei_v2 | 1,132 | 1978-12-31 | 2025-12-31 | 17167d |
| drought_area_pct | 12,990 | 2010-01-04 | 2026-03-23 | 5922d |
| wb_SP.POP.TOTL | 2,490 | 1959-12-31 | 2022-12-31 | 23011d |
| wb_AG.LND.FRST.ZS | 2,038 | 1989-12-31 | 2022-12-31 | 12053d |
| wb_EG.USE.PCAP.KG.OE | 2,004 | 1989-12-31 | 2022-12-31 | 12053d |
Domain total: 22,480 observations
Satellite
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| sar_scene | 5,516 | 2026-03-14 | 2026-03-24 | 10d |
Domain total: 5,516 observations
Catalog / Autosense
| Metric | Records | Start | End | Span |
|---|---|---|---|---|
| catalog_csv_row | 5,349,665 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_file | 1,303,883 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_xlsx_row | 616,971 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_zip_entry | 107,812 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_directory | 97,839 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_text_file | 33,483 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_geojson_feature | 6,100 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_catalog_collection | 3,550 | 2026-03-19 | 2026-03-25 | 6d |
| catalog_json_object | 1,028 | 2026-03-20 | 2026-03-25 | 5d |
| catalog_directory_entry | 222 | 2026-03-19 | 2026-03-19 | 0d |
Domain total: 7,520,553 observations
Research Workspaces
| # | Workspace | Title |
|---|---|---|
| 1 | aqi-weather-coupling | Air Quality–Weather Coupling |
| 2 | california-streamflow | California Streamflow Anomaly Detection |
| 3 | city-warming-trends | Urban Temperature Trends — Are Cities Warming in Real-Time Data? |
| 4 | compound-anomalies | Compound Environmental Anomalies — Multi-Metric Unusual Days |
| 5 | cross-domain-clustering | Cross-Domain Temporal Clustering Atlas — Inter-Event Time Analysis Across Environmental Metrics (Paper) |
| 6 | earthquake-spatial-clustering | Temporal Clustering of Global M4+ Earthquakes — Spatial clustering |
| 7 | earthquake-temporal-clustering | Temporal Clustering of Global M4+ Earthquakes |
| 8 | enso-drought-correlation | ENSO Phase vs US Drought Severity |
| 9 | enso-seismicity | ENSO Teleconnection to Global Seismicity — Replication Study |
| 10 | granger-causality | Cross-Domain Granger Causality Network (Paper) |
| 11 | ligo-environment | LIGO–Environment Coupling |
| 12 | march-2026-fireballs | March 2026 Fireball Cluster — Statistical Significance and Space Weather Context (Paper) |
| 13 | notebook-template.ipynb | notebook-template.ipynb |
| 14 | radiation-global-baseline | Global Environmental Radiation Baseline from Citizen Science — Signal vs Sampling Bias |
| 15 | solar-geomagnetic-lag | Solar Flux–Kp Index Time Lag — Paper Replication Study |
| 16 | solar-seismic-correlation | Solar Activity and Earthquake Frequency — Is There a Signal? |
| 17 | solar-terrestrial-forcing | Solar Forcing of Terrestrial Geophysics |
| 18 | tornado-climatology | US Tornado Climatology 1950-2023 |
| 19 | volcano-earthquake | Volcano-Earthquake Coupling |
Papers
| # | Title | Path | Pages |
|---|---|---|---|
| 1 | Temporal Clustering is Universal | workspaces/cross-domain-clustering/paper/paper.pdf | 3 |
| 2 | Cross-Domain Predictive Coupling | workspaces/granger-causality/paper/paper.pdf | 3 |
| 4 | March 2026 Fireball Cluster | workspaces/march-2026-fireballs/paper/paper.pdf | 3 |
Data Sources by Type
| Type | Count | Description |
|---|---|---|
| Government APIs (USGS, NOAA, NASA) | ~30 | Core scheduled fetchers |
| Michael's EPA/data.gov additions | ~100+ | AutoSense ingestion |
| Scientific archives (Smithsonian, SILSO, GWOSC) | ~10 | Historical catalogs |
| Real-time feeds (NWS, SPC, GOES, DSCOVR) | ~10 | Sub-minute updates |