Update drone sightings base-event release

Verified local release drone-sightings-base-events-uap-20260425-r1: 10 event clusters, 32 source rows, 0 verifier failures.

dataset_bundle/README.md

@@ -3,6 +3,7 @@
 A small, review-oriented slice of U.S. public-source and FAA-reported drone sightings mapped against official covered-area registries.
 
 This release tracks reported drone sightings from public-source news stories and FAA preliminary UAS sighting reports; it does not prove intent, wrongdoing, threat, or a verified security breach.
+It also includes a conservative UAP/drone language overlay so readers can distinguish official UAS records from ordinary drone language and sources that explicitly use mystery-drone, UFO, or UAP wording.
 
 ## Included Files
 
@@ -10,6 +11,7 @@ This release tracks reported drone sightings from public-source news stories and
 - `monitored_areas.csv`
 - `event_sources.csv`
 - `daily_area_rollup.csv`
+- `uap_language_overlay_report.json`
 - `public_release_manifest.json`
 - `methodology.md`
 - `limitations_and_blind_spots.md`
@@ -19,6 +21,7 @@ This release tracks reported drone sightings from public-source news stories and
 ## Caveats
 
 - This release tracks reported drone sightings from public-source news stories and official FAA UAS sighting reports; FAA reports are still preliminary sighting records, not verified federal incident findings.
+- UAP-adjacent labels are source-language overlap labels only; they do not verify that an object was a UAP, anomalous, or non-human.
 - A reported sighting does not by itself prove intent, threat, wrongdoing, or the presence of a hostile actor.
 - Events are plotted at the covered-area point or centroid, not at a freehand geocoded story location.
 - Some event dates use article publication dates as bounded proxies when an observed date is not extractable from the story.

dataset_bundle/limitations_and_blind_spots.md

@@ -1,9 +1,12 @@
 # Limitations And Blind Spots
 
 - This release tracks reported drone sightings from public-source news stories and FAA preliminary UAS sighting reports; it does not prove intent, wrongdoing, threat, or a verified security breach.
+- UAP-adjacent labels mean the source language overlaps with mystery-drone or UFO/UAP wording; they are not UAP determinations.
 - This is a public-source and preliminary-reporting dataset, not a verified government incident ledger.
 - Stories behind paywalls, JavaScript-heavy pages, or blocked fetches can fall out of the slice.
 - Event points are covered-area centroids or official point locations, not narrative story coordinates.
 - Publication dates are used as bounded proxies when a direct observation date is not extractable.
 - Ambiguous multi-area stories stay in the internal review queue and are excluded from the public map.
-- Current gap: `port` has `370` monitored areas but no public events in this slice.
+- Current gap: `airport` has `19407` monitored areas but no public events in this slice.
+- Current gap: `port` has `370` monitored areas but no public events in this slice.
+- Current gap: `power_plant` has `16104` monitored areas but no public events in this slice.

dataset_bundle/methodology.md

@@ -8,11 +8,13 @@ This release shows a bounded set of U.S. public-source and FAA-reported drone si
 - News candidates are harvested through a bounded search layer and then fetched as raw article HTML for deterministic parsing.
 - Official FAA UAS sighting report rows are included only when a strict airport-code match resolves to one monitored airport.
 - Source records are matched only to covered-area registry entries and deduped into area-scoped events.
+- Each event also gets a deterministic source-language overlay that separates official UAS reports, ordinary drone-language reports, mystery-drone language, and explicit UFO/UAP language.
 - When a source mentions more than one plausible area and a single primary area cannot be resolved deterministically, the source is kept out of the public map.
 
 ## Source Window
-- Start: `2024-04-24`
+- Start: `2023-01-01`
 - End: `2026-04-24`
 
 ## What This Does Not Prove
-This release tracks reported drone sightings from public sources and FAA preliminary sighting reports; it does not prove intent, threat, wrongdoing, illegality, or the identity of any aircraft operator.
+This release tracks reported drone sightings from public sources and FAA preliminary sighting reports; it does not prove intent, threat, wrongdoing, illegality, or the identity of any aircraft operator.
+The UAP-adjacent overlay is a language classifier only; it does not verify that a reported object was anomalous or a UAP.

dataset_bundle/public_release_manifest.json

@@ -1,21 +1,21 @@
 {
-  "public_version": "drone-sightings-public-20260425-r7",
+  "public_version": "drone-sightings-base-events-uap-20260425-r1",
   "title": "Drone Sightings Near Covered U.S. Military and Civilian Areas",
-  "release_date": "2026-04-25T09:31:32.437334+00:00",
-  "source_run_name": "drone_sightings_24mo_faa_release_candidate_20260425_r4",
+  "release_date": "2026-04-25T15:17:58.986193+00:00",
+  "source_run_name": "drone_sightings_curated_base_events_20260425_r6",
   "slice_description": "A small, review-oriented slice of U.S. public-source and FAA-reported drone sightings mapped against official covered-area registries.",
   "source_window": {
-    "start_date": "2024-04-24",
+    "start_date": "2023-01-01",
     "end_date": "2026-04-24",
-    "window_days": 730
+    "window_days": 1209
   },
   "counts": {
-    "events": 2508,
+    "events": 10,
     "monitored_areas": 36702,
-    "event_sources": 2551,
-    "daily_area_rollup_rows": 2334,
-    "article_candidates": 309,
-    "article_fetch_failed": 7
+    "event_sources": 32,
+    "daily_area_rollup_rows": 10,
+    "article_candidates": 44,
+    "article_fetch_failed": 2
   },
   "covered_area_counts_by_type": {
     "airport": 19407,
@@ -24,37 +24,53 @@
     "power_plant": 16104
   },
   "event_counts_by_type": {
-    "airport": 2501,
-    "military_installation": 6,
-    "power_plant": 1
+    "military_installation": 10
   },
   "event_counts_by_class": {
-    "civilian": 2502,
-    "military": 6
+    "military": 10
   },
   "quality_summary": {
-    "unresolved_area_share": 0.09233,
-    "review_article_count": 260,
-    "weak_area_review_count": 39,
-    "weak_area_context_review_count": 23,
-    "weak_event_context_review_count": 20,
-    "off_scope_review_count": 35,
-    "false_match_canary_review_count": 1,
-    "article_fetch_failure_share": 0.002486,
-    "article_fetch_failure_count": 7,
+    "unresolved_area_share": 0.272727,
+    "review_article_count": 12,
+    "weak_area_review_count": 2,
+    "weak_area_context_review_count": 0,
+    "weak_event_context_review_count": 2,
+    "off_scope_review_count": 1,
+    "false_match_canary_review_count": 0,
+    "article_fetch_failure_share": 0.045455,
+    "article_fetch_failure_count": 2,
     "news_search_failure_count": 0,
     "official_source_failure_count": 0,
     "source_unavailable_count": 0,
-    "duplicate_cluster_share": 0.004785,
+    "duplicate_cluster_share": 0.9,
     "conflicting_area_cluster_count": 0,
-    "review_conflicting_area_cluster_count": 1,
-    "report_date_proxy_share": 0.000399
+    "review_conflicting_area_cluster_count": 0,
+    "report_date_proxy_share": 0.5
+  },
+  "uap_language_overlay": {
+    "interpretation": "This is a source-language overlay. It labels whether sources use drone/UAS, mystery-drone, or explicit UFO/UAP language; it does not verify that a reported object was a drone or a UAP.",
+    "event_counts_by_uap_overlap_label": {
+      "drone_or_uas_report": 1,
+      "explicit_ufo_uap_language": 2,
+      "known_non_uap_drone_language": 2,
+      "uap_adjacent_drone_language": 5
+    },
+    "event_counts_by_language_family": {
+      "drone_or_uas_report": 1,
+      "explicit_ufo_uap_language": 2,
+      "known_operator_or_mundane_drone": 2,
+      "mystery_drone_language": 5
+    },
+    "uap_adjacent_event_count": 5,
+    "explicit_ufo_uap_event_count": 2,
+    "official_uas_event_count": 0
   },
   "included_tables": [
     "events.csv",
     "monitored_areas.csv",
     "event_sources.csv",
     "daily_area_rollup.csv",
+    "uap_language_overlay_report.json",
     "public_release_manifest.json",
     "methodology.md",
     "limitations_and_blind_spots.md",
@@ -63,6 +79,7 @@
   ],
   "caveats": [
     "This release tracks reported drone sightings from public-source news stories and official FAA UAS sighting reports; FAA reports are still preliminary sighting records, not verified federal incident findings.",
+    "UAP-adjacent labels are source-language overlap labels only; they do not verify that an object was a UAP, anomalous, or non-human.",
     "A reported sighting does not by itself prove intent, threat, wrongdoing, or the presence of a hostile actor.",
     "Events are plotted at the covered-area point or centroid, not at a freehand geocoded story location.",
     "Some event dates use article publication dates as bounded proxies when an observed date is not extractable from the story.",

dataset_bundle/quality_checks.md

@@ -1,16 +1,16 @@
 # Quality Checks
 
-- Event rows: `2508`
+- Event rows: `10`
 - Monitored areas: `36702`
-- Event source rows: `2551`
-- Article fetch failure share: `0.002486`
+- Event source rows: `32`
+- Article fetch failure share: `0.045455`
 - Source unavailable count: `0`
-- Review article count: `260`
-- False-match canary review count: `1`
-- Duplicate cluster share: `0.004785`
+- Review article count: `12`
+- False-match canary review count: `0`
+- Duplicate cluster share: `0.9`
 - Conflicting area clusters: `0`
-- Review-suppressed conflicting area clusters: `1`
-- Unresolved area share: `0.09233`
+- Review-suppressed conflicting area clusters: `0`
+- Unresolved area share: `0.272727`
 
 ## Public Integrity Language
 

dataset_bundle/schema_notes.md

@@ -4,6 +4,9 @@
 - `event_date`: observed date when extractable, otherwise a publication-date proxy.
 - `review_status`: public rows are auto-included deterministic event rows only.
 - `source_count`: number of supporting stories retained in the dedupe cluster.
+- `language_family`: deterministic source-language bucket such as official UAS report, ordinary drone report, mystery-drone language, or explicit UFO/UAP language.
+- `uap_overlap_label`: conservative language-overlap label; it is not a verification that the object was a UAP.
+- `ambiguity_score`: deterministic language score, not a confidence score or factual finding.
 
 ## monitored_areas.csv
 - Rows represent official covered-area points or centroids used for event plotting.

dataset_bundle/uap_language_overlay_report.json

@@ -0,0 +1,91 @@
+{
+  "report_kind": "drone_uap_language_overlay_v1",
+  "interpretation": "This is a source-language overlay. It labels whether sources use drone/UAS, mystery-drone, or explicit UFO/UAP language; it does not verify that a reported object was a drone or a UAP.",
+  "event_count": 10,
+  "review_article_count": 12,
+  "normalized_article_count": 43,
+  "event_counts_by_uap_overlap_label": {
+    "drone_or_uas_report": 1,
+    "explicit_ufo_uap_language": 2,
+    "known_non_uap_drone_language": 2,
+    "uap_adjacent_drone_language": 5
+  },
+  "event_counts_by_language_family": {
+    "drone_or_uas_report": 1,
+    "explicit_ufo_uap_language": 2,
+    "known_operator_or_mundane_drone": 2,
+    "mystery_drone_language": 5
+  },
+  "review_counts_by_uap_overlap_label": {
+    "drone_or_uas_report": 5,
+    "known_non_uap_drone_language": 3,
+    "uap_adjacent_drone_language": 4
+  },
+  "article_counts_by_uap_overlap_label": {
+    "drone_or_uas_report": 9,
+    "explicit_ufo_uap_language": 3,
+    "known_non_uap_drone_language": 21,
+    "uap_adjacent_drone_language": 10
+  },
+  "uap_adjacent_event_count": 5,
+  "explicit_ufo_uap_event_count": 2,
+  "official_uas_event_count": 0,
+  "sample_uap_adjacent_events": [
+    {
+      "event_id": "event:dod:joint-base-langley-eustis:va:2024-10-13:0001",
+      "event_date": "2024-10-13",
+      "area_name": "Joint Base Langley-Eustis",
+      "uap_overlap_label": "explicit_ufo_uap_language",
+      "headline": "Pentagon Baffled By 17-Day Drone Swarm At US Military Base",
+      "primary_source_url": "https://dronexl.co/2024/10/13/pentagon-drone-swarm-us-military-base/"
+    },
+    {
+      "event_id": "event:dod:hill-air-force-base:ut:2024-12-18:0002",
+      "event_date": "2024-12-18",
+      "area_name": "Hill Air Force Base",
+      "uap_overlap_label": "uap_adjacent_drone_language",
+      "headline": "Multiple Drone Sightings Reported Near Hill Air Force Base Amid Nationwide Military Installation Incidents",
+      "primary_source_url": "https://dronexl.co/2024/12/17/multiple-drone-sightings-reported-near-hill-air-force-base/"
+    },
+    {
+      "event_id": "event:dod:wright-patterson-air-force-base:oh:2024-12-16:0003",
+      "event_date": "2024-12-16",
+      "area_name": "Wright-Patterson Air Force Base",
+      "uap_overlap_label": "uap_adjacent_drone_language",
+      "headline": "Multiple Drone Incursions Force Temporary Shutdown At Ohio's Wright-Patterson Air Force Base",
+      "primary_source_url": "https://dronexl.co/2024/12/15/drone-incursions-ohio-wright-patterson-air-force-base/"
+    },
+    {
+      "event_id": "event:dod:naval-weapons-station-earle-nj:nj:2024-12-09:0004",
+      "event_date": "2024-12-09",
+      "area_name": "Naval Weapons Station Earle NJ",
+      "uap_overlap_label": "uap_adjacent_drone_language",
+      "headline": "Nearly 12 Drones Flew Over Naval Weapons Station Earle In Middletown",
+      "primary_source_url": "https://patch.com/new-jersey/middletown-nj/6-drones-flew-over-naval-weapons-station-earle-friday-night"
+    },
+    {
+      "event_id": "event:dod:joint-base-mcguire-dix-lakehurst:nj:2024-09-15:0008",
+      "event_date": "2024-09-15",
+      "area_name": "Joint Base McGuire-Dix-Lakehurst",
+      "uap_overlap_label": "explicit_ufo_uap_language",
+      "headline": "New Jersey military base confirms multiple drone contraband-smuggling incursions this year",
+      "primary_source_url": "https://www.foxnews.com/us/new-jersey-military-base-confirms-multiple-drone-contraband-smuggling-incursions-year"
+    },
+    {
+      "event_id": "event:dod:barksdale-air-force-base:la:2026-03-09:0009",
+      "event_date": "2026-03-09",
+      "area_name": "Barksdale Air Force Base",
+      "uap_overlap_label": "uap_adjacent_drone_language",
+      "headline": "Leak Reveals Major Drone Incident at Air Force Base in Trump’s War",
+      "primary_source_url": "https://www.thedailybeast.com/leak-reveals-major-drone-incident-at-louisiana-air-force-base-in-trumps-war/"
+    },
+    {
+      "event_id": "event:dod:joint-base-myer-henderson-hall:va:2026-03-19:0010",
+      "event_date": "2026-03-19",
+      "area_name": "Joint Base Myer-Henderson Hall",
+      "uap_overlap_label": "uap_adjacent_drone_language",
+      "headline": "Unidentified drones reported flying over Fort McNair; expert calls it security concern",
+      "primary_source_url": "https://ktul.com/news/nation-world/unidentified-drones-fly-over-fort-mcnair-expert-calls-it-security-concern"
+    }
+  ]
+}

public_space_app.py

@@ -56,6 +56,9 @@ def _visible_events(events: pd.DataFrame, frame_dates: list[str], frame_index: i
 def _point_table(events: pd.DataFrame) -> pd.DataFrame:
     ordered = events.copy()
     ordered["event_date"] = ordered["event_date"].astype(str)
+    for column in ["uap_overlap_label", "language_family", "ambiguity_score", "phenomenon_terms"]:
+        if column not in ordered.columns:
+            ordered[column] = ""
     ordered = ordered.sort_values(["event_date", "event_id", "headline"], ascending=[True, True, True]).reset_index(drop=True)
     return ordered[
         [
@@ -70,6 +73,9 @@ def _point_table(events: pd.DataFrame) -> pd.DataFrame:
             "lon",
             "source_count",
             "confidence_label",
+            "uap_overlap_label",
+            "language_family",
+            "ambiguity_score",
             "review_status",
             "primary_source_url",
         ]
@@ -79,6 +85,10 @@ def _point_table(events: pd.DataFrame) -> pd.DataFrame:
 def _build_map(events: pd.DataFrame, frame_label: str):
     if events.empty:
         return px.scatter_mapbox(pd.DataFrame({"lat": [], "lon": []}), lat="lat", lon="lon", zoom=3, height=560)
+    events = events.copy()
+    for column in ["uap_overlap_label", "language_family"]:
+        if column not in events.columns:
+            events[column] = ""
     fig = px.scatter_mapbox(
         events,
         lat="lat",
@@ -92,6 +102,8 @@ def _build_map(events: pd.DataFrame, frame_label: str):
             "event_date": True,
             "source_count": True,
             "confidence_label": True,
+            "uap_overlap_label": True,
+            "language_family": True,
             "primary_source_url": True,
             "lat": False,
             "lon": False,
@@ -132,9 +144,13 @@ def _detail_markdown(event_sources: pd.DataFrame, events: pd.DataFrame, event_id
         f"- `state`: `{event_row['state']}`",
         f"- `lat`: `{event_row['lat']}`",
         f"- `lon`: `{event_row['lon']}`",
-        f"- `source_count`: `{event_row['source_count']}`",
-        f"- `confidence_label`: `{event_row['confidence_label']}`",
-        f"- `review_status`: `{event_row['review_status']}`",
+            f"- `source_count`: `{event_row['source_count']}`",
+            f"- `confidence_label`: `{event_row['confidence_label']}`",
+            f"- `uap_overlap_label`: `{event_row.get('uap_overlap_label', '')}`",
+            f"- `language_family`: `{event_row.get('language_family', '')}`",
+            f"- `ambiguity_score`: `{event_row.get('ambiguity_score', '')}`",
+            f"- `phenomenon_terms`: `{event_row.get('phenomenon_terms', '')}`",
+            f"- `review_status`: `{event_row['review_status']}`",
         f"- `primary_source_url`: {event_row['primary_source_url']}",
         "",
         "#### Summary",