Return to Fire

Where this began

On October 8, 2017, the Tubbs Fire came over the ridge into Santa Rosa. By morning our house was a chimney and a set of stone steps.

That fire did not make me a data scientist. I already loved this work — the pull of a question you can actually check. But when I sat down in early 2020 to build my first real project, at the very start of my career, there was never a question about the subject. It had to be fires.

I found the biggest wildfire dataset I could: 1.88 million US fires in a SQLite database. I wrote R by hand. I wrote Python by hand. I made maps, bar charts, a random forest. I published a three-part series and was proud of it — and I am still proud of it, because it was the beginning of something.

Here is the detail I did not dwell on at the time: that dataset ended in 2015. The fire that had just burned through my family's life was 22 months past the edge of the data. I was analyzing 1.88 million fires, and the one that mattered most to me could not, by construction, be one of them.

The database has since been updated through 2020, and a research team bolted 270 new columns onto every record — the weather at each ignition, the dryness of the fuels, the terrain, the people nearby. Somewhere in those 2.3 million rows is a row named TUBBS. We will get to it.

TL;DR

What 2020-me built

Three parts, written by hand at the start of a career: an R/ggplot exploration, a leaflet map tour, and a scikit-learn random forest. The originals stay online, unedited.

Respect first, because it is deserved. 2020-me picked a genuinely hard dataset — 1.88M rows in SQLite, not a tutorial CSV — and handled the database boundary correctly, closing connections and explaining why. Every figure got a paragraph of interpretation; nothing was dumped and abandoned. The maps used a proper Albers equal-area projection, which plenty of working analysts skip. And buried in Part III is one sentence of real instinct:

"I am going to drop a lot of the variables that are known after the fire. I want to see if we can predict the cause of fire by just the Latitude, Longitude, Month, year, and day of week."

That is leakage awareness, unprompted, self-taught, in 2020. The instinct was right — it just was not applied everywhere, and the features it trusted were quietly broken. Which brings us to the bug.

df['DATE'] = pd.to_datetime(df['DISCOVERY_DATE'])
df['MONTH'] = pd.DatetimeIndex(df['DATE']).month
df['DAY_OF_WEEK'] = df['DATE'].dt.dayofweek

The other 2020 problems, briefly and specifically:

• The headline conclusion outran the analysis. "It does seem climate change is a strong cause of this" rested on one straight trend line through raw annual counts — no climate variable existed anywhere in the data, and (as we will see) raw counts partly measure paperwork.
• The 94.7% was never questioned. A random 70/30 split let the model memorize coordinates; campfires were rare enough that guessing "not campfire" scored ~93%. Two other models landed on exactly 0.9000 and the notebook celebrated rather than squinted.
• Model 1 leaked. Predicting cause with FIRE_SIZE and containment dates in the feature set is using the aftermath to predict the beginning.
• Every fire was the same dot. A 1,200-acre fire and a 300,000-acre fire rendered identically on every map.
• The Florida section had a header, a figure, and zero sentences. It gets its words this time.

None of this is disqualifying for a first project. It is a starting line. The rest of this page is the same questions, asked the way I would ask them now.

The data, upgraded

Same national fire registry, two major versions later — plus 270 new columns of physics, fuels, terrain, and people attached to every single fire.

The backbone is the Fire Program Analysis Fire-Occurrence Database (FPA-FOD), the interagency registry of every reported wildfire in the US. My 2020 project used its 2015 edition via Kaggle. The current 6th edition runs 1992–2020 with 2.3 million fires. On top of it, the FPA FOD-Attributes dataset (Pourmohamad et al., 2024; Zenodo 10.5281/zenodo.8381129, CC-BY) attaches ~270 attributes to each record: gridMET fire weather on the discovery day (temperature, humidity, wind, vapor-pressure deficit, ERC), 5-day antecedent windows, local climatological percentiles, NDVI and land cover, elevation/slope/aspect, population, social-vulnerability indices, distances to fire stations. It is 29 annual CSVs, 4.68 GB raw, 308 columns wide.

The 2021–2025 extension. FPA-FOD ends in 2020, which would leave this rebuild six years behind the present. For the large-fire context series only, I pull annual aggregates (counts and acres of 1,000+ acre wildfires) from NIFC's WFIGS perimeter service. It is a different reporting system with different completeness, so it is drawn as a dashed, visibly separate segment, never mixed into the models, and never used for trend tests across the seam.

Honest scope notes: the attributes dataset covers the contiguous US — Alaska and Hawaii, which my 2020 national maps included, are absent here and that matters for national acreage (Alaska burns big). Cause is missing or undetermined for 8.4% of fires nationally — and for 30.8% of California-plus-Florida fires, which constrains every cause model downstream.

The full look

Part I's job, done the 2026 way: before any model exists, characterize what the table actually delivers — including what is missing, and where the registry itself changes shape.

Six bets, placed before the verdicts

Each hypothesis was written down with a decision rule; the lab fills in the verdict chips from trend_lab_results.json. Not all of them survived — including two claims 2020-me treated as obvious.

California: not more fires — more fire

The state's large-fire count trend is statistically unremarkable. Everything else about its fire behavior changed.

The row

FOD_ID 400015986. In 2020 this record did not exist to be found. Here is what the database now holds for the night everything burned.

Read the weather columns again. Bone-dry air, fuels at a top-decile energy state, and a wind field the daily average can only hint at. The row is the Diablo-wind signature written into a database — the same pattern the seasonal map shows for nearly every autumn disaster on the California coast ranges.

You can print this row yourself, offline, in one command: python examples/find_tubbs.py.

Florida, which finally gets its paragraphs

In 2020 the Florida section was a header and an unexamined image. It deserved better: Florida is the clearest counterexample to every "fires are exploding everywhere" take.

Florida burns constantly and on purpose: it runs one of the country's largest prescribed-burn programs, and its ecosystems are built to burn frequently and lightly. Its large-fire count trend over 29 years is a flat line (IRR 0.99/decade, MK p=0.612); its burned-area trend is indistinguishable from noise (MK p=0.468); and its fire season, if anything, contracted (257 → 228 days era-over-era, not significant).

So H6 — the 2020 claim that large wildfires were rising "across the U.S. and across California and Florida" — is rejected, and the rejection is the insight: the American fire problem is not a uniform national trend. It is a Western drying story, and Florida's stability is the control group that proves the point.

The national picture, with the paperwork removed

2020-me fit one line through national counts and read climate into it. The honest version has to separate physics from reporting first.

The 2021–2025 extension adds current-events context without contaminating the statistics: the WFIGS years include the quiet 2022–2023 lull and the ferocious 2024; January 2025's Los Angeles fires (Palisades, Eaton) barely register in acres — and were among the costliest disasters in state history, a reminder this page returns to in Limits: burned area is not damage.

The model lab: a museum piece and an honest machine

First rebuild the 2020 random forest exactly as it was — dead features, leaked outcome, random split — then sit it next to models evaluated the way 2026 requires.

The museum piece

Faithfully reconstructed on 1992–2015 California large fires (the old 13 cause classes approximated from NWCG's new taxonomy): the same RandomForest settings, the same random 70/30 split, MONTH pinned to 1 and DAY_OF_WEEK to Thursday exactly as the Julian bug left them, and FIRE_SIZE left in the features exactly as the leak allowed. It scores 49.4% on the 13-class task (the 2020 notebook reported 61.3%) and 96.0% on the celebrated campfire binary (2020: 94.7%) — against a guess-the-majority baseline of 95.7%. Re-scored under a temporal split, the 13-class museum model's macro-F1 is 0.14.

The honest machine

Gradient boosting (scikit-learn's HistGradientBoosting — native missing-value and categorical handling, no extra dependencies) on at-ignition features only: location, calendar (computed correctly this time), the fire weather of the day, fuel moisture, vegetation, terrain, and human presence. Named and excluded: FIRE_SIZE, size class, containment anything, agency, owner — if it isn't knowable at ignition, it isn't a feature. Cause labels are missing for 15.2% of CA fires; those rows sit out and that share is reported, not hidden.

Protocol: train ≤2014, validate 2015–2017, test 2018–2020 — the model never sees the era containing Tubbs. Inside the training era, 5-fold spatial-block cross-validation (1°×1° blocks) checks that scores survive when nearby fires can't leak across folds. Three baselines every model must beat: majority class, a groupby climatology (majority cause per 0.2° cell × month), and a linear model.

Defend it

Every headline claim on this page, against the strongest objection I could aim at it. Objections that partially land are conceded, in print.

Scoreboard

Six bets, six verdicts, one number each.

Six years later

What the beginner got right, what the rebuild fixed, and what changed in between.

The deeper change is speed of thought. In 2020, every idea cost an evening of hand-written code, so ideas went untested and enthusiasm attached to whatever numbers appeared. In 2026 I can spend that same evening trying twelve ideas, discarding nine, stress-testing three — the thinking is still mine; the friction is gone. This rebuild took a fraction of the original's calendar time and did roughly a hundred times the work.

The original trilogy stays online, unedited, exactly as a first project should: Part I · Part II · Part III. Be kind to it. It was the beginning.

Limits, stated plainly

• Reported ignitions are not fire risk. This registry sees fires that got reported; its small-fire completeness varies by state and era, and several analyses here exist specifically to route around that.
• Association is not attribution. The extreme-fire-weather shift at ignition is consistent with a warming, drying West; formal climate attribution requires counterfactual modeling this project does not attempt.
• Burned area is not damage. January 2025's Los Angeles fires were small in acres and catastrophic in loss. Acres are the measurable proxy here, not the human cost.
• CONUS only. Alaska and Hawaii are absent from the attributes dataset; 2020-me's national maps included them. National acreage figures here understate the US total.
• Daily 4-km weather. gridMET cannot see nighttime wind events like the one that drove Tubbs; the row's 6.0 m/s daily mean is the floor of that night's truth, not the story.
• Cause labels are incomplete and reclassified. A third of CA/FL records carry no usable cause; the old-13 museum crosswalk is approximate by construction.
• One fire anchors the narrative. The Tubbs row is one record given personal weight; the statistics never depend on it.

Reproduce it

Everything on this page regenerates from public data with pinned-minimum, plain Python. One network step, offline forever after.

python -m venv .venv
.venv\Scripts\activate                  # Windows
pip install -r requirements.txt

python fetch_raw.py --yes               # ~5 GB, once (or --years 2015-2020 to start smaller)
python fetch_recent.py                  # WFIGS 2021-2025 aggregates (seconds)
python reduce_raw.py                    # 4.68 GB -> ~24 MB of hash-locked caches (~10 min)

python examples\find_tubbs.py           # the row, offline, instant
python examples\headline_trend.py       # the headline IRRs, offline, instant

python run_eda.py                       # dataset anatomy: 6 figures
python run_trend_lab.py                 # H1-H6 verdicts + trend figures
python run_ml_lab.py                    # museum replica + honest models (~20 min)
python run_maps.py                      # the three maps
python verify_claims.py                 # every number in this article == the JSONs, or exit 1

Sources: FPA FOD-Attributes (CC-BY 4.0; Pourmohamad et al. 2024, ESSD) · FPA-FOD v6 (Short, USFS RDS-2013-0009.6) · NIFC WFIGS perimeters (public domain) · US Census cartographic boundaries (public domain).