Spider Bug Fixes

Two Spider bugs were fixed. First, the "stale status" bug: when re-running the Spider, the UI would briefly show the previous run's final status instead of "Running" because the background task hadn't yet written to the database. The fix adds a guard in GetStatus() that checks the in-memory task state and returns "Running" if the task is still active, regardless of what the database says.

Second, the Afterword page ("The Closing Door") was causing an "Illegal characters in path" error during indexing. The root cause was a commented-out line '.ThumbnailPath = "" that was being matched by the text-based property extraction in AssignPropertiesFromFile(). Removing the commented-out line eliminated the error.

Spider UI Simplified

The Spider page previously offered checkboxes to choose whether to scan Contents, Gateways, or both. In practice, you always need to scan both, so the checkboxes were removed. The Spider now always indexes both Contents and Gateways. The "Include unpublished" option remains.

Site-Wide Content Review

Every content page on the site—approximately 971 pages across all sections—was reviewed for typos, spelling errors, grammatical errors, and factual errors. Over 800 corrections were made across 438 files:

Common issues included:

• Spelling errors ("archetecture", "Lousiana", "massiff", "ocilliscope", hundreds more)
• The word "desert" used where "dessert" was meant (food context)—found across dozens of pages
• Wrong words ("discreet" for "discrete", "free reign" for "free rein", "pouring over" for "poring over")
• Celebrity name misspellings ("Brittany Spears", "Dan Akroyd", "Matthew Shepherd", "Eddie Fischer")
• Factual errors (Plato's dates listed as Pythagoras's, Chichen Itza called Incan instead of Mayan, "Smithsonian Institute" corrected to "Institution", CD sample rate listed as 41,000 instead of 44,100)
• Missing or extra words, unclosed HTML tags, its/it's confusion, and smart quote cleanup
• OCR artifacts in the 1975 short story "Secret of the Eternal City" (~90 fixes for character substitutions like "1" for "I")