Research episode · Fishing for Agents · Oct 9, 2026

Your Website's Next Visitor Won't Be Human.

AI agents quietly passed us on the internet — and most websites can't be seen by them at all. I go phishing for agents on the big sites, open up the llms.txt hype machine, and show you what a website looks like when your visitor is a machine.

In this episode

What you'll see

  • The June 3, 2026 milestone: Cloudflare Radar confirms automated requests hit 57.5% of all HTML web traffic — real, actual humans down to 42.5%
  • What AI agents actually sense, level by level — and why clean text beats dazzling design
  • PageSpeed's new "agentic browsing" test: llms.txt, accessibility trees, and CLS
  • The raw numbers behind "llms.txt is dead": 31 total fetches, GPTBot exactly once
  • Harvard/BCG's jagged-frontier study: GPT-4 worth about $26,000 per year per employee (with a catch)
  • How I use my own local LLM as a "word calculator" — data sovereignty in plain language
Every claim sourced

Sources cited in this episode

  1. LovedByAI — "llms.txt Is Dead" study video
  2. LovedByAI — The Lab (the study data)
  3. Pew Research — Google users are less likely to click when an AI summary appears
  4. Matthew Prince interview (related) — "The Internet's Business Model Is Dead"
  5. + the full chapter list and timestamps in the video description
How I cite: every research episode lists its references — reports, articles, X posts, and videos used — here and in the YouTube description. Primary sources linked wherever they exist; unverified statements labeled as opinion.
Community

Compare notes with me all week

I build all of this in the open, with a crew of AI agents. If you're directing agents too — or wondering where to start — the Discord is where we trade what actually works.