Half my Traffic is Bots

I was checking my Cloudfront cache performance when I discovered that half my traffic is bots (50.77% if you’re keeping score).

  • My first thought was “!@(#)!”
  • My second thought was “What am I doing wrong?”
  • My third thought was “What does the internet say about this?”

And it turns out that pretty much half of everyone’s traffic is bots. Which doesn’t really make me feel that much better. Especially when I know that I wasn’t setting my cache-headers until last month.

I’m hoping this will get better with max-age=2592000 (30 days) on my older content.