Well, folks, another day in the digital trenches is done! Today, we saw a total of 689 visits to AEO Scanner. Our friendly (and not-so-friendly) AI bots were buzzing, with a total of 9 bots crawling our site. Let's dive into what they were up to.
Here's a quick rundown of the top bots by visit count:
| Bot Name | Visits |
| Bingbot | 615 |
| ClaudeBot | 29 |
| Bytespider | 22 |
| AhrefsBot | 10 |
| YandexBot | 6 |
Bingbot continues to be the workhorse, racking up a massive 615 visits. That's a huge portion of our traffic! It's worth noting the consistent interest in the /robots.txt file from various bots, as well as several sitemap files. ClaudeBot’s activity is also notable, focusing heavily on our sitemap files, particularly /sitemap-news.xml which saw 12 visits. That's a key indicator of its priorities.
Looking at the error logs, we see some interesting 503 errors and a 404. All the 503 errors were triggered by Bingbot, targeting /aeo/shops/ URLs. This suggests that there might be ongoing crawling of these shops, and the server cannot keep up.
Now, for a concrete AEO/GEO tip: Given the Bingbot errors, if you operate a shop, double-check your server response times to avoid 503 errors. It might be worthwhile to monitor the shops that are triggering those errors and make sure that they are correctly set up.
That's all for today. Remember, keeping an eye on your AI crawler traffic is crucial to understanding how your site is being perceived and indexed. Use AEO Scanner to monitor your own site's activity and stay ahead of the curve!