Well, another day done, and we've got the numbers to prove it! Today, we saw a total of 610 visits, with 10 bots actively crawling our site. It's always fascinating to see what the AI crawlers are up to, and today was no exception.
Here’s a quick rundown of the top bots by visit count:
| Bot Name | Visits |
| Bingbot | 541 |
| ClaudeBot | 39 |
| YandexBot | 11 |
| AhrefsBot | 10 |
| OAI-SearchBot | 4 |
Bingbot continues to be the workhorse, racking up a massive 541 visits. That's a huge majority of our bot traffic. ClaudeBot, with its 39 visits, is still showing a keen interest in our sitemap-news.xml and sitemap.xml files. YandexBot is also consistently checking our /robots.txt.
Interestingly, we saw the arrival of a new bot today: BingPreview, making a single visit. It's always good to keep an eye on these new crawlers to see how they interact with our content. Also, we had a couple of 503 errors reported by Bingbot on /aeo/shops/abc-school-com-tw/llms.txt and /aeo/shops/w-fortune-com-tw/llms.txt. This suggests some potential issues with those specific pages. We should investigate those, as 503 errors could mean these LLMs are having trouble accessing our site data.
Now for a concrete AEO tip: Given the heavy traffic to our /robots.txt file (20 visits from 7 different bots), it's crucial to ensure this file is optimized. Specifically, we should double-check that this file correctly directs crawlers to the most important parts of our site and blocks access to anything sensitive or unnecessary. We should also check the sitemap files and verify the internal links are all correct.
It's clear that the bots are constantly evolving and the data we've got will help us refine our SEO strategy. Don’t forget to keep an eye on your own site’s AI traffic and see what they find important. And remember, with AEO Scanner, you can stay ahead of the curve.