Well, another day, another mountain of data from the AEO Scanner. Today, we saw a total of 620 visits to the site, with a healthy 6 bots actively crawling around. Let's dive into what caught our eye today.
First, a quick overview of the top bots by visit count:
| Bot Name | Visits |
| Bingbot | 600 |
| YandexBot | 9 |
| ChatGPT-User | 4 |
| OAI-SearchBot | 4 |
| Bytespider | 2 |
It's pretty clear that Bingbot is dominating the scene, accounting for the vast majority of our bot traffic. The distribution is quite skewed, but that's not necessarily a bad thing – it just highlights where the focus lies. YandexBot is present, a good sign for broad coverage, and we’re seeing a few other interesting players.
Now, let's zoom in on a few specific observations. The sheer volume of Bingbot activity is, as usual, noteworthy. Examining the top paths visited by Bingbot reveals a strong emphasis on sitemaps. They hit several sitemap files multiple times, specifically /sitemap-hosted-llms-1.xml (4 visits), /sitemap-site-profiles-2.xml (3 visits) and /sitemap-hosted-llms-3.xml (3 visits). This suggests that Bing is prioritizing indexing of content related to hosted LLMs and site profiles. The presence of ChatGPT-User indicates that even AI chatbots are actively crawling our blog content, primarily focusing on posts like /blog/perplexity-optimization, /blog/llms-txt-guide and /blog/ai-crawler-robots-txt.
Also of note are the errors: We had a few 404s and a 503 error pop up. Specifically, Bytespider hit a 503 on /aeo/shops/flexoplate-com-tw/llms.txt, and Bingbot stumbled on a couple of 404s trying to access the same type of file on two other shop sites: /aeo/shops/w-r-com-tw/llms.txt and /aeo/shops/xn-z1xr5zr7nnui-tw/llms.txt. Time to check those shop site LLMs. They might be temporarily down.
For an actionable GEO/AEO tip based on today’s data: Given Bingbot's heavy focus on sitemaps, make sure yours are up-to-date and comprehensive, especially for content related to hosted LLMs, site profiles, and any new blog content that you want to be indexed quickly. Consider providing both HTML and XML sitemaps. Double-check any pages that generate 404s or 503 errors and make sure all bots can access them.
That's all for today. Remember to keep an eye on your own site's AI traffic with AEO Scanner!