Another day, another look at the AI crawler activity on AEO Scanner. We saw a total of 636 visits today, with 8 active bots crawling our site. Let's dive into the specifics.
Here's a quick overview of the top 5 bots, based on their visit counts:
| Bot Name | Visits |
| Bingbot | 606 |
| YandexBot | 12 |
| AhrefsBot | 11 |
| ChatGPT-User | 2 |
| DuckDuckBot | 2 |
Bingbot is still dominating the scene, accounting for the vast majority of our traffic with 606 visits. Their focus seems to be on sitemaps. Notably, they hit the sitemap-static.xml, sitemap-site-profiles-2.xml, and sitemap-hosted-llms-3.xml files multiple times. YandexBot and AhrefsBot are also quite active, though their visit counts are significantly lower. We also noticed some activity from ChatGPT-User and DuckDuckBot, which is always interesting to track.
The most popular path overall today was /robots.txt, with 8 visits from 6 different bots. This isn't surprising, as bots always check this file to understand our crawling instructions. The home page '/' and the sitemap-news.xml, sitemap.xml, and sitemap-hosted-llms-3.xml were also popular, each garnering 4 visits. It's a good sign that our sitemaps are being actively crawled, indicating that our content is being indexed effectively.
Looking at the errors, we see that Bingbot encountered 2 404 errors when attempting to access /aeo/shops/h-c-com-tw/llms.txt and /aeo/shops/zenisis.ai/llms.txt. This suggests that these specific LLM files may be missing or misconfigured.
Our hourly distribution data shows a relatively steady flow of traffic throughout the day, with peaks during certain hours. The period from 19:00 saw the most visits, with 49 visits. The lowest numbers were between 03:00 and 05:00, with 13, 24, and 12 visits respectively. The consistent crawling activity suggests that our site is being actively monitored by various bots.
A Concrete AEO/GEO Tip:Given the 404 errors encountered by Bingbot, we should review the /aeo/shops/h-c-com-tw/llms.txt and /aeo/shops/zenisis.ai/llms.txt files (or the intended locations of these files). Double-check that these LLM-related files exist and are correctly configured for any AEO/GEO targeting strategies these shops have, and if they are no longer relevant, they should be removed and the links updated.
That's the rundown for today. Remember, understanding your site's AI crawler traffic is crucial for optimizing your AEO and overall SEO performance. Keep an eye on your own site's activity with AEO Scanner!