Another day, another peek into the digital trenches! Today, we observed a total of 717 visits to the site, with a healthy 10 bots actively crawling our pages. It's always fascinating to see how these automated visitors interact with our content.
Here's a quick look at the top 5 bots that made the most noise today:
| Bot Name | Visits |
| Bingbot | 547 |
| AhrefsBot | 98 |
| YandexBot | 32 |
| ClaudeBot | 30 |
| OAI-SearchBot | 4 |
Bingbot continues to dominate, as expected, but the activity from ClaudeBot caught our eye. While they only racked up 30 visits, they were hitting /sitemap-news.xml a whopping 12 times and /sitemap.xml 10 times. That's a significant focus on our sitemap, which suggests they're prioritizing content discovery and indexing. Interesting.
We also welcomed a new bot to the party: Amazonbot. It only made a single visit, primarily to /robots.txt. The steady focus on the robots.txt file across many bots (20 visits in total) suggests that they're all diligently respecting our crawl directives – a good sign for maintaining control over indexing.
Now, for a concrete actionable GEO/AEO tip. Given the strong showing from ClaudeBot and their focus on our sitemaps, we should double-check the freshness of the content included there. We should ensure that our news sitemap is dynamically generated, up-to-date and prioritized to the right content to increase the chances of the most relevant content being indexed and prioritized, especially given the bot’s behaviour today. This will help them find our latest and most relevant AEO content quickly. We should also check other sitemaps to see if they're properly reflecting our current site structure.
Keep an eye on your own site's AI traffic. AEO Scanner is here to help you understand and leverage these insights to keep your site optimized!