AI Crawl Weekly · Week 45, 2026
First-party site logs · A complete calendar week · Downloadable PDF
brand.com editorial team · Published November 10, 2026 · 8 min read
AI and search crawlers:
Which brands are they visiting?
From 846,846 site requests, we identified 190,043 brand, company and organization profiles that received visits. Connecting sources, individual profiles and content types helps us observe how crawlers access brand information.
Daily crawler requests
Requests · A common linear scale with a zero baseline
- 11/02Mon1,833
- 11/03Tue1,512
- 11/04Wed283,047
- 11/05Thu376,524
- 11/06Fri38,309
- 11/07Sat75,847
- 11/08Sun69,774
Window: November 2, 00:00 to November 9, 00:00, Beijing time (UTC+8); the end timestamp is excluded.
From request volume to specific brands and content.
Requests concentrated in two days
A short burst dominated the week. Future comparisons should distinguish concentrated crawls from sustained visits.
Shared coverage10 companiesEach visited Amazon and Google
Each of these two profiles recorded visits from ten source companies. The matrix shows how coverage differs across profiles.
Content types104,985 requestsTo controversy and recent-event paths
Event content received visits alongside main profile pages. The ultimate use of those requests remains unverified.
A baseline for complete calendar weeks
Logging began on October 28, leaving the preceding week incomplete. We do not report week-over-week growth or treat missing periods as zero visits.
Who is visiting
Anthropic accounts for 74.71%.
Coverage varies across companies.
Request counts measure frequency; distinct profile counts measure breadth. They answer different questions.
Where did the week's requests come from?
Shares of 846,846 requests. The top five companies are shown separately; ten others are grouped.
- Anthropic632,68074.71%
- Amazon78,1869.23%
- OpenAI69,1908.17%
- Google47,3545.59%
- Perplexity12,3011.45%
- 10 others7,1350.84%
A closer look at the other sources
The donut shows shares of all weekly requests. The chart below compares the other 214,166 requests, excluding Anthropic, on a linear scale starting at zero.
Requests from the remaining sources
214,166 requests excluding Anthropic; nine smaller sources are grouped. Linear scale, starting at zero.
View distinct profile coverage by company
| Source | Distinct profiles (2xx and matched) |
|---|---|
| Anthropic | 189,178 |
| Amazon | 33,757 |
| 8,533 | |
| Perplexity | 3,734 |
| OpenAI | 1,562 |
The same profile can be visited by several companies. Company-level counts cannot be added to obtain site-wide coverage.
Breadth & overlap
190,043 profiles received visits.
One in five had multiple sources.
Amazon and Google rank highly on both request counts and source diversity. Profiles are deduplicated by database identity and include brands, companies and organizations.
Source diversity across profiles
- One company 149,351 (78.59%)
- Exactly two 35,706 (18.79%)
- Three or more 4,986 (2.62%)
Top profiles × source companies
● A 2xx visit was recorded this week; · none was recorded. Only the ten most-requested profiles are shown.
| Profile | Anthropic | Amazon | OpenAI | Perplexity | Meta | Microsoft | ByteDance | Exa | Shape | Requests | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Amazon | ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | 498 |
| ● | ● | ● | ● | ● | ● | ● | ● | ● | ● | 380 | |
| Tesla | ● | ● | ● | ● | ● | ● | ● | ● | · | ● | 309 |
| Samsung | ● | ● | ● | · | ● | · | ● | · | ● | ● | 293 |
| Apple | ● | ● | ● | ● | ● | ● | ● | ● | · | ● | 260 |
| Samsung Electronics | ● | ● | ● | · | ● | · | ● | · | · | ● | 232 |
| Amazon Web Services | ● | ● | ● | ● | ● | · | ● | · | · | ● | 204 |
| Universal Music Group | ● | ● | ● | · | ● | ● | ● | ● | · | ● | 197 |
| Microsoft | ● | ● | ● | ● | ● | ● | ● | ● | · | ● | 193 |
| ● | ● | ● | ● | ● | · | ● | ● | ● | ● | 187 |
Alternate path spellings and related subpages are merged by profile. Samsung and Samsung Electronics remain distinct entities, as recorded in the database.
188,317 profiles first appeared in our logs this week
First observed does not mean first discovered by AI. The short logging history strongly affects this metric. Future reports will track return visits and additional sources.
What gets fetched
Controversy and recent-event paths
received 104,985 requests.
Controversy paths recorded 59,566 requests and recent-event paths 45,419. Visits extended beyond main profile pages.
The site's content landscape
Rectangle area represents request share. Exact counts for smaller categories appear in the detail chart below.
Where the remaining 21.90% went
Excludes the dominant group above. Five categories total 185,453 requests, including failures. Linear scale, starting at zero.
The dominant group above and these five groups total 846,846 requests. This detail chart uses a linear scale starting at zero.
This week's focus: six major classified sectors
Six sectors only. Profiles must match the database and have a 2xx response. Linear scale, starting at zero.
Sector distribution does not establish preference
Of covered profiles, 45.09% are classified as Other or lack a classification. Sectors also have different database populations. These results describe distribution, not preference or causation.
Quality & next questions
An error rate of 0.122%.
Almost all errors were missing pages.
Of 1,034 error responses, approximately 99.42% were 404s. Follow-up work should examine old links, path spellings and requests for nonexistent addresses.
Composition of error requests
Among 1,034 error responses only, not all site requests
Site-wide response statuses
| HTTP status | Meaning | Requests |
|---|---|---|
| 200 | OK | 845,705 |
| 308 | Redirect | 106 |
| 304 | Not modified | 1 |
| 404 | Not found | 1,028 |
| 403 | Forbidden | 6 |
Errors are HTTP statuses ≥400. Non-error responses include redirects and do not all prove that content was read.
Three boundaries to keep in mind
A complete calendar week: November 2, 00:00 to November 9, 00:00, Beijing time (UTC+8), end excluded. The preceding week is incomplete, so no week-over-week comparison is provided.
Two statistical populations: Site-wide totals include failed requests. Profile analysis includes only 2xx visits matched to the database.
A visit is not a citation: Identity is classified by User-Agent; verification results were not stored. Training use and business conversions cannot be inferred.
Full methods, unmatched records and snapshot details
Collection and matching: Site logs were classified and deduplicated, with SEO tools excluded. GET and HEAD are included. Matching used the database at extraction time and yielded 747,883 profile requests. Another 1,650 unmatched path keys, representing 4,101 requests, were excluded from profile and sector analysis.
Historical limitations: Logging began October 28 at 23:17, Beijing time. Without an end-of-week inventory snapshot, we do not calculate whole-database coverage. Sectors use current classifications, not historical snapshots. A first record is not a first discovery.
Data snapshot: Extracted around November 10, 2026, 12:21, Beijing time (UTC+8). Later deduplication or profile revisions may cause small changes to historical totals.
Explore Brand Wiki
Start with your brand.
Explore its profile and crawl statistics.
This report links request records to individual profiles. Find a brand and explore its existing information and crawl statistics. Profile-page statistics are cumulative and differ from this weekly snapshot.