See which AI crawlers really visit your site
Every AI visibility checker estimates. Your server log doesn't. Drop it in and see GPTBot, ClaudeBot, PerplexityBot and live ChatGPT fetches over time — each request checked against the official IP lists, so fakes are filtered out.
Where do I find my access log?
- cPanel hosting: Metrics → Raw Access → download the .gz for your domain (enable "archive logs" to keep more than a day or two).
- Plesk: Websites & Domains → Logs → download
access_log/access_ssl_log. - Nginx (VPS):
/var/log/nginx/access.logplus rotatedaccess.log.1,.2.gz… - Apache (VPS):
/var/log/apache2/access.logor/var/log/httpd/access_log. - Managed WordPress: WP Engine (Logs), Kinsta (MyKinsta → Logs → access.log), SiteGround (Site Tools → Statistics → Access Log), Cloudways (Monitoring → Logs).
- CDN / cloud: Cloudflare Logpush (JSON), CloudFront standard logs, ALB access logs, IIS W3C logs from
C:\inetpub\logs\LogFiles.
Reading…
The AI crawlers that matter most
Requests from verified or unverifiable IPs — spoofed bots are excluded. Lines show daily activity across the whole log.
AI crawler hits over time
View chart data as a table
Every crawler we found
Click a row to see the pages that crawler fetched.
What this means
Plain-English findings from your log, most important first.
Pages AI crawlers fetch most
Query strings are ignored. Errors show the status codes the crawler received.
Turn crawling into citations
Being crawled is step one. Being quoted in ChatGPT, Claude, Perplexity and Google AI answers takes citation-ready content, consistent entity signals and authority. That's OptiSEOn's GEO service.
Prove AI is reading you. Then make it recommend you.
Your log shows whether AI systems visit. Getting named in their answers takes content built to be quoted, schema and entity signals that agree, and authority AI trusts. That's generative engine optimization — and it's what OptiSEOn does.
Book a Free GEO Strategy Call →AI crawler log analyzer FAQ
How can I tell if ChatGPT, Claude or Perplexity crawl my website?
Your server access log records every request along with the visitor's user agent and IP address. AI crawlers identify themselves with user agents such as GPTBot, OAI-SearchBot and ChatGPT-User (OpenAI), ClaudeBot, Claude-SearchBot and Claude-User (Anthropic), and PerplexityBot and Perplexity-User (Perplexity). This tool reads the log, finds those requests, and checks each IP against the ranges the companies publish so you know the visits are genuine.
Is my log file uploaded anywhere?
No. The log is read and analyzed entirely in your browser. The only thing the page downloads from our server is the public list of official crawler IP ranges, and the comparison happens on your device. Your log and your visitors' IP addresses never leave your computer.
What is the difference between GPTBot, OAI-SearchBot and ChatGPT-User?
GPTBot collects content that may be used to train OpenAI's models. OAI-SearchBot builds the index behind ChatGPT search, which decides whether your pages can appear and be cited in ChatGPT answers. ChatGPT-User fetches a page live when a person's conversation needs it. Anthropic (ClaudeBot, Claude-SearchBot, Claude-User) and Perplexity (PerplexityBot, Perplexity-User) use the same split. Live user-triggered fetches are the strongest evidence that AI assistants are actually using your content.
Why doesn't Google-Extended show up in my logs?
Google-Extended is not a crawler. It is a robots.txt product token that controls whether content Google has already crawled may be used for Gemini models and grounding. It never makes requests and has no user agent string. Google's crawling is done by Googlebot, so the tool shows verified Googlebot activity alongside Google-Extended — and our robots.txt AI crawler checker tells you whether the token is blocked.
How does the tool spot fake AI bots?
Anyone can put GPTBot or ClaudeBot in a user agent. OpenAI, Anthropic, Perplexity, Google, Microsoft, Apple and Common Crawl publish the IP ranges their crawlers use. Requests claiming to be one of those crawlers but coming from an IP outside the official list are flagged as spoofed and kept out of your totals. Crawlers whose operators publish no list are counted but marked as unverifiable.
Where do I find my website's access log?
On cPanel hosting, open Metrics and then Raw Access to download a .gz log. On Plesk, use Logs in the domain panel. On a VPS, Nginx logs are usually in /var/log/nginx/access.log and Apache logs in /var/log/apache2/access.log or /var/log/httpd/access_log. Managed WordPress hosts such as WP Engine, Kinsta and SiteGround offer access logs in their dashboards. Cloudflare Logpush, AWS CloudFront and load balancer logs and IIS logs are supported too.
