RankOnGeoDocs

AI Search, Crawler, Bot Analytics

Track AI search engines, crawlers, and bots visiting your website. Get insights into traffic from AI platforms like ChatGPT, Claude, and Perplexity.

AI Analytics Setup Guide

Server-side analytics tracks AI agents, crawlers, and other bots that don't run JavaScript. It has to run on your server (or in front of it), because a browser script never sees them.

Fastest way: open Analytics → Connections → Connect → Custom Built Site in your dashboard and copy the prompt — paste it into Claude Code, Cursor, Copilot, Lovable, Bolt or v0 and it adds both the tracking script and this server-side call for your stack. To do it by hand, pick your setup:

Call this endpoint from your server, on every page request:

POST https://www.rankongeo.com/api/track/bot

curl -X POST https://www.rankongeo.com/api/track/bot \ -H "Content-Type: application/json" \ -d '{ "siteKey": "YOUR_SITE_KEY", "path": "/current/path", "userAgent": "User-Agent header from the request", "referrer": "Referer header from the request" }'

Only recognized AI bot user-agents get stored — calling this for every request (including regular human traffic) is safe and expected; non-bot requests are silently ignored.

AI Crawlers, Bots that we track

  • ChatGPT — OpenAI's conversational AI and search (GPTBot, ChatGPT-User, OAI-SearchBot)
  • Claude — Anthropic's AI assistant (ClaudeBot, anthropic-ai)
  • Perplexity — AI-powered search engine (PerplexityBot)
  • Gemini — Google's AI platform (Google-Extended)
  • DeepSeek — Advanced AI search
  • Others — CCBot, Bytespider, Amazonbot, and other AI crawlers

Debugging

Not seeing AI traffic?

  • Verify your siteKey from Analytics → Connections.
  • Add a log line to confirm your middleware is actually running on the routes you expect.
  • AI crawlers visit on their own schedule, not a fixed interval — it can take time before real traffic shows up. Use "Send test AI-crawler hit" in Analytics → Connections to confirm the pipeline itself works, or run the curl command from the REST API tab with a bot user-agent such as GPTBot/1.0.