AI Search, Crawler, Bot Analytics
Track AI search engines, crawlers, and bots visiting your website. Get insights into traffic from AI platforms like ChatGPT, Claude, and Perplexity.
AI Analytics Setup Guide
Server-side analytics tracks AI agents, crawlers, and other bots that don't run JavaScript. You need to add this to your server's middleware.
You can use our REST API, or a Next.js middleware if that's what you're running.
Use this endpoint from your server middleware:
POST https://www.rankongeo.com/api/track/bot
curl -X POST https://www.rankongeo.com/api/track/bot \
-H "Content-Type: application/json" \
-d '{
"siteKey": "YOUR_SITE_KEY",
"path": "/current/path",
"userAgent": "User-Agent header from the request",
"referrer": "Referer header from the request"
}'
Only recognized AI bot user-agents get stored — calling this for every request (including regular human traffic) is safe and expected; non-bot requests are silently ignored.
AI Crawlers, Bots that we track
- ChatGPT — OpenAI's conversational AI and search (GPTBot, ChatGPT-User, OAI-SearchBot)
- Claude — Anthropic's AI assistant (ClaudeBot, anthropic-ai)
- Perplexity — AI-powered search engine (PerplexityBot)
- Gemini — Google's AI platform (Google-Extended)
- DeepSeek — Advanced AI search
- Others — CCBot, Bytespider, Amazonbot, and other AI crawlers
Debugging
Not seeing AI traffic?
- Verify your
siteKeyfrom the LLM Analytics tab. - Add a log line to confirm your middleware is actually running on the routes you expect.
- AI crawlers visit on their own schedule, not a fixed interval — it can take time before real traffic shows up. Use "Send test event" in the dashboard to confirm the pipeline itself works.