WeSearch

I made a Claude Code skill to check if AI crawlers can read your site

·3 min read · 0 reactions · 0 comments · 7 views
I made a Claude Code skill to check if AI crawlers can read your site

Contribute to MerqryLabs/ai-crawler-visibility development by creating an account on GitHub.

Original article
GitHub
Read full at GitHub →
Opening excerpt (first ~120 words) tap to expand

AI Crawler Visibility A Claude Code skill that tells you whether your website is actually visible to AI search — and exactly how to fix it if it isn't. ChatGPT Search, Claude, and Perplexity are sending people to websites now. But the crawlers that feed them — ClaudeBot, GPTBot, PerplexityBot, Bytespider, Meta-ExternalAgent — do not run JavaScript. They read only the raw HTML your server returns. Google's renderer has handled JavaScript for years, so a client-rendered site (React, Vite, Vue, Svelte, any SPA) can rank perfectly fine on Google and still be completely invisible in AI answers. If you've ever thought "we get Google traffic but nothing from AI" — or you shipped a slick vibe-coded SPA and you're nowhere in ChatGPT — this is almost always why.

Excerpt limited to ~120 words for fair-use compliance. The full article is at GitHub.

Anonymous · no account needed
Share 𝕏 Facebook Reddit LinkedIn Threads WhatsApp Bluesky Mastodon Email

Discussion

0 comments

More from GitHub