made with Svelte

CrawlerCheck

Googlebot & AI Crawlability Checker

Visit Site

Description

Googlebot & AI Crawlability Checker

"CrawlerCheck is a free and simple tool to check if crawlers are allowed to access a URL. It analyzes a site's robots.txt file, meta robots tags, and X-Robots-Tag HTTP headers to give you a complete and accurate report on crawler accessibility.

The entire front-end is a fast and lightweight single-page application built with Svelte. The backend is powered by Go to ensure reliable and speedy checks."


Creator

Bögözi Attila
@attilabogozi


Social Media Links

CryptoBubble AI-Powered Crypto Bubble Burst Detection
icon-eye-dark Created with Sketch. 169
Call for Maintainers List of Projects Looking for Maintainers
icon-eye-dark Created with Sketch. 738
Sentry for Svelte Svelte Error & Performance Monitoring
🧡 Sponsored by Friends
image-koala Created with Sketch.
Make this Koala happy and follow us on X!
daisyUI Docs Docs for a TailwindCSS Component Library
icon-eye-dark Created with Sketch. 4.196
STROLLÿN Travel & Accommodation Platform for Remote Workers
icon-eye-dark Created with Sketch. 1.466