Site Crawler Whole site
Follows links across every page of your site and collects broken links, redirect chains, duplicate titles, missing meta tags and orphan pages in one report. What commercial tools charge for — free here.
- 404Broken internal and external links
Every missing target is listed together with the page that links to it.
- 301Redirect chains
Redirects resolved in multiple hops burn crawl budget.
- DUPDuplicate titles and descriptions
Pages sharing the same title/description compete with each other.
- METAMissing meta tags
Pages without a title, description or H1.
- ORPHOrphan pages
URLs present in the sitemap but linked from no page.
- OKHealthy pages
Pages returning 200, with complete meta structure and indexable.
| Status | Address |
|---|---|
| 200 | /urunler/analiz-paketi |
| 200 | /blog/teknik-seo-rehberi |
| 301 | /eski-fiyatlar → /fiyatlar |
| 404 | /blog/kaldirilan-yazi |
| 200 | /hakkimizda |
- 10 pages — about 15 seconds
- 25 pages — about 40 seconds
- 60 pages — about 1.5 minutes
For larger crawls, create a free account and save the report.
Site Crawler — frequently asked questions
How many pages can the crawler handle?
You can set the limit to 10, 25, 40 or 60 pages before starting. The crawler follows internal links from the address you give and stops at the limit, so a large site is sampled from its most linked pages rather than crawled exhaustively.
Does crawling put load on my server?
Requests are issued one after another rather than in parallel, so the load stays close to a single visitor browsing your site. Even so, only crawl sites you own or have explicit permission to analyze.
Why does a working link show up as broken?
A link is reported as broken when the server returns 4xx or 5xx, or when the connection times out. Pages behind a login, geo-blocking or aggressive bot protection can answer differently to a crawler than to your browser — check those cases manually.
What is the difference between the crawler and a single-page audit?
The crawler looks for site-wide patterns: broken links, redirect chains, duplicate titles and descriptions, orphan pages. A single-page audit goes deep on one URL instead — content, schema, performance and GEO signals.