
A technical SEO audit checks whether search engines can crawl, render, index, and rank your website efficiently. The core process: verify indexation in Google Search Console, crawl the site to find broken links and redirect chains, review robots.txt and XML sitemaps, fix duplicate content with canonicals, pass Core Web Vitals on mobile, confirm HTTPS and mobile-friendliness, validate structured data, and ensure AI crawlers can access your content. Free tools cover the entire audit.
Introduction: The Invisible Problems Killing Your Rankings
You can publish the best content in your niche and still get no traffic — because of problems no visitor ever sees. A noindex tag left over from staging. A robots.txt rule blocking your blog. Three thousand thin tag pages diluting your crawl budget. A redirect chain quietly leaking authority on your most-linked page.
Technical SEO is the plumbing of search visibility: when it works, nobody notices; when it breaks, nothing else matters. And in 2026 the stakes have widened — the same crawlability and structure that traditional search depends on now also determines whether AI systems can retrieve and cite your content at all.
This guide from Webin Marketing walks you through a complete technical SEO audit in seven stages, using free tools throughout (the full toolkit is in our guide to doing SEO without paid tools). Run it quarterly, or immediately after any redesign, migration, platform change, or unexplained traffic drop — the cost of the audit is hours, while the cost of an unnoticed indexation problem is measured in months of lost revenue.
What You Need Before Starting
- Google Search Console verified for your domain (non-negotiable — it is your direct line to how Google sees your site)
- A website crawler — free tiers of desktop crawlers handle sites up to several hundred URLs
- PageSpeed Insights and the Search Console Core Web Vitals report
- Your robots.txt and sitemap URLs (yourdomain.com/robots.txt and /sitemap.xml)
- Two hours for a small site; a full day for sites over a few thousand URLs
Stage 1: Indexation — Is Google Even Seeing Your Pages?
Indexation is the first checkpoint because nothing ranks if it is not indexed.
- Open Search Console → Pages report. Compare “indexed” against the number of pages you actually want indexed.
- Review every exclusion category. “Crawled — currently not indexed” on important pages usually signals quality or duplication issues; “Excluded by noindex” on money pages is an emergency.
- Spot-check critical URLs with the URL Inspection tool — it shows exactly how Google last crawled and rendered each page.
- Search site:yourdomain.com for a rough index footprint and to spot junk URLs (search results pages, parameters, staging subdomains) that should not be there.
The two classic disasters to rule out first: a sitewide noindex meta tag shipped from staging, and a robots.txt Disallow: / left in place after launch. Both happen to real businesses every single week.
Stage 2: Crawlability — Can Bots Move Through Your Site?
Crawl your site and review:
| Check | What to Look For | Fix |
| Broken internal links (404s) | Any links to dead pages | Update the link or 301 the destination |
| Redirect chains | A→B→C hops | Point every link directly at the final URL |
| Redirect loops | Pages that never resolve | Repair the redirect logic immediately |
| Orphan pages | Pages with zero internal links | Link them from relevant content or remove |
| Click depth | Money pages >3 clicks from home | Flatten architecture, add hub links |
| Robots.txt | Accidental blocks on CSS/JS or sections | Allow rendering resources; block only true junk |
| AI crawler access | GPTBot, ClaudeBot, PerplexityBot rules | Decide deliberately; do not block by accident |
Internal architecture deserves special attention: pages buried five clicks deep get crawled less and rank worse. Hub-and-spoke structures — a pillar page linking to and from every cluster article, like our own SEO cluster around the on-page SEO checklist — solve depth and relevance at the same time.
Stage 3: Duplication and Canonicalization
Duplicate content rarely triggers penalties, but it constantly splits signals and wastes crawl budget.
- Protocol and host duplicates. http vs https, www vs non-www, trailing slash variants — exactly one version should resolve with 200; all others 301 to it.
- Parameter URLs. Faceted navigation, sorting, and tracking parameters can spawn thousands of near-duplicates. Canonicalize to the clean URL and block crawl traps in robots.txt where appropriate.
- Canonical tags. Every page should declare a canonical; verify important pages self-canonicalize and that no money page accidentally canonicalizes elsewhere. Google treats canonicals as hints, not commands — consistency across canonicals, sitemaps, and internal links is what makes them stick.
- Ecommerce-specific duplication. Platforms like Shopify generate collection-path product URLs alongside canonical ones — we cover the exact fix in our Shopify SEO guide.
- Thin near-duplicates. Tag archives, boilerplate location pages, and printer versions: consolidate, noindex, or genuinely differentiate.
Stage 4: Sitemaps and Site Structure
Your XML sitemap is the canonical list of URLs you want indexed — treat it that way.
- Confirm the sitemap exists, is referenced in robots.txt, and is submitted in Search Console.
- It must contain only indexable, canonical, 200-status URLs — no redirects, no noindexed pages, no 404s. A dirty sitemap erodes trust in the whole file.
- Check Search Console’s sitemap report for the discovered-vs-indexed gap; large gaps point back to quality or duplication issues from earlier stages.
- Large sites should split sitemaps by section (posts, products, categories) so indexation problems can be isolated per type.
While you are here, audit breadcrumbs: they clarify structure for users, generate breadcrumb rich results via schema, and reinforce your internal linking hierarchy.
Stage 5: Speed and Core Web Vitals
Page experience is assessed on real-user data, so audit with the field data in Search Console’s Core Web Vitals report first, then diagnose individual templates with PageSpeed Insights.
| Metric | Measures | Good Threshold | Most Common Fixes |
| LCP | Loading of largest element | ≤2.5s | Compress hero images, preload critical assets, better hosting/CDN |
| INP | Responsiveness to interaction | ≤200ms | Reduce JavaScript, defer third-party scripts, break long tasks |
| CLS | Visual stability | ≤0.1 | Set width/height on media, reserve ad/embed space, preload fonts |
Audit by template, not by page: fixing the product template fixes every product. The highest-ROI actions for most sites remain image compression to WebP, caching plus a CDN, removing unused scripts and plugins, and lazy-loading below-the-fold media. Speed work pays twice — in rankings and in conversions — which is why we treat it as a revenue project in our website speed work for clients.
Stage 6: Security, Mobile, and Rendering
- HTTPS everywhere. Valid certificate, no mixed-content warnings, and all http URLs 301-redirected.
- Mobile-first reality. Google indexes the mobile version. Verify content parity between mobile and desktop, tap targets are usable, and nothing important is hidden on mobile.
- JavaScript rendering. If key content or links only appear after JS execution, use URL Inspection’s rendered HTML to confirm Google sees them. Server-side rendering or pre-rendering remains the safe default for content that must rank — and matters even more for AI crawlers, many of which handle JavaScript poorly.
- Hreflang (if multilingual). Validate return tags and language codes; broken hreflang silently misroutes international rankings.
Stage 7: Structured Data Validation
Run every major template through the Rich Results Test:
- Validate Article/BlogPosting on posts, Product and Review on commerce pages, LocalBusiness on location pages, FAQPage where visible FAQs exist, and Organization sitewide.
- Fix errors first (they disqualify rich results), then warnings.
- Confirm the schema reflects visible page content — markup for content that is not on the page violates guidelines.
- Re-validate after every theme or plugin update; schema breakage is the most common silent regression we see, and structured data is increasingly how AI systems read entities and facts, as covered in our GEO guide.
Advanced: Crawl Budget and Log File Insights
For sites beyond a few thousand URLs, *what Google chooses to crawl* becomes its own optimization surface. Search Console’s Crawl Stats report (Settings → Crawl stats) shows requests by response code, file type, and purpose — your free window into crawler behaviour.
Signals that crawl budget is being wasted: large volumes of crawls on parameterised URLs, redirects, or 404s; important sections crawled rarely while junk is crawled daily; spikes of 5xx responses that throttle crawling sitewide. The remedies are the earlier stages applied with intent — eliminate crawl traps in faceted navigation, return 410 for permanently gone bulk URLs, keep sitemaps pristine so they advertise only what matters, and strengthen internal links to under-crawled money sections. Server log analysis (free with command-line tools or log analysers) takes this further by showing every bot hit, but for most businesses the Crawl Stats report plus a clean architecture solves the problem.
Special Case: The Migration Audit
More traffic is lost to botched migrations than to any algorithm update. If you are changing domains, platforms, or URL structures, audit before and after:
- Export every indexed URL and its traffic before migration day.
- Map each old URL to its new equivalent with one-hop 301s — no chains, no blanket redirects to the homepage.
- Carry over title tags, meta data, content, and schema; parity first, improvements later.
- Re-verify Search Console, resubmit sitemaps, and use the Change of Address tool for domain moves.
- Monitor the Pages report and rankings daily for a month; investigate any URL cluster that fails to transfer.
Expect some turbulence for two to six weeks even in clean migrations; expect disaster without the mapping. If a past migration was never audited, running this checklist retroactively still recovers equity from broken redirects years later.
Your Technical SEO Audit Checklist (Summary)
| Stage | Key Checks | Frequency |
| Indexation | Pages report, noindex audit, URL inspection | Monthly glance, quarterly deep dive |
| Crawlability | 404s, chains, orphans, depth, robots.txt | Quarterly |
| Duplication | Host variants, parameters, canonicals | Quarterly |
| Sitemaps | Clean URLs only, submitted, gap analysis | Quarterly |
| Performance | CWV field data, template diagnostics | Monthly |
| Security & mobile | HTTPS, parity, rendering | Quarterly + after changes |
| Structured data | Rich Results Test per template | After every update |
Prioritising Fixes: The Impact Matrix
Not all findings are equal. Triage everything you found into four buckets:
- Emergencies (fix today): noindex on money pages, robots.txt blocking the site, sitewide 5xx errors, broken HTTPS.
- High impact (this week): redirect chains on linked pages, failing CWV on top templates, canonical conflicts, schema errors on revenue pages.
- Medium (this month): orphan pages, sitemap cleanup, image compression backlog, thin archive handling.
- Low (backlog): minor warnings, cosmetic Lighthouse suggestions, non-critical redirects.
This ordering matters because technical SEO has diminishing returns: the first 20% of fixes typically delivers 80% of the recovery. Ship the emergencies and high-impact items, measure for a month in Search Console, then iterate.
What a Healthy Site Looks Like After the Audit
When the work is done, the picture in Search Console is unmistakable: the Pages report shows your intended URLs indexed with exclusions you can explain in one sentence each; crawl stats show bots spending their time on money sections; Core Web Vitals shows green across mobile templates; and the sitemap report shows discovered and indexed converging. Reaching that state once is the project; keeping it there is the quarterly habit. Put a recurring two-hour block in the calendar, attach this checklist, and technical SEO stops being a crisis discipline and becomes routine maintenance — which is exactly what your rankings want it to be.
Frequently Asked Questions About Technical SEO Audits
How often should I run a technical SEO audit?
A full audit quarterly, plus immediately after migrations, redesigns, platform changes, or sudden traffic drops. Indexation and Core Web Vitals deserve a monthly glance in Search Console.
Can I do a technical audit with only free tools?
Yes. Search Console, free crawler tiers, PageSpeed Insights, and the Rich Results Test cover every stage in this guide for small and medium sites. Paid suites add scale and scheduling, not fundamentally different data.
What is the most common critical issue you find?
Leftover noindex tags and staging blocks after launches, followed closely by uncontrolled parameter duplication on ecommerce sites. Both are invisible to owners and devastating to traffic.
Does technical SEO matter for small websites?
Proportionally, yes — a 30-page site with a noindexed services page loses a third of its potential. Small sites finish this audit in two hours; there is no reason to skip it.
How is technical SEO changing with AI search?
The foundations are identical, with added emphasis on AI-crawler access in robots.txt, server-rendered content that retrieval systems can read, and clean structured data that helps models extract facts and entities accurately.
Will fixing technical issues alone improve rankings?
If technical problems were suppressing otherwise strong pages, yes — sometimes dramatically. If content and authority are weak, technical fixes remove the handbrake but you still need to press the accelerator.
Conclusion: Fix the Plumbing, Then Pour the Water
Every rupee spent on content and links flows through your site’s technical foundation — and leaks out through every broken redirect, blocked resource, and unindexed page. Run this seven-stage audit quarterly, triage with the impact matrix, and you guarantee that the creative work actually reaches the rankings it deserves.
If you would rather hand the wrench to specialists, Webin Marketing’s SEO services include full technical audits with prioritised fix lists and implementation — for WordPress, Shopify, and custom builds across India and worldwide. Book a free strategy call and get a complimentary mini-audit of your site’s top issues.
Affiliate Disclosure
Some links in this article may be affiliate links. If you purchase a tool or service through these links, Webin Marketing may earn a small commission at no extra cost to you. We only recommend tools we have tested or genuinely believe add value to our readers.
Disclaimer
This article is for informational and educational purposes only. Search engine systems, tools, and guidelines change frequently, and no agency can guarantee specific rankings or traffic outcomes. Test changes carefully — ideally on staging — and consult current official documentation before modifying robots.txt, redirects, or site architecture.