PROGRAM ZERO 18-month live AI, LLM & full-stack programme · ₹89,999 or ₹7,500/month · Starts 9 January 2027
Explore Program Zero →
Careers Ninza — business and startup leadership training
JOIN ZERO NINZA KIDS
JOIN ZERO NINZA KIDS
See all programs → Free live masterclass → Guides & articles → Newsletter →
Careers Ninza
SEO & AI SEARCH 7 min read · Updated 14 October 2026

Technical SEO audit checklist: how to find what stops Google and AI crawlers from ranking your site

A technical SEO audit checks whether search engines and AI crawlers can find, render, understand and index your pages. This checklist covers crawling, indexing, site structure, speed, mobile, structured data and international and local signals.

CN
Careers Ninza SEO faculty
Careers Ninza · Kolkata, India
Learn this live in our SEO & AI Search Mastery course

A technical SEO audit answers four questions in order: can search engines and AI crawlers reach your pages, can they render and understand them, do they choose to index them, and does the site load fast and work well on phones? Fix problems in that order, because a page that is not crawled or indexed cannot rank, however good its content.

Most Indian business websites we audit have the same handful of technical issues: duplicate pages from filters and tracking parameters, missing or wrong canonicals, slow mobile pages, orphan pages and broken internal links. None of them need a rebuild. This checklist follows session one of SEO & AI Search Mastery, where every student audits a real site.

Why does technical SEO matter more in 2026?

Search is no longer one crawler and ten blue links. Google still handles about 97% of searches in India according to StatCounter, but answers increasingly appear in AI Overviews and AI Mode, and people also ask ChatGPT, Gemini, Claude and Perplexity. All of these depend on being able to fetch and parse your pages. A site that blocks crawlers, hides content behind scripts or serves slow, broken pages is invisible to every one of them.

India’s audience is mobile and growing: the IAMAI and Kantar Internet in India 2025 report counted about 958 million active internet users in 2025, most of them on phones. Technical quality on a mid-range Android phone is the baseline, not a bonus.

Search engine share in India (all devices, 2025)
Googleabout 97%
Bingabout 1.3%
Othersabout 1.7%

Source: StatCounter figures as reported for 2025; shares vary by month and device.

Can search engines crawl your site?

—robots.txt allows important sections and does not block CSS, JavaScript or images needed to render pages. Check that AI search crawlers you want (for example OAI-SearchBot, PerplexityBot, Claude-SearchBot) are not blocked by accident.
—Server responses: important pages return 200; removed pages return 404 or 410, not a "soft 404" that shows an error message with a 200 status.
—Redirects: single hops, no chains or loops, http to https and non-www to www (or the reverse) consistently.
—Internal links reach every important page within a few clicks of the home page; no orphan pages.
—JavaScript rendering: main content and links appear in the rendered HTML; test with the URL Inspection tool.

Are the right pages indexed?

Open the Page indexing report in Google Search Console and read every reason in "Why pages aren’t indexed". Common ones and what they mean:

ReasonWhat it usually meansFix
Duplicate without user-selected canonicalFilter, sort or tracking URLs creating copiesCanonical tags, parameter-free internal links
Crawled, currently not indexedGoogle saw the page but did not think it worth indexingImprove uniqueness and usefulness, or remove
Discovered, currently not indexedGoogle knows the URL but has not crawled itInternal links, sitemap, server speed
Alternate page with proper canonicalWorking as intendedNo action
Soft 404Thin or error-like page returning 200Return a real 404 or add real content

Is the site structure helping or hurting?

A clear hierarchy (home, category, subcategory, page) helps crawlers and users. For service businesses this usually means one page per service and one per location where you genuinely serve, linked from navigation and from each other. Avoid thousands of near-identical location pages that only swap the city name; Google treats them as doorway pages. Our programmatic SEO guide explains how to scale pages that are genuinely different.

Are canonicals, sitemaps and hreflang correct?

—Every indexable page has a self-referencing canonical; duplicates point to the main version.
—The XML sitemap lists only canonical, indexable, 200-status URLs, and is submitted in Search Console.
—Sitemap lastmod dates change only when content changes.
—If you have Hindi, Bengali or other language versions, hreflang tags link them correctly.

How fast is the site on Indian mobile networks?

Check Core Web Vitals in Search Console and test key templates with PageSpeed Insights. Google’s Core Web Vitals measure loading (LCP), responsiveness (INP) and visual stability (CLS). The usual culprits on Indian sites are uncompressed hero images, heavy sliders, too many third-party scripts (chat widgets, multiple pixels) and cheap shared hosting. Our Core Web Vitals guide covers fixes in detail.

Is structured data valid and useful?

Structured data in JSON-LD helps search engines and AI systems understand entities: your organisation, products, courses, articles, FAQs, local business details. Validate with the Rich Results Test and the Schema.org validator. Mark up only what is visible on the page, keep facts consistent with the page, and do not add review stars you did not collect.

What does a prioritised audit output look like?

PriorityExample findingImpact
Criticalrobots.txt blocks /products/Whole section invisible
High4,000 filter URLs indexed as duplicatesCrawl budget and ranking dilution
HighService pages are orphanedPages rarely crawled or ranked
MediumLCP over 4 seconds on mobile templatesPoor experience, lower conversions
LowMissing alt text on decorative imagesMinor accessibility and image search

Technical fixes remove barriers; they do not create demand. A technically perfect site with thin, generic content still will not rank. Pair the audit with keyword research and content improvements.

Which tools do you need?

For most Indian business sites, free tools are enough: Google Search Console, Bing Webmaster Tools, PageSpeed Insights, the Rich Results Test and a crawler such as Screaming Frog’s free version (up to 500 URLs). Paid suites such as Ahrefs or Semrush add backlink and competitor data, useful for agencies but not required to start.

How often should you run a technical audit?

Run a full audit when you take over a site, after a redesign or migration, and at least twice a year. Between audits, check Search Console weekly for new indexing errors, Core Web Vitals regressions and manual actions. Migrations are where most traffic is lost; always map old URLs to new ones with 301 redirects before launch.

What does an audit of a typical Indian business site find?

Here is a condensed audit we ran in class on a sample WordPress site for a Jaipur jewellery brand with about 600 products and a blog:

1Crawling: robots.txt was fine, but the theme loaded product links through JavaScript in a slider, so many product pages had no plain HTML links pointing to them.
2Indexing: about 2,300 URLs with ?orderby= and ?filter_ parameters were crawlable and several hundred were indexed as duplicates.
3Soft 404s: out-of-stock products redirected to the home page, which Google treated as soft 404s.
4Speed: the home page loaded a 2.4 MB hero image and five tracking scripts; mobile LCP was well above the recommended level.
5Structured data: two plugins each output Organization markup with different names.

The fixes, in order: add static category and product links in HTML, canonicalise and stop linking to parameter URLs, keep out-of-stock product pages live with an "available on order" note or return a proper 404 for discontinued ones, compress and resize images, delay non-essential scripts, and remove the duplicate schema plugin. None required a new website.

Which checks matter for Hindi and multi-language sites?

—Each language version has its own URL, not content switched by a cookie or script.
—hreflang tags point between equivalent pages in both directions, with an x-default where useful.
—Fonts for Devanagari, Bengali or Tamil scripts load quickly and do not shift the layout.
—Titles and descriptions are written in the page language, not left in English.

What should you monitor every week after the audit?

Five minutes a week in Search Console prevents most disasters: the Page indexing report for sudden jumps in excluded pages, Core Web Vitals for regressions, Manual actions and Security issues, and the Performance report for sudden drops in impressions on important page groups. Bing Webmaster Tools is worth checking too, because Bing’s index also feeds some AI search products.

Our SEO & AI Search Mastery batches run live online, so the same class reaches learners and business owners in metros such as Kolkata, Mumbai, Delhi NCR, Bengaluru and Hyderabad, growing cities such as Surat, Jaipur, Indore, Lucknow and Coimbatore, and smaller industrial towns such as Siliguri, Durgapur, Tiruppur, Rajkot and Guwahati, at the same fee. Each city page explains how local businesses use SEO and AI search, for example in Kolkata, Surat, Tiruppur.

Learn this live: SEO & AI Search Mastery

Audit a real site, fix crawling, indexing, speed and structured data, and present a prioritised report. 20 live hours, ₹19,999, single payment.

SHORT-TERM COURSE · LIVE ONLINE
SEO & AI Search Mastery

Rank on Google and get cited by AI answer engines.

₹19,999 · single payment20 hoursLive, mentor-ledCertificate on completion

Frequently asked questions

What is a technical SEO audit?+

A technical SEO audit checks whether search engines and AI crawlers can crawl, render and index a website, and whether it loads quickly and works well on mobile. It covers robots.txt, status codes, redirects, canonicals, sitemaps, structure, Core Web Vitals and structured data.

How do I check if Google has indexed my pages?+

Use the Page indexing report and URL Inspection tool in Google Search Console. They show which pages are indexed, which are not, and why, such as duplicates without canonicals, soft 404s or pages crawled but not indexed.

What is the most common technical SEO problem on Indian websites?+

Duplicate URLs from filters, sorting and tracking parameters, slow mobile pages with heavy images and scripts, and orphan pages with no internal links are the issues we find most often.

Should I allow AI crawlers in robots.txt?+

If you want your content found and cited in AI search tools, allow their search crawlers such as OAI-SearchBot, PerplexityBot and Claude-SearchBot. Decide separately whether to allow training crawlers such as GPTBot or Google-Extended, based on your content policy.

Which free tools are enough for a technical SEO audit?+

Google Search Console, Bing Webmaster Tools, PageSpeed Insights, the Rich Results Test and a crawler such as Screaming Frog’s free version cover most small and medium business sites.

Where can I learn technical SEO in India?+

Careers Ninza SEO & AI Search Mastery starts with technical foundations and an audit of a real site. It is 20 live hours for ₹19,999, online across India, with lifetime recordings.

Related reading

SEO & AI SEARCH SEO Reporting With Search Console and GA4: What to Measure and How to Explain It Good SEO reports connect rankings and traffic to leads and revenue, separate brand from non-brand, and explain changes honestly, including AI search effects. Here is a reporting framework with Search Console, GA4 and Looker Studio. 6 min read SEO & AI SEARCH Ecommerce SEO for Indian Stores: Category Pages, Product Pages, Filters and AI Shopping Ecommerce SEO wins traffic that does not need ad spend. This guide covers category pages, product pages, filter and duplicate control, structured data, Merchant Center free listings and AI shopping answers for Shopify and WooCommerce stores. 6 min read SEO & AI SEARCH Core Web Vitals and Page Speed for Indian Websites: LCP, INP and CLS Fixes That Work Most Indians browse on mid-range Android phones over mobile data, so speed is a ranking and revenue issue. This guide explains Core Web Vitals and the fixes that matter most for WordPress, Shopify and custom sites. 6 min read

We teach this, live

Every article here comes from something we teach. Sit in on a free masterclass and judge the mentors yourself.