What SEO issues does CrawlIQ detect?

CrawlIQ identifies over 15 categories of SEO issues: missing title tags, title too short or too long, missing meta descriptions, missing or multiple H1 tags, missing H2 tags, canonical tag absent or pointing to a different URL, duplicate meta descriptions across pages, pages returning 4xx and 5xx HTTP errors, thin content (under 300 words), images with empty alt text, HTTP pages, URLs with underscores, uppercase characters, or excessive depth, and high link density.

What data formats can I export from CrawlIQ?

CrawlIQ exports structured Excel (.xlsx) reference documents: a Full SEO Report with all evaluated pages, issues, keywords, and AI remediation guidance; a Per-Field Issues Report with field-level issue breakdowns; a Remediation Table with optimised titles, meta descriptions, and H1 tags; and a Technical SEO Assessment with per-page scores (0-100), grades (A-F), and indexability status.

How many pages can CrawlIQ evaluate per assessment?

CrawlIQ is free to use with no credit card required. Without an account you can evaluate up to 50 pages per session. Creating a free account raises this to 200 pages per month. The evaluation engine uses breadth-first search from your root URL, following internal links and handling SSL failures with automatic HTTP fallback.

Is my website data secure when using CrawlIQ?

Yes. CrawlIQ processes all evaluation data in isolated in-memory sessions. No data is stored to a database or disk permanently. All data exists only for the duration of your active session and is cleared when a new evaluation begins. The system is fully open-source on GitHub and hosted on HuggingFace Spaces.

Does CrawlIQ support JavaScript-rendered websites?

CrawlIQ uses an aiohttp-based async evaluation engine with BeautifulSoup for HTML parsing. It works best with server-side rendered, static, and WordPress sites. For fully JavaScript-rendered SPAs, server-side rendering or static generation is recommended for best evaluation coverage.

Open-Source Technical SEO Evaluation Reference Free

Technical SEO Evaluation
with AI Precision

Submit any website URL and receive a structured on-page signal assessment across 50+ dimensions, with AI-produced remediation documentation. No signup required.

Free & open-source · 50 pages evaluation · 200 pages/mo free account · No credit card

⚡ Groq · Gemini · Claude · OpenAI 🔓 Open Source 📊 50+ Technical Signals 📤 Excel Export

EVALUATION METHODOLOGY

Technical SEO Evaluation: Four-Stage Methodology

CrawlIQ processes a complete technical SEO evaluation pipeline — no configuration needed

Step 1

Submit Evaluation Target

Provide any website URL. The BFS evaluation engine maps all internal links, handles SSL fallback, processes up to 50 pages.

Step 2

Technical Signal Assessment

Each page scored 0–100 across 9 dimensions: title, meta, canonical, headings, OG tags, content depth, URL, alt text, HTTP status.

Step 3

AI Remediation Documentation

Groq, Gemini, OpenAI, or Claude produces structured remediation guidance: optimised titles, meta descriptions, H1 rewrites — ranked by impact.

Step 4

Structured Report Export

Export a structured Excel reference document: per-field issues, AI remediation guidance, keyword scores, A–F grades, and an optimisation table.

ABOUT CRAWLIQ

Open-source because paywalls shouldn't block good SEO knowledge

CrawlIQ is a free, open-source Technical SEO evaluation reference built by Teki Bhavani Shankar — the same evaluation depth as Screaming Frog and SEMrush, at zero cost.

Teki Bhavani Shankar

Technical SEO Specialist

Built CrawlIQ to solve the problem I had as an SEO intern — no budget for paid SEO platforms. Now it's free for everyone. Powered by Python · FastAPI · aiohttp · Gemini AI · Groq.

LinkedIn GitHub Full Bio

FAQ

Frequently Asked Questions

Common questions about the CrawlIQ technical SEO evaluation reference

How does CrawlIQ's AI SEO evaluation work?

CrawlIQ examines each page of a website using an async BFS evaluation engine and sends each page's signal data to an AI model — Groq (Llama 3), Gemini, OpenAI, or Claude (configurable). The AI evaluates content quality, keyword alignment, readability, and semantic relevance, then produces structured remediation recommendations ranked by impact. Output includes optimised title tags, meta descriptions, H1 rewrites, and content guidance.

What SEO issues does CrawlIQ identify?

CrawlIQ identifies 15+ issue categories: missing or oversized title tags, missing meta descriptions, missing or multiple H1 tags, no H2 structure, canonical tag issues, duplicate meta descriptions across pages, pages returning 4xx/5xx errors, thin content (under 300 words), images missing alt text, HTTP instead of HTTPS, and URL structure issues like underscores or excessive depth.

What data formats can I export?

CrawlIQ exports structured Excel (.xlsx) reference documents: a Full SEO Report with all evaluated pages, issues, and AI remediation guidance; a Per-Field Issues Report; a Remediation Table with optimised content; and a Technical SEO Assessment with per-page scores (0–100), letter grades (A–F), and indexability status.

How many pages can the evaluation engine process?

CrawlIQ is free with no credit card required. As a guest you can evaluate up to 50 pages per session — enough for most small to medium sites. Creating a free account raises this to 200 pages per month with project saving and position tracking. The evaluation engine uses breadth-first search from your root URL and handles SSL failures with automatic HTTP fallback.

Is my website data secure and private?

Yes. All evaluation data is processed in isolated in-memory sessions and never stored permanently or shared. Data exists only for the duration of your session and is cleared when a new evaluation begins. CrawlIQ is fully open-source on GitHub and hosted on HuggingFace Spaces — you can review every line of code.

Does CrawlIQ support JavaScript-rendered sites?

CrawlIQ uses an aiohttp-based async evaluation engine with BeautifulSoup for HTML parsing. It works best with server-side rendered, static, and WordPress sites, extracting titles, meta tags, headings, canonicals, Open Graph tags, body text, and image alt texts. For heavily client-side SPAs, enabling server-side rendering gives the best evaluation coverage.

What is CrawlIQ? — Technical SEO Evaluation Reference

CrawlIQ is a free, open-source AI-powered technical SEO evaluation reference built by Teki Bhavani Shankar, a Technical SEO Specialist. It gives every website owner access to the same evaluation depth as Screaming Frog, SEMrush, and Ahrefs — at zero cost. Submit any URL to receive a complete technical assessment covering 50+ SEO signals, AI-produced remediation guidance, and a downloadable Excel reference document.

Technical SEO Evaluation at Scale

CrawlIQ examines entire websites in seconds using an async Python BFS evaluation engine. It surfaces indexing issues, broken canonicals, missing meta tags, redirect chains, and thin content — the same checks enterprise systems charge hundreds per month for. Every page receives a score from 0–100 and an A–F grade across 9 technical dimensions.

AI-Powered SEO Remediation Engine

Unlike other free site evaluation systems, CrawlIQ pairs its evaluation engine with AI models — Groq (Llama 3), Gemini, Claude, and OpenAI — to produce paste-ready content remediation. Receive a Core Web Vitals assessment, per-page A–F grades, and export everything to Excel. Python SEO automation powers the backend, so every evaluation reflects real HTTP responses.

Designed for Real SEO Workflows

CrawlIQ integrates indexation budget optimisation signals, robots.txt validation, sitemap evaluation, and duplicate content detection into one reference system. Designed by a working Technical SEO Specialist, every capability reflects real on-the-job needs. All evaluation data is processed in isolated in-memory sessions and never stored permanently.

Technical SEO Evaluation
with AI Precision

Seven Technical SEO Evaluation Modules