Crawlux publishes full methodology documentation under permissive open license

LONDON · APRIL 28, 2026

Crawlux today publishes the full methodology documentation for all 23 analyzer modules under a permissive open license. The release covers scoring weights, prompt sets, toxicity rubric categories, schema validation patterns and decision thresholds. Auditors, agencies and in-house teams can apply the methodology without using the Crawlux platform.

What is now documented. The 12-prompt AI Citation Checker test set and prompt-selection panel methodology. The 47-prompt AEO Test set organized by 9 crypto verticals. The 14-field FinancialProduct schema validation rules. The 6-category Web3 Backlink Toxicity Rubric with temporal decay curves. The 13-bot allowlist for AI crawlers. Plus the 18 less-visible analyzer modules covering technical SEO, indexability, internal linking, Core Web Vitals, content depth scoring and competitor analysis methodology.

The license is Creative Commons Attribution-ShareAlike 4.0 International. Anyone can apply the methodology commercially. Anyone can rebrand the methodology in their own audit reports as long as they cite Crawlux as the source. Anyone can build derivative tools using the methodology as long as those derivative tools publish under the same CC BY-SA license. Modifications to scoring weights require disclosure but not approval. The license terms publish in full at crawlux.com/license.

Why open methodology. Three reasons. First: the crypto SEO industry needs a shared toxicity and authority vocabulary that AI engines and search engines actually agree with. A common methodology accelerates that adoption. Second: closed methodology gates expert audit work behind platform subscriptions, which inflates costs for crypto teams that mostly do not need recurring monitoring. Third: reproducibility is a precondition for trust. Closed methodology cannot be reproduced or independently validated by third parties.

The competitive case is counterintuitive but solid. Publishing the methodology does not erode the moat. The moat is execution. Running 23 analyzers across multi-chain crypto sites in 60 seconds with continuous prompt set updates, weekly bot allowlist refreshes and quarterly toxicity rubric recalibration requires substantial engineering infrastructure. Most agencies and in-house teams will not build that infrastructure even with full methodology access. The Crawlux platform automates the methodology. The methodology itself is the public good.

For agencies running client audits, the recommended workflow: download the methodology PDFs, build an internal audit playbook against them, run audits manually or with semi-automated tools tailored to specific client needs. Crawlux Pro becomes one of several execution options for teams that want full automation rather than the only option for teams that want methodology access at all.

The full methodology documentation is at crawlux.com/blog/crawlux-methodology with category-by-category PDFs, worked examples and machine-readable scoring rule files in JSON format. The documentation updates quarterly aligned with prompt-set versioning and rubric category refreshes. Version history publishes alongside each update so teams can pin to a specific methodology version for reproducible audit comparison over time.

A note on what staying open does not mean. Crawlux Pro pricing stays at $25 per audit and $49 Team tier. The free tools remain free. The methodology being open does not change the product pricing because the product is the automation, not the rules. Teams paying for Crawlux Pro pay for time saved, not methodology access.

Crawlux is the world's first automated SEO audit tool built for Web3, DeFi and blockchain. The platform runs 23 analyzers across 6 check groups including AI visibility testing across ChatGPT, Perplexity and Claude. Free tier available. Paid tiers from $25 per audit. More at crawlux.com.