Oncrawl vs WebPageTest in 2026: crawl and log intelligence vs open-source performance diagnostics
Oncrawl tracks how crawlers, including AI bots, move through your site at enterprise pricing with a required demo. WebPageTest is the free, open-source standard for diagnosing exactly why an individual page is slow.
Oncrawl
WebPageTest- WebPageTest's core product is genuinely free, with a public instance at webpagetest.org requiring no account; Oncrawl has no free tier and no self-serve signup at all, access starts with a sales demo.
- Oncrawl analyzes server logs to show exactly which URLs Googlebot and AI bots like GPTBot and ClaudeBot are visiting; WebPageTest has no log analysis capability, it tests individual pages on demand rather than ingesting server data.
- WebPageTest exposes the full request waterfall, filmstrip frame-by-frame rendering, and raw HAR data for deep performance diagnosis; Oncrawl does not run performance tests or expose this level of page-load detail.
- Oncrawl tracks AI bot crawl activity and monitors whether pages are cited in AI-generated answers; WebPageTest has no AI bot tracking or AI answer visibility feature of any kind.
- WebPageTest's Pro API tier costs $9.89/month and adds programmatic access, priority queuing, and continuous monitoring; Oncrawl's API is only available after a sales conversation with no published price at any tier.
- WebPageTest is open source and can be self-hosted for testing internal or staging environments; Oncrawl is a closed, hosted enterprise platform with no self-hosting option.
- WebPageTest scored 8.5/10 in our review, the highest of any tool in this comparison, driven by a 9.5 features score and a 9.5 value-for-money score given the free tier; Oncrawl scored 8.0/10.
Oncrawl and WebPageTest sit in the same Technical SEO category but answer completely different questions. Oncrawl audits site structure, ingests server logs to show which URLs Googlebot and AI bots are actually crawling, and layers in AI-generated answer visibility monitoring, all through a cloud platform with no public pricing and a required sales demo. WebPageTest is a free, open-source performance testing tool, run by Catchpoint and originally built by AOL engineer Patrick Meenan, that has been the reference benchmark for diagnosing page speed problems for over fifteen years. It runs real browser tests across 30-plus global locations and exposes waterfall, filmstrip, and raw HAR data that most commercial tools still measure themselves against. One costs nothing to start; the other costs a sales conversation before you know the number.
The tools at a glance
Oncrawl
Cloud-based technical SEO platform combining crawl data, log analysis, and AI bot tracking.
Oncrawl runs as a cloud platform combining three data sources: crawl data, server logs, and performance data. The log analysis piece is core to the product rather than an add-on, it shows exactly which URLs Googlebot and AI crawlers are visiting and where crawl budget is going to waste on pages that will never earn it back.
It has extended into AI search too, tracking crawl requests from GPTBot, ClaudeBot, and PerplexityBot at the URL level, with a separate layer checking whether pages are actually cited in AI-generated answers. Scheduled crawls run automatically and alerts flag regressions like a spike in 404s or a drop in indexed URLs without anyone needing to remember to check.
What Oncrawl does not offer is deep, single-page performance diagnostics, no waterfall breakdown, no filmstrip, no request-level timing data. Access is enterprise-only: no self-serve signup, no public pricing, and a demo is required before you see a number, which is a real barrier for a team that just wants to diagnose why one page is slow.
| Feature | Enterprise Contact for pricing |
|---|---|
| Pricing model | Custom |
WebPageTest
The open-source gold standard for deep web performance diagnostics, trusted by engineers at Google, Mozilla, and every serious web team.
WebPageTest has been the reference benchmark for web performance diagnostics for over fifteen years, originally built by AOL engineer Patrick Meenan and now maintained by Catchpoint. It runs tests on real Chrome, Firefox, or Edge browser instances, not headless emulation, across more than 30 global locations, and the public instance at webpagetest.org is free with no account required.
The diagnostic depth is what sets it apart: the waterfall view breaks down every request with connection, DNS, SSL, and response timing, and the filmstrip shows frame-by-frame what a user actually sees as a page loads. No-Code Experiments let you test the impact of a hypothetical change, like removing a third-party script, before involving an engineering team at all.
It is not built for crawling a whole site or analyzing server logs, WebPageTest tests pages you point it at, one at a time or via the API, it does not audit broken links, canonical issues, or crawl budget the way Oncrawl does. The paid Pro API tier, starting at $9.89/month, adds programmatic access and continuous monitoring for teams that need automation beyond one-off diagnostic runs.
| Feature | Free Free | Pro API (Starter) $9.89/month |
|---|---|---|
| On-demand tests | Shared queue | Priority access |
| Global test locations | 30+ | 30+ |
| Filmstrip and video replay | Yes | Yes |
| Lighthouse integration | Yes | Yes |
| API access | No | Yes |
| Continuous monitoring | No | Yes |
Head-to-head feature comparison
| Feature | Oncrawl | WebPageTest |
|---|---|---|
| Overall score | 8.0 / 10 | 8.5 / 10 |
| Site crawling & technical audits | Yes, core feature | No |
| Server log analysis | Yes, core feature | No |
| AI bot crawl tracking | Yes (GPTBot, ClaudeBot, PerplexityBot) | No |
| AI-generated answer citation monitoring | Yes, dedicated layer | No |
| Deep performance diagnostics (waterfall/filmstrip) | No | Yes, core feature |
| Global test locations | No | 30+ |
| Continuous monitoring | Yes, scheduled crawls | Pro API only |
| API access | Yes, REST API | Pro API only |
| Open source / self-hostable | No | Yes |
| Free tier | No | Yes, full public instance |
| Starting price | Contact for pricing | Free |
WebPageTest has no AI-search angle, and Oncrawl only offers one behind an enterprise sales demo.
WebPageTest is entirely focused on page-load performance diagnostics, it has no feature for tracking AI bot crawl behavior or whether content is cited in AI-generated answers. Oncrawl does track this, monitoring AI bot activity from GPTBot, ClaudeBot, and PerplexityBot and whether pages actually appear as citations in AI responses, but only as part of a full enterprise crawl-and-log platform behind a required demo. AI Peekaboo covers that specific job as a self-serve product, tracking brand mentions across ChatGPT, Gemini, Perplexity, and Google AI Overviews from $50/month with a read and write API on every plan, no diagnostic tool or enterprise contract required.
Read the AI Peekaboo review →Which should you choose?
OncrawlWebPageTestOncrawlWebPageTestWebPageTestOncrawlThese two tools rarely compete for the same budget line because they solve different-sized problems. WebPageTest answers a narrow, deep question, why is this specific page slow, with more diagnostic detail than almost anything else available, and it does it for free. Oncrawl answers a broader, ongoing question about a whole site: is crawl budget being wasted, are AI bots reaching the right content, is anything actually being cited in AI answers. A team chasing a single page-speed regression should reach for WebPageTest first; a team managing an enterprise site's crawl health has a different problem WebPageTest was never built to solve.
Bottom line
Start with WebPageTest, it is free, and for diagnosing why a specific page is slow nothing else comes close on detail. Book the Oncrawl demo only once the question gets bigger than page speed, when crawl budget waste, log-verified indexation, or AI bot and citation tracking become the actual bottleneck, and be ready for enterprise pricing rather than a free account. The two are complementary enough that a technical SEO team managing a large site could reasonably run both.
Frequently asked questions
Is WebPageTest actually free, or does it require a paid plan for real use?
WebPageTest's public instance at webpagetest.org is genuinely free with no account required, and it covers the vast majority of one-off diagnostic work. The paid Pro API tier at $9.89/month only becomes necessary for programmatic access, priority queuing, and continuous monitoring, none of which Oncrawl offers without a sales demo either.
Can Oncrawl diagnose why a single page is loading slowly the way WebPageTest can?
Oncrawl does not offer the kind of request-level waterfall or filmstrip diagnostics that WebPageTest is built around, its performance data sits alongside crawl and log analysis rather than replacing a dedicated diagnostic tool. For diagnosing exactly why one page is slow, WebPageTest's real-browser testing and filmstrip view give far more actionable detail.
Does WebPageTest track AI bots like GPTBot the way Oncrawl does?
WebPageTest has no AI bot tracking or AI-generated answer visibility feature, it is strictly a performance testing tool for individual pages. Oncrawl tracks crawl activity from GPTBot, ClaudeBot, and PerplexityBot directly and separately monitors whether pages are cited in AI-generated answers.
Who maintains WebPageTest and can I trust the data for client reporting?
WebPageTest is open source, originally created by AOL engineer Patrick Meenan and now maintained by Catchpoint, which also hosts the public instance and sells the commercial Pro API tier. The tool has been the reference benchmark for performance engineers at companies like Google and Mozilla for over fifteen years, which makes its data credible enough for client-facing reporting.
Which tool is better for auditing crawl budget and server log data?
Oncrawl is the clear choice for this, log analysis is a core, always-on part of the platform, mapping exactly which URLs Googlebot and AI crawlers visit and where crawl budget is being wasted. WebPageTest has no server log ingestion or crawl budget analysis capability at all, it tests pages one at a time rather than analyzing site-wide crawl behavior.
Is there a cheaper way to track AI answer citations than Oncrawl's enterprise platform?
AI Peekaboo tracks brand mentions across ChatGPT, Gemini, Perplexity, and Google AI Overviews as a self-serve product starting at $50/month with a read and write API on every plan. Oncrawl's AI-generated answer visibility feature covers similar ground but only inside a full enterprise crawl platform with contact-only pricing, and WebPageTest has no AI citation tracking of any kind.