Skip to content
testcritic

Pa11y vs Lighthouse

Feature checklists rarely decide anything. What decides it is the pricing metric, who has to write the tests, and which limitation you can live with.

Entry price

Free and open source

Open source

Free and open source

Open source

What drives the bill

The metric that actually scales your invoice.

Free and open source. You pay in engineering time and CI minutes.

Free and open source. You pay in engineering time and CI minutes.

Free tier

Everything, self-hosted

Everything, self-hosted

Open source

LGPL-3.0

Apache-2.0

Self-hostable

No-code authoring

Languages

JavaScript
JavaScript

Platforms

Web
Web

Fits teams

Solo / side projectStartupScale-up / mid-market
Solo / side projectStartupScale-up / mid-marketEnterprise

Adoption

Established

OSS community · since 2013

Category standard

Google · since 2016

Strengths

  • Free, scriptable and trivially added as a CI gate.
  • Tests a sitemap of URLs in one run, unlike page-by-page extensions.
  • Self-hosted dashboard for tracking without a vendor.
  • Already installed in every Chrome browser — zero adoption cost.
  • Covers performance, accessibility and SEO in one report.
  • Lighthouse CI turns scores into enforceable build assertions.

Limitations

  • No guided manual testing or remediation workflow.
  • Testing authenticated or interactive states requires scripting actions.
  • Maintenance activity has been intermittent.
  • Lab data from a synthetic environment, not what real users experience.
  • Scores vary run to run, which makes strict thresholds frustrating.
  • Accessibility coverage is the axe-core subset, not a full audit.

Best for

Teams wanting free automated accessibility gates across many pages.

Every web team as a first, free quality baseline.

All of these integrate with: GitHub Actions.

Pricing last reviewed August 2026 and is indicative only — confirm on each vendor’s own page.