Skip to content
testcritic

API & Contract Testing

Verify services and their contracts without opening a browser.

13 specialist tools3 free or open source11 self-hostable1 usable without code

What this category is really about

API tests are the best value in the whole pyramid: they run in milliseconds, they don't flake on a CSS change, and they cover the layer where most business logic actually lives. If your E2E suite is slow and brittle, moving half of it down to this layer is usually the highest-leverage change available.

Contract testing is the specialist sub-category. In a microservice estate, it lets a consumer and a provider verify their agreement independently, so you catch a breaking change at build time instead of in a shared staging environment.

What to evaluate

01

Spec-driven generation

Importing OpenAPI/GraphQL schemas to scaffold tests saves days and keeps tests honest as the schema evolves.

02

Environment and secret handling

You will run the same suite against local, staging and production. Variables, vaults and per-environment config must be clean.

03

CI-native execution

A CLI runner that exits non-zero is non-negotiable. GUI-only tools cannot gate a deploy.

04

Chaining and data flow

Real flows need the token from step 1 in step 4. Check how painful that is.

Common mistakes

  • Keeping the test collection in one person's desktop app instead of in the repo.
  • Asserting on the full response body, so every additive field change turns the suite red.
  • Treating contract testing as a replacement for integration testing rather than a complement.

13 tools built for this

Sorted by how widely adopted they are, not by preference. Tick the compare boxes to put two or more side by side.

Filter these

Tools that also cover this

These are built primarily for something else but handle this category as part of a broader platform — often a way to consolidate two subscriptions into one.

Apache JMeter

Load & Performance

The open-source workhorse: every protocol, a GUI, and twenty-five years of plugins.

Open sourceNo-codeSelf-host

Cypress

E2E & UI Testing

Developer-first browser testing with an interactive runner developers actually enjoy.

from $75Open sourceSelf-host

Grafana k6

Load & Performance

Developer-first load testing: JavaScript scripts, Go engine, CI-native thresholds.

from $19Open sourceSelf-host

LocalStack

Test Data & Mocks

A local AWS cloud emulator so you can test infrastructure without an AWS bill.

from $35Open sourceSelf-host

Playwright

E2E & UI Testing

Microsoft's cross-browser automation library with tracing and auto-waiting built in.

Open sourceSelf-host

pytest

Unit & Component

The de facto Python testing framework: fixtures, parametrisation, plugins.

Open sourceSelf-host

Testcontainers

Test Data & Mocks

Real databases and services in throwaway Docker containers, per test run.

Free tierOpen sourceSelf-host

WireMock

Test Data & Mocks

The standard HTTP mock server for JVM and beyond: record, replay, stub, simulate faults.

Free tierOpen sourceSelf-host

Artillery

Load & Performance

YAML or JavaScript load tests that run serverless on AWS at large scale.

Open sourceSelf-host

BlazeMeter

Load & Performance

Managed cloud execution for JMeter, Gatling, k6 and Selenium scripts.

from $149

Checkly

Monitoring

Monitoring as code: your Playwright scripts, running against production on a schedule.

from $40

Gatling

Load & Performance

High-performance load testing with a code-first DSL and superb HTML reports.

from €89Open sourceSelf-host

Katalon Studio

E2E & UI Testing

All-in-one low-code platform covering web, API, mobile and desktop.

from $175No-code

Locust

Load & Performance

Write load tests as plain Python. Scale by adding workers.

Open sourceSelf-host

Mockoon

Test Data & Mocks

Spin up a realistic mock API from a desktop app in under a minute.

from $9Open sourceSelf-host

Robot Framework

E2E & UI Testing

Keyword-driven acceptance testing that reads like structured English.

Open sourceNo-codeSelf-host

Tricentis Tosca

E2E & UI Testing

Model-based enterprise test automation for SAP, mainframe and packaged applications.

Talk to salesNo-code

mabl

E2E & UI Testing

Low-code, AI-assisted test automation with self-healing locators.

Talk to salesNo-code

Mockaroo

Test Data & Mocks

Design a realistic dataset in the browser and export it as CSV, JSON or SQL.

from $60No-code

Prism

Test Data & Mocks

Turn an OpenAPI document into a mock server that validates as well as responds.

Open sourceSelf-host

Testsigma

E2E & UI Testing

Write tests in plain English, run them on web, mobile and APIs.

from $349Open sourceNo-codeSelf-host

Hoverfly

Test Data & Mocks

Lightweight service virtualisation: capture real traffic, then simulate it.

Open sourceSelf-host

Leapwork

E2E & UI Testing

Visual flowchart automation designed for business users, not engineers.

Talk to salesNo-code

Virtuoso QA

E2E & UI Testing

Natural-language authoring with self-healing, aimed at enterprise QA teams.

Talk to salesNo-code