Passmark
By Bug0. Category: Natural-language test authoring. Homepage
Bug0's Passmark README describes Passmark as a Playwright library for AI regression testing. Tests are written as plain-English steps that an AI agent executes in the browser. Successful step actions can be cached in Redis so later runs replay them without AI calls. Cached steps heal automatically when they stop working. Tests are Playwright test files that import the Passmark library and need Anthropic and Google AI keys or a supported gateway. The vendor's site states that existing CI setups, such as GitHub Actions, GitLab CI and Jenkins, work unchanged. The code is source-available under the FSL-1.1-ALv2 licence.
Description written from the vendor's documentation.
Status
Status: Active
Facts
| Fact | Value | Evidence | Source | Verified on |
|---|---|---|---|---|
| Status | Active | Documented | github.com | |
| Founded | Not documented | Not documented | None found | |
| Headquarters | Not documented | Not documented | None found | |
| AI capabilities | Documented | github.com | ||
| Test creation | Documented | github.com | ||
| Test output | Not documented | Not documented | None found | |
| Surfaces | Documented | github.com | ||
| Hosting | Documented | github.com | ||
| Pricing model | Documented | github.com | ||
| Free tier | Yes | Documented | github.com | |
| CI integrations | Vendor-stated | passmark.dev | ||
| Self-healing | Documented | Documented | github.com | |
| Agent integration | Not documented | Not documented | None found | |
| Open source | Yes, licence FSL-1.1-ALv2 | Documented | github.com |
Published prices
| Plan | Price | Billing |
|---|---|---|
| Open-source Passmark | Free | not stated |
Vendor-stated, verbatim
What Bug0 says about its product, quoted as published and not confirmed in documentation.
“First run: AI agent → ~30s per action step”
“Passmark caches successful step actions in Redis. On subsequent runs, cached steps execute directly without AI calls, dramatically reducing latency and cost.”
Alternatives
Tools in the same category (Natural-language test authoring), ordered by the number of shared creation and surface values, then by name. Each line lists documented facts that differ from Passmark.
- agent-qa: documents output Proprietary runner
- Alumnium: Natural-language test authoring; no documented difference in output, creation, hosting or free tier
- AskUI: documents output Proprietary runner; hosting hybrid; no free tier
- AssureQA: documents hosting cloud; no free tier
- Auto Playwright: Natural-language test authoring; no documented difference in output, creation, hosting or free tier
- AutonomIQ: documents creation by recording; status shut down
Questions
Is this page a review of Passmark?
No. This page is a fact sheet. Each fact shows its evidence level, its source and the date it was checked. We do not rate or rank tools.
Does Passmark have a free tier?
Yes. Passmark has a free tier. This is documented, checked on 2026-09-24.
What test output does Passmark produce?
The test output format is not documented as of 2026-09-24.
Is Passmark still available?
Status: Active, checked on 2026-09-24.
Sources
Spotted an outdated or wrong fact about Passmark? Send the source and we apply it at the next monthly update.