Assembly Line

Shortest

QA via natural language AI tests

Shortest is an open-source test frameworks project on GitHub under the MIT license (permissive), with 5.7k stars. It is built with TypeScript, V8, Drizzle ORM and Next.js. Its last push was 3 months ago.

Stars
5.7k
License
MIT
Activity
Slowing
Latest release
v0.4.9

Code on GitHub Website

Judgement

What it is
Developer tool
What it does
An end-to-end testing framework where tests are written as plain-English instructions that Claude carries out in a Playwright browser.
Adopt it when
You want to try natural-language E2E tests on a web app and accept paying for model calls on every run.
Watch out
Runs are slower, cost API fees and are less deterministic than scripted tests, and development has slowed with no push since August.
Ready for
Experimental
Runs as
Command line and library
Built with
TypeScript, Playwright and Anthropic API
How established
Established: started 2 years ago, latest release v0.4.9.
What the license allows
You can build it into a product you sell, as long as you keep its copyright notice.

Judged on 2026-11-06 from the project's README and GitHub data. The license and age lines are worked out directly.

Built from

Follow it down: Shortest → TypeScript → Go → runs on a microchip

How compilers were built, back to punched paper tape

Open-source alternatives to Shortest

  1. 1
    Playwright microsoft

    Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

    Developer tool Production-ready You need reliable end-to-end tests across all major browser engines, or browser automation for scripts and AI agents.

    ★ 99k Apache-2.0 TypeScript Active, pushed today
  2. 2
    Cypress cypress-io

    Fast, easy and reliable testing for anything that runs in a browser.

    Developer tool Production-ready Your front-end team wants an easy-to-debug browser test tool with an interactive runner, mainly for Chromium-family browsers.

    ★ 51k MIT TypeScript Active, pushed today
  3. 3
    Jest jestjs

    Delightful JavaScript Testing.

    Developer tool Production-ready You maintain a React or Node.js codebase already built around Jest, or want the most widely documented JavaScript test runner.

    ★ 45k MIT TypeScript Active, pushed 3 days ago
  4. 4
    Mocha mochajs

    ☕️ Classic, reliable, trusted test framework for Node.js and the browser

    Developer tool Production-ready You maintain an existing Node.js suite written for Mocha, or want a minimal runner where you pick each piece yourself.

    ★ 23k MIT JavaScript Active, pushed yesterday
  5. 5
    AVA avajs

    Node.js test runner that lets you develop with confidence 🚀

    Developer tool Production-ready You test Node.js libraries and prefer a minimal runner without global functions.

    ★ 21k MIT JavaScript Active, pushed 5 days ago
  6. 6
    Vitest vitest-dev

    Next generation testing framework powered by Vite.

    Developer tool Production-ready The project already builds with Vite, or you want native ES module and TypeScript support without the transform setup Jest needs.

    ★ 17k MIT TypeScript Active, pushed today
  7. 7
    Karate karatelabs

    Test Automation Made Simple

    Developer tool Production-ready Testers who are not strong Java programmers need to write API tests and mocks for microservices in a readable format.

    ★ 9k MIT Java Active, pushed today
  8. 8
    Doctest doctest

    The fastest feature-rich C++11/14/17/20/23 single-header testing framework

    Developer tool Production-ready You want C++ unit tests with very low compile-time cost or tests written inside the source files themselves.

    ★ 6.9k MIT C++ Active, pushed 18 days ago

Stars, license and activity come from GitHub and refresh on a rolling hourly schedule. The project's own description is quoted as written.