PROJECT · TOK0 / FIELD COMPRESSION UNIT
SERIAL NO. 0.1.18 · BUILT IN RUST · MIT
OPEN SOURCE — SHELL OUTPUT COMPRESSION PROXY TOK0 · DOCS >>> REFERENCE

Compressors

The full inventory of commands tok0 compresses out of the box. ~250 commands across 30 ecosystems, each with a CI-asserted minimum savings floor.

The complete list of commands tok0 ships with built-in compression. Each row’s “floor” is the minimum savings the rule must hit in CI on its captured fixture. Real-world savings are usually higher.

Commands not on this list still work — they pass through tok0’s generic ANSI-strip + hard-cap path, which typically saves 20–40% on any verbose tool.

Version control

CommandFloorType
git diff83%native
git log78%native
git status70%TOML
gh pr list68%native
gh pr view72%native
gh issue list65%TOML
gt log70%TOML
jj log70%TOML

Build & package — JavaScript / TypeScript

CommandFloorType
npm install80%native
pnpm install81%native
bun install79%native
yarn install78%TOML
tsc66%native
vitest71%native
jest70%native
next build70%native
eslint64%TOML
prettier60%TOML
playwright test68%native
prisma migrate70%TOML
turbo run70%TOML
nx run70%TOML
esbuild65%TOML

Build & package — Rust

CommandFloorType
cargo build72%native
cargo test68%native
cargo clippy74%native
cargo bench70%TOML
cargo fmt80%TOML

Build & package — Python

CommandFloorType
pytest73%native
ruff check65%native
mypy60%TOML
pip install72%TOML
uv sync70%TOML
poetry install70%TOML
black60%TOML
flake860%TOML

Build & package — Go / Java / .NET / Ruby

CommandFloorType
go build67%native
golangci-lint65%native
gradle build76%native
mvn install72%native
dotnet build72%TOML
dotnet test68%native
rake65%native
rspec70%native
rubocop65%native

Build systems

make, cmake, bazel, ninja, meson, scons, pants, buck2 — all rule-driven, floors 65–75%.

Containers & cloud

CommandFloorType
docker build84%native
docker compose up75%TOML
docker inspect60%native (JSON-aware)
kubectl get69%native
kubectl get -o json60%native (JSON-aware)
kubectl describe70%TOML
helm install70%TOML
terraform plan77%native
terraform apply75%native
aws s3 ls72%native
gcloud …70%TOML
ansible-playbook75%TOML
argocd …70%TOML
flux …70%TOML

nerdctl is aliased to the docker dispatcher: every docker subcommand (ps, build, images, logs, compose, inspect) is also covered when invoked as nerdctl ….

Package managers

brew, apt, dnf, pacman, snap, flatpak, nix, winget, scoop, choco, gem, nuget, vcpkg, conan — floors 70–85%, mostly TOML rules.

Linters & formatters

shellcheck, hadolint, stylelint, yamllint, markdownlint, clang-format, shfmt, gofmt, swiftformat, ktlint, scalafmt, nixfmt — floors 60–75%.

Security & supply chain

semgrep, trivy, bandit, snyk, grype, gitleaks, checkov, tfsec, cosign, sops, sonar — floors 65–75%, all TOML rules.

CI/CD: act (local GitHub Actions runner), pre-commit — TOML.

Networking & system tools

Native compressors (CI-asserted ≥60% savings):

CommandFloorNotes
curl -v60%drops TLS handshake, request/response headers, progress meter — keeps status line + body
dig60%keeps the ANSWER section; drops query metadata, AUTHORITY, ADDITIONAL
lsof60%drops DEVICE/SIZE/NODE columns; group-by-command summary for large outputs
netstat / ss60%groups by state, keeps LISTEN ports in full, summarises ESTABLISHED
openssl x509 -text60%indent-aware drop of pub-key bytes, signature, SCT block, AIA URLs
tar -tvf60%count + size summary, by-extension grouping for archives >50 entries

TOML rules (strip patterns + head/tail window):

head, tail, cat/bat (route through read), sort, uniq, tree, sed, awk, wget, nslookup, traceroute, mtr, top, htop, sysctl, dmesg, journalctl, ip, eza/exa, glab, dasel, grpcurl, yq, httpie, gpg, keytool, vault, step, zip, unzip, 7z.

grep/rg/ag share one compressor; find/fd share another.

Other ecosystems

Languages: Elixir (mix, dialyzer), Haskell (cabal, stack), PHP (composer, artisan, phpunit, phpstan), Scala (sbt, mill), Swift (xcodebuild, swiftc), Dart (flutter, dart), mobile (expo, react-native), Perl (prove, cpanm), exotic (zig, nim, crystal, d).

System: ls, grep, find, diff, wc, env, ssh, rsync, tar, unzip, network tools, process tools, service managers.

Databases: mysql, psql, redis-cli, mongo, sqlite3.

API tools: httpie, grpcurl, newman, load testers.

Version managers: nvm, fnm, pyenv, rbenv, rustup, asdf, mise, volta.

When a command isn’t on the list

Three options, in order of effort:

  1. Run it through tok0 anyway. The generic path strips ANSI and applies a hard cap, saving 20–40% on most verbose tools.
  2. Write a TOML rule. ~10 lines for a typical case. See Writing TOML rules.
  3. Ship it as a built-in. PR a src/rules/<cmd>.toml into the repo with an assertion. CI gates the floor.
Tip

Run tok0 scan to see which of your already-run commands would benefit from a compressor. It reads your AI tool session histories and ranks the misses by tokens you’d have saved.

Known limitations

Global flag collision. tok0 has two global short flags: -v (--verbose) and -u (--ultra-compact). They take precedence anywhere in argv, so tok0 ls -v interprets -v as tok0’s verbose flag, not as ls -v. To pass -v or -u through to the underlying tool:

tok0 ls -- -v       # explicit `--` separator
tok0 ls --classify  # long form (no -v collision)

Other short flags (-l, -a, -r, -n, -h, etc.) work without escaping — tok0 ls -lah, tok0 grep -r foo, tok0 find -name '*.rs' all do what you’d expect.

BUILT IN RUST · SINGLE STATIC BINARY · 8 MB v0.1.18 / MIT GITHUB.COM/PRXM-LABS/TOK0