Skip to content
Joel Natividad edited this page Nov 15, 2026 · 47 revisions

qsv Wiki

Linux build status Windows build status macOS build status Security audit Codacy Badge Discussions Minimum supported Rust version Crates.io FOSSA Status DOI

qsv is a blazing-fast, composable data-wrangling toolkit for CSV, TSV, SSV, Excel, JSON/JSONL, Parquet and more. 80 commands across five binary variants, and a single binary that fits in your toolbox.

Latest release: 29.0.0 — 🛡️ the "Trust the numbers" release — ~104 commits since 28.0.0, and the theme is correctness: a sweep of stats and moarstats, luau, profile, scoresql, sqlp --format avro, and every command that reads piped stdin. New: validate --sarif writes JSON Schema errors as a SARIF 2.1.0 log for GitHub code scanning. stats no longer crashes on NaN cells, which is how pandas and numpy write missing values; upgrade if you run stats --median, --quartiles or --everything on their output. Also in this release: piped stdin works in eleven more commands (sample, cat, applydp, geocode --batch 0, input --skip-lastlines, partition, split --chunks, searchset, frequency, sniff, extsort); maps render in sandboxed iframes such as CKAN's Webpage view; the stats cache is no longer served stale after an environment or delimiter change; faster stats --cardinality/--everything (see Benchmarks); and sqlp on a newer Polars with correlated subqueries, LATERAL and CREATE VIEW. See the full changelog.

Important

29.0.0 breaking changes — some results and exit codes change. sqlp: EXPLAIN takes queries only, so EXPLAIN DROP TABLE t now fails instead of dropping the table (#5055), and the Polars bump changes a few results (IS DISTINCT FROM precedence, POSITION/STRPOS of NULL, Int64 return types, row order of window queries without an outer ORDER BY). validate: rows that passed can fail under jsonschema 0.61.2 (stricter date-time/date/time, . in pattern, big whole floats against bounds). profile --strict fails where it used to pass (#5025). luau: an END script error exits 1 (#5036). stats: NaN cells are skipped by every numeric statistic and an all-NaN column has no sum (#5053, #5056); with QSV_NO_HEADERS, fields are numbered 0, 1, … (#5049); --mode without --cardinality reports *ALL for an all-unique column; max_precision changes for very small and very large floats; and --weight changes for all-zero-weight columns (#5050). Details in the changelog's Breaking Changes. The MSRV is now Rust 1.100. (The x86_64 prebuilts require AVX2, all variants except qsvdp — check first before qsv --update on an older CPU.)

Welcome! This wiki is the workflow + discoverability layer for qsv. Use it to learn how the commands fit together and find recipes for real-world tasks. For per-command flag references, follow the deep-links into /docs/help/ — that's the canonical reference.

Three ways to start

Path When
Try it in your browser You want to evaluate qsv before installing anything
Install qsv You're ready to run it locally
Read the Whirlwind Tour You want a guided 2.7M-row walkthrough

Then jump to Getting Started for a hands-on tutorial, or Why qsv? for the elevator pitch.

Where things live

qsv documentation lives on several surfaces. Each has a different job:

Surface Job
README.md Project overview, command catalog with legend, install options, feature flags
/docs/ (canonical reference) The source of truth: PERFORMANCE.md, BENCHMARKS.md, ENVIRONMENT_VARIABLES.md, STATS_DEFINITIONS.md, Validate.md, Fetch.md, Describegpt.md, INTERPRETERS.md, plus the whirlwind tour
/docs/help/ Per-command help — flags, arguments, examples
This wiki Workflow & discoverability: getting started, cookbook recipes, command-reference category guides, tuning, integrations, troubleshooting
100.dathere.com Interactive lessons & exercises (WIP)
Discussions Q&A, FAQ, announcements, ideas
Ask DeepWiki LLM-generated Wiki that crawls the codebase once a week, that you can chat with!

Browse by tier

Every wiki page has a Tier badge — Beginner, Intermediate, or Advanced. See the Tier Legend for what each tier assumes.

Beginner

Installation · Getting Started · Why qsv? · Command Reference (index) · Cookbook · Troubleshooting · FAQ · Glossary · External Resources · qsv pro

Intermediate

Binary Variants · Transform & Reshape · Aggregation & Statistics · Joins & Set Ops · Validation & Schema · Conversion & I/O · Geospatial · HTTP & Web · Indexing, Compression & Diff · AI & Documentation · Comparison vs others · Integrations · US Census Integration · Claude Cowork Plugin · MCP Server

Advanced

SQL & Polars · Scripting (Luau / Python) · Performance Tuning · Environment Variables · Stats Cache & Caching · Lookup Tables · Contributing to the Wiki

Anchor datasets used across this wiki

Examples in this wiki reach for a small set of datasets repeatedly, so you build mental models:

Try it in your browser

No install required: visit qsv.dathere.com to try qsv against a sample CSV right now.

Talks & blog series

Legacy pages (preserved during wiki rewrite)

These pages predate the wiki rewrite. Their content has been integrated into the new structure but the originals are kept for backwards-compatibility with external links:

Contributing to this wiki

This wiki is itself a git repo at https://github.com/dathere/qsv.wiki.git. See Contributing to the Wiki for clone/edit/push instructions and the verification checklist.

Home · Why qsv? · Tier legend

Quick links

Get Started

Command Reference

Cookbook

Tuning & Internals

Ecosystem

Reference

Legacy

Clone this wiki locally