Column toolkit for CSV and JSON files
Load a CSV, TSV, JSON or JSONL file and build a list of cleanup steps: rename, reorder, drop, split, merge, trim, change case, find and replace, fill empty cells, reformat dates, cast numbers, filter and sort. The preview updates as you go, and the steps export as JSON to re-run later. It runs in your browser.
How to use it
- 01Load a file, or try the sample of messy contact records.
- 02Pick an operation, fill in its fields and add it as a step. The preview updates at once.
- 03Remove any step that does not do what you want. Later steps see the columns left by earlier ones.
- 04Download the cleaned file in the format you loaded.
- 05Export the steps as JSON. Import them next month to run the same cleanup on a refreshed file.
What it does not do
- Number casting reads US-style numbers such as 1,234.50. European formats such as 1.234,50 need a find and replace step first.
- Dates written as 03/04/2024 are read month first unless you tick the day-first option.
- CSV values are text. A cast number is written as a number in JSON and JSONL output.
- Files are read into memory, so the limit is 50 MB.
Questions
About the column toolkit.
Is my data uploaded anywhere?
Can I reuse the same cleanup on a new file?
Does find and replace support regular expressions?
In what order do the steps run?
Is it really free?
More free tools
Personal data scrubber
Strip names, emails, phones, cards, keys and addresses from text and files.
Dataset profiler
Rows, columns, tokens, date span, duplicates and personal-data columns in one report.
Column hasher and remover
Drop sensitive columns or replace them with salted hashes that still join.
CSV, JSON and JSONL converter
Convert between CSV, TSV, JSON and JSONL without breaking quoted cells.
JSONL validator
Find the broken lines in a JSONL file and see which keys are missing.
Duplicate remover
Remove repeated rows, records or log lines, keeping the first of each.
Token counter
Size text the way AI labs do: tokens, words, characters and lines.
Data card generator
Write the one-page description every data buyer asks for.
Data rights pre-check
A tailored checklist of the contracts and questions to clear before a sale.
Slack export parser
Turn a Slack workspace export into clean thread JSONL with pseudonymized users.
Email thread parser
Convert .mbox and .eml files into threaded JSONL without quoted replies.
Ticket export parser
Map help desk exports to customer and agent turns in conversation JSONL.
Chat dataset format converter
Convert and validate OpenAI, ShareGPT, Alpaca and prompt/completion datasets.
Log parser
Turn web server, syslog, logfmt and JSON logs into structured JSONL or CSV.
HTML and document text extractor
Extract clean text from HTML, Markdown, XML and JSON files in batches.
Re-identification risk checker
Measure k-anonymity and l-diversity, then preview fixes that lower the risk.
Secrets scanner
Find API keys, tokens, passwords and private keys in a repo or export before you share it.
Delivery manifest builder
Create a SHA-256 checksum manifest for a dataset delivery, with one hash to compare.
Delivery verifier
Check received files against a manifest: match, changed, missing or extra.
File checksum calculator
SHA-256 of any file, with a compare box that turns green or red.
Train, validation and test splitter
Split a dataset into train, validation and test files without leaking related rows across splits.
Dataset sampler
Pull a random, stratified or first-N sample from a file, including files too large to open.
Schema inferrer and data dictionary
Infer field types and stats from a file and export JSON Schema, a data dictionary and SQL.
Text chunker
Split documents into overlapping chunks for retrieval or training, with heading context.
Dataset diff
Compare two versions of a dataset: added, removed and changed records, plus schema changes.
Encoding and mojibake fixer
Repair garbled characters, convert files to UTF-8 and strip invisible characters.
Cleaned it up? Sell it to Outrich.
Outrich Data buys company data directly. Check in five minutes whether yours qualifies, with no call.