All tools › Rows and columns
Remove duplicate rows
Finds rows that are the same after normalising, and keeps the one you choose.
It runs entirely in this browser tab: the documents you paste are never uploaded, and the tool makes no network request while it works. Open your browser's network panel and try it — nothing leaves the page.
Settings
- Delimiter
- Choices: Work it out, Comma, Semicolon, Tab, Vertical bar.
- No header row
- On or off. Starts off.
- Duplicates by
- Leave it empty and the whole row is the key.
- Keep
- Which of a set of duplicate rows survives. Choices: The first, The last, The fullest.
- Before comparing
- Two rows that look different can be the same row. Choices: Ignore capitals, Trim the spaces, Collapse spaces.
- Show
- Choices: What was kept, Removed.
How to use it
- Paste your text into the box above, or open a file.
- Adjust the settings beside it until the result is what you wanted.
- Copy the result, or save it as a file. The result updates as you type.
Questions
- Is what I paste uploaded anywhere?
- No. The whole tool is carried as WebAssembly and runs on your own device. That is the point of the group: the files these tools are for are exactly the ones you would not paste into somebody else's server.
- How big a file can it take?
- About a megabyte, and it says so rather than truncating quietly. Past that you are handing it a database rather than a document, and the input here is a text area — the editing view is capped at forty thousand characters and says so, though the tool still reads all of what you gave it.
- Why does it say it guessed?
- Because it did. Which format a document is, which delimiter a table uses and whether the first row is a header are all decided by looking at the text. Each guess is right almost always and each is printed on the result, because a converter that guessed silently and got it wrong would eat a file.
- Does it change my numbers?
- No. A number keeps the text it was written as, all the way through: `1.0` stays `1.0` and a thirty-digit identifier stays thirty digits. Nothing here is ever a floating-point value, which is why a sorted document differs from the original only where you asked it to.
Other tools for rows and columns
CSV columns
Picks, renames, reorders and filters the columns of a table.
Merge and split tables
Joins tables by column name, or cuts one into parts that each keep the header.
Change CSV delimiter
Rewrites a file with another delimiter, quotation marks and decimal point.
Table to Markdown
A table as Markdown, HTML or lined-up text, with the columns aligned.
Markdown table editor
Adds, drops, moves or sorts a column and gives the table back with the pipes lined up.
HTML table to CSV
Pulls every table out of a page, merged cells filled in.
Fixed-width parser
Splits lines whose columns are positions rather than delimiters.
Table diff
Compares two tables on a key and shows what changed, cell by cell.
Anonymise a table
Replaces names, addresses and numbers, the same value the same way every time.
All thirty-five tools