Download Deduplicator
Deduplicator is a small desktop utility for cleaning repeated entries from text lists. It accepts a pasted set of values, detects identical or similar items, and removes the repetitions so that only unique elements remain. A slider controls comparison strictness, covering exact matching, case differences, spelling variations, and relaxed similarity.
The program is intended for anyone who works with lists containing repeated names, codes, or terms. After detection, a preview window shows the matches before removal, giving the operator a chance to confirm the result. The final list keeps the original order of surviving entries.
Deduplicator is developed by David Gradwell and written in Java, which supports operation across common platforms with a suitable runtime. It forms part of a set of compact utilities released by the same author. The tool focuses on a single task: producing a clean list without repeated values.
Use Cases for Deduplicator
| Scans pasted list identifying every entry appearing more than once | Compares items per fuzziness setting, builds repeated value set |
| Deletes previously identified duplicates leaving single instance each | Preserves original order of remaining items across whole list |
| Separate panel lists every detected duplicate for verification | Acts as checkpoint between detection and removal stages |
| Adjusts strictness of comparison algorithm across slider range | Exact, case-insensitive, spelling-insensitive, relaxed positions available |
| Compares entries ignoring uppercase and lowercase letters | Suits lists where capitalisation varies but values match |
| Treats entries as duplicates differing by small spelling variations | Handles typographical differences like Jenni and Jenny |
| Applies least strict comparison available in slider range | Shortened or extended forms like Bob and Bobby treated equal |
| Field where source list is pasted, one entry per line | All detection, preview, removal operations work on this content |
| Presents deduplicated result after duplicates removed | Copyable output with one instance of every original value |
| Keeps original sequence of surviving entries intact | First occurrence retained, later repetitions discarded |
| Defines span between strict and fuzzy matching behaviour | Operator selects level balancing identity and similarity |