dskDitto: Ultra-Fast Parallel Duplicate File Detector with Interactive TUI
DskDitto: Ultra-fast, parallel duplicate-file detector
I built dskDitto to scan large disks for duplicate files instantly using parallel processing. It features an intuitive terminal interface powered by Bubble Tea and an optional Raylib GUI for managing results. You can safely delete duplicates, convert them to symlinks, or export findings to CSV and JSON. The tool supports flexible hashing with SHA-256 or BLAKE3, smart filtering, and even fuzzy matching for near-duplicates.
On macOS SHA256 is fine tuned and out performs BLAKE3 most of the time.
- psYchotic
I'm not sure exactly how it compares, but a similar tool you can use that also does phashes of images/videos to find potential duplicate media files is czkawka [0].
- chaz6
Here's a tip, if you are making regular compressed backups of the configuration of your network devices, if you use gzip, make sure to set the mtime to 0 when writing the file as this can throw off deduplication. This also applies to the name field.
https://docs.python.org/3/library/gzip.html#gzip.GzipFile.mt...
- jdefr89
Wow. Wasn’t expecting to see this here… I am the author…