Simple program that finds duplicate files, written in Rust.
-
Updated
Jun 4, 2017 - Rust
Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
Simple program that finds duplicate files, written in Rust.
A collection of algorithms to generate a signature/fingerprint/hash in order to be used for detecting duplicate/near duplicate documents.
A command-line tool for deduplicating entries in a file or stream.
Remove local files that are duplicates of files in another path
Data deduplication engine, supporting optional compression and public key encryption.
A file deduplication app written in rust to be _blazingly fast_ with absolutely no unsafe code.
A Rust based deduplication tool
Traveler: a file deduplication tool. 📂🔍🗂️
🗃️🐊 fdupes-xenon is crposs-platform Rust version of fdupes utility with many cool features! (just for practice in Rust)
A pure rust library for parsing and generating zchunk file
An Implementation of Generalized Deduplication, written in Rust
A utility for locating near duplicate photos irrespective of image resolution, compression settings or file format.
[UNMAINTAINED] A transactional and deduplicating virtual file system
Deduplicate data by creating reflinks between identical files.
Created by Halbert L. Dunn
Released 1946