rustic - fast, encrypted, and deduplicated backups powered by Rust
-
Updated
Aug 10, 2024 - Rust
Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
rustic - fast, encrypted, and deduplicated backups powered by Rust
Data deduplication engine, supporting optional compression and public key encryption.
Filter, Sort & Delete Duplicate Files Recursively
Productivity improvements for Rust ecosystem: warnings are skipped until errors are fixed, LSP-independent Neovim integration, etc.
[UNMAINTAINED] A transactional and deduplicating virtual file system
Yet Another Dupes Finder
A Rust based deduplication tool
A utility for locating near duplicate photos irrespective of image resolution, compression settings or file format.
A command-line tool for deduplicating entries in a file or stream.
An Implementation of Generalized Deduplication, written in Rust
A collection of algorithms to generate a signature/fingerprint/hash in order to be used for detecting duplicate/near duplicate documents.
A pure rust library for parsing and generating zchunk file
Duplicate file/folder finder, can also scan in archives, HDD optimized
Deduplicate data by creating reflinks between identical files.
A tool to deduplicate backups. It builds a hash tree of all files and folders in the target directory. Optionally also traversing into archives like zip or tar files. The hash tree is then used to find duplicate files and folders.
Created by Halbert L. Dunn
Released 1946