A fast high compression read-only file system for Linux, Windows and macOS
-
Updated
Aug 31, 2024 - C++
Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
A fast high compression read-only file system for Linux, Windows and macOS
Deduplicating archiver with encryption and paranoid-level tests. Swiss army knife for the serious backup and disaster recovery manager. Ransomware neutralizer. Win/Linux/Unix
HUMID: reference free FastQ deduplication
System prototype for DSN 2016: "REED: Rekeying-aware Encrypted Deduplication Storage"
Generate duplex/single consensus reads to reduce sequencing noises and remove duplications
Fast multi files (or STDIN) de-duplicator keeping lines order.
DBRetina python package
DeDuplicationKit: Advanced File Storage Deduplication
A command line application that finds duplicate files and removes them. Duplicate files can also be replaced with symbolic links or hard links.
zpaqfranz/zpaq SFX module for Windows 32 and 64 bit
Deduplication over dis-aggregated memory for Serverless Computing
A deduplication lib built Over [SIMHASH](https://github.com/yanyiwu/simhash).
A Management Friendly Deduplication Prototype System for Backup
A backup program that does deduplication, compression, encryption
Yet another block-level btrfs deduplication tool. Other filesystems with FIEMAP and FIDEDUPERANGE may also compatible.
System prototype for MSST 2019: "Metadedup: Deduplicating Metadata in Encrypted Deduplication via Indirection"
Designed, implemented, and tested Reduct, a functional deduplicated distributed file system.
System prototype for USENIX ATC 2015: "Convergent Dispersal Deduplication Datastore"
Created by Halbert L. Dunn
Released 1946