Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
-
Updated
Sep 11, 2024 - Python
Entity resolution (also known as data matching, data linkage, record linkage, and many other terms) is the task of finding entities in a dataset that refer to the same entity across different data sources (e.g., data files, books, websites, and databases). Entity resolution is necessary when joining different data sets based on entities that may or may not share a common identifier (e.g., database key, URI, National identification number), which may be due to differences in record shape, storage location, or curator style or preference.
Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends
Prototype for basic deduplication and aggregation of eCQM data
Open source project for data preparation of LLM application builders
Welcome to TheAnimeScripter – the ultimate tool for Video Upscaling, Interpolating and many more. Available as a CLI, GUI and Adobe Extension.
CLI utility to find near duplicate images and remove all but the best copy.
A secure and efficient file backup solution that fits both system administrators (CLI) and end users (GUI)
Deduplicating archiver with compression and authenticated encryption.
Simple, configuration-driven backup software for servers and workstations
Framework and command-line tools for integrating FollowTheMoney data streams from multiple sources
The SQL/Ibis powered sklearn of record linkage
ATBU Cloud/Local Backup & File Integrity/Duplication Management Utility
An open-source library that leverages Python’s data science ecosystem to build powerful end-to-end Entity Resolution workflows.
Python package for deduplication/entity resolution using active learning
A robust, extensible Python data tagging framework for dynamic processing and intelligent filtering of pretraining corpora for AI models.
Curated list of awesome software and resources for Senzing, The First Real-Time AI for Entity Resolution.
EROFS documentation repo for https://erofs.docs.kernel.org
UniSim is a package for efficient similarity computation, fuzzy matching, and clustering of data.
A maximum-strength name parser for record linkage.
Created by Halbert L. Dunn
Released 1946