Identifying and removing near-duplicate images using perceptual hashing.

ECMAScript proposal for Deduplicating method of Array

File Integrity Manager -

JS script that allows you to remove duplicates from your Last.fm scrobbles library.

Go implementation of Facebook's DataLoader with 200+ lines of code.

A funny extension that integrates image-browsing , downloader , deduplicate , cluster , can quickly collect, classify and process your images. | 一个有趣的扩展，整合了 图库，下载，去重，聚类 ，可以快速搜集、分类、处理你的图片。

Benchmarking javascript array operations

A command line tool for sorting photo's from the Synology DSPhoto auto-upload tool

Smart caching for promises. Like memoization, but better.

动漫一拍N自动识别算法

Efficient Deduplicate for Anime Video Frame Interpolation

Deduplication/backup tool with extremely high 'compression' rate

Package uniq provides primitives for getting the first unique elements of (aka deduplicate) your existing sorted sort.Interface.

Refine your file collection using Rust!

General deduping engine for JDBC sources with output to JDBC/csv targets

A command-line tool for deduplicating entries in a file or stream with constant memory usage

makes any request idempotent across nodejs frameworks like nestjs, express, fastify

😺一款用于防止重复攻击的组件，基于SPI机制实现核心功能 >>> 防重放组件 (A component used to prevent duplicated attacks, such as repeat request, replay attack)

Deduplicate data by creating reflinks between identical files.

Deduplicates maildir contents using hard links.