Explore Projects

Discover 23 open source projects

Active filters (1):
Search: duplicationsร—
Clear all

Showing 1-20 of 23 projects

qarmin/czkawka

Multi-functional file management tool for finding duplicates, similar media, and cleaning up files.

29.7K
Active
Rust
CLI Tools
CLI Tools
#file-cleanup#duplicate-remover#image-comparison

oldratlee/useful-scripts

A collection of useful scripts for Java and shell developers to improve their everyday productivity.

7.5K
Stable
Shell
CLI Tools
Shell Enhancements
#shell#java#productivity

arsenetar/dupeguru

A Python-based deduplication tool to find and remove duplicate files on your system.

7.4K
Active
Python
API Frameworks
CLI Tools
Python
#deduplication#file-management#python

idealo/imagededup

Duplicates images made easy with AI-powered image deduplication.

5.6K
Stable
Python
Prompt Engineering
PyTorch
#image-deduplication#computer-vision#python

kucherenko/jscpd

A TypeScript library that detects copy-pasted code in programming source code.

5.4K
Active
TypeScript
Linters & Formatters
Backend Frameworks
TypeScript
#clones-detection#code-quality#copy-paste

dedupeio/dedupe

A Python library for accurate and scalable fuzzy matching, record deduplication, and entity resolution.

4.4K
Experimental
Python
ORMs & Query Builders
API Frameworks
Python
#data-cleaning#entity-resolution#fuzzy-matching

danielstjules/jsinspect

A JavaScript library to detect copy-pasted and structurally similar code for improving code quality.

3.6K
Archived
JavaScript
Linters & Formatters
API Frameworks
JavaScript
#clean-code#code-analysis#duplication

MaximeBeasse/KeyDecoder

KeyDecoder is a mobile app that lets you quickly decode mechanical keys using your smartphone's camera.

3.2K
Archived
Dart
Security Research
General Utilities
#keydecoder#security-enthusiasts#infosec

0x90d/videoduplicatefinder

A cross-platform tool to find duplicate videos, useful for developers working with media content.

3.0K
Active
C#
General Utilities
#video#duplicate-detection#media

adrianlopezroche/fdupes

FDUPES is a utility to identify and delete duplicate files in specified directories.

2.9K
Stable
C
CLI Tools
General Utilities
#file-deduplication#directory-management#filesystem-utilities

pkolaczk/fclones

Efficient Duplicate File Finder for developers using AI tools

2.7K
Experimental
Rust
React
#duplicate file finder#AI-powered tooling#file management

w4po/ExplorerTabUtility

A powerful utility to supercharge Windows 11's File Explorer with tab management and other productivity features.

2.6K
Experimental
C#
Component Libraries (React)
CLI Tools
React
#file-explorer#tab-management#productivity

nomic-ai/nomic

Nomic Developer API SDK is a Python library that provides tools for clustering, duplicate detection, embeddings, and topic modeling on unstructured data.

1.9K
Stable
Python
LLM Wrappers & SDKs
Databases
Python
#clustering#embeddings#text-processing

visual-layer/fastdup

Accelerate data curation and augmentation with this scalable, free tool for image and video analysis.

1.8K
Stable
Python
Computer Vision
ETL & Pipelines
Python
#data-augmentation#data-curation#image-processing

diskoverdata/diskover-community

Diskover is an open-source file indexer, search engine, and analytics tool powered by Elasticsearch.

1.8K
Active
PHP
API Frameworks
Search
#crawler#file-indexing#file-search

oyvindeh/ucss

A tool to find unused and duplicate CSS in your codebase.

1.6K
Archived
JavaScript
Component Libraries (React)
CLI Tools
React
#css-optimization#linting#code-quality

aahnik/tgcf

A powerful tool for automating custom Telegram message forwarding, with features like live-syncing, auto-posting, and chat cloning.

1.6K
Archived
Python
Messaging & Notifications
CLI Tools
Python
#telegram#chat-forwarding#automation

mhenrixon/sidekiq-unique-jobs

A Ruby library that prevents duplicate Sidekiq jobs, ensuring efficient background processing.

1.5K
Active
Ruby
Background Jobs
CLI Tools
Ruby
#sidekiq#redis#background-jobs

scinos/yarn-deduplicate

A deduplication tool for managing duplicate packages in Yarn lock files.

1.4K
Active
TypeScript
CLI Tools
Backend Frameworks
Node
#dedupe#duplicates#lock-file

pauldreik/rdfind

A command-line tool to find duplicate files on a system, useful for developers managing large codebases.

1.2K
Stable
C++
CLI Tools
#file-deduplication#storage-optimization#disk-management
2

Stay in the loop

Get weekly updates on trending AI coding tools and projects.