VideoDupChecker

Check your video collection for duplicates!

ℹ About

VideoDupChecker is a command line tool for detecting video duplicates in a folder structure and can be easily installed via the included setup wizard.

The program checks if a smaller video is part of a larger video stream. It also detects if a specified portion of a video file (more info further down below) matches another one in the given folder.

The program supports multiple modes for different use cases, including comparing videos across folders or within specific subfolders (such as "Extras").

Features

• Duplicate Detection: Compare videos to identify duplicates based on file content.
• Flexible Modes: Check a specific folder, focus on "Extras" or scan complete movie directories.
• Customizable Threshold: Adjust the match threshold to suit your needs (default is 95%).

Notes

• The tool only checks if the video stream of a file matches that of another one. There can still be differences in the audio tracks or included subtitles. This has to be checked before you can delete them safely.

Requirements

• Video format: Your video files need to be in the MKV format.

• MKVToolNix: You need the mkvextract.exe tool for extracting video tracks. Either install MKVToolNix or place mkvextract.exe in the same directory as the VideoDupChecker.exe file.

• RAM: The program requires as much RAM as the combined size of the two largest video files being compared. Make sure your system has sufficient available memory to handle the file sizes, especially when working with large video files.

• Temporary Storage: The program requires temporary storage to process the video files. It will create a temp folder in the directory you are executing the program in.
  The storage requirements depend on the mode you are running (further down you will find more info about them):

  • In check_folder mode: You will need temporary storage for the entire contents of the folder being processed.
  • In check_extras_folder mode: You will need temporary storage for the largest Extras subfolder.
  • In check_movie_folder mode: You will need temporary storage for the largest movie folder (including subfolders).

  Ensure you have enough space in the directory where you execute the program. The program will automatically clean up the temporary files after processing.

Usage

If you installed PaddleOCR via the setup wizard and added it to your Path you can just open a terminal and run the following command:

videodupchecker -h

If you did not add it to your path, navigate to your install location and open a terminal in there. Afterwards you can run the following command:

.\videodupchecker.exe -h

The program supports the following arguments:

• folder_path: Path to the folder you want to process.

• --mode: Specifies the mode of operation.

  • check_folder: Compares all videos contained in this folder and all its subfolders for duplicates.
    Example usage:

    videodupchecker "C:\path\to\folder" --mode check_folder
    

  • check_extras_folder: Scans for videos in subdirectories within the specified folder structure. The program will go through each folder within the specified top-level directory and process all subdirectories it finds. Each subdirectory (e.g., 'Extras', 'BehinTheScenes', etc.) will be processed individually. An example folder structure for this case:

    Movies
      ├── Movie 1
      │   ├── BehindtheScenes
      │   └── Subdirectory2
      ├── Movie 2
      │   ├── Extras
      │   └── DeletedScenes
      └── Movie 3
          ├── BonusContent
          └── Interviews
    

    Example Usage:

    videodupchecker "C:\path\to\Movies" --mode check_extras_folder
    

  • check_movie_folder: Compares all videos directly within movie folders, including their subfolders. The program will iterate through all subdirectories within the specified top-level directory and process videos in each folder and its subfolders. An example folder structure for this case:

    Movies
       ├── Movie 1
       │   ├── Video1.mkv
       │   ├── Video2.mkv
       │   └── Subfolder
       ├── Movie 2
       │   └── Video3.mkv
       └── Movie 3
           ├── Video4.mkv
           └── Subfolder
    

    Example Usage:

    videodupchecker "C:\path\to\Movies" --mode check_movie_folder
    

• --threshold (optional): Percentage threshold for considering partial matches (default: 95%). The program checks if the first or last 95% of the video file matches with another file. You can specify a value between 0 and 100.

  Example Usage:

  videodupchecker "C:\path\to\folder" --mode check_folder --threshold 90
  

Example of running the command videodupchecker "C:\Users\YourUsername\Desktop\test" --mode check_extras_folder:

It iterates through both example movie folders and checks the subfolders Extras and BehindtheScenes for duplicates.

Self-Compilation with Nuitka

If you want to compile VideoDupChecker yourself, you can do so using Nuitka. Here is the command you need to use:

nuitka VideoDupChecker.py --standalone --windows-icon-from-ico=icon.ico