Dataset Processor Tools is a comprehensive set of tools designed for processing image datasets for machine learning. With these tools, you can easily discard low-resolution images, resize images while preserving their aspect ratio, generate tags using a pre-trained model, mass edit .txt files with tags, and even manually edit .txt files with ease.
The download comes bundled with all the necessary dependencies, including OnnxRuntime .dll/.so files, to ensure a seamless experience. Please note that some of these files can be quite large due to their importance in the functionality of the tools.
For detailed instructions and examples, be sure to visit the Wiki page. You'll find comprehensive guidance on how to make the most of Dataset Processor Tools.
New Features:
- Adds experimental support for WD Large Auto Tagger:
- Larger auto tagger model with more data and more tags.
- I'm looking into quantizing the model for a future version to reduce its size.
Developer notes: I wasn't able to run it on my integrated GPU since the model requires a lot of VRAM when running with GPU and DirectML and for some reason I can't get the C# OnnxRuntime to work with GPU in 64bits builds. I was able to run it in CPU just fine though, so please let me know if you found any issues with it.
Requirements:
This software requires the following runtimes or newest versions, so be sure to install them:
.NET Desktop Runtime 8.0.2 or newer
For Windows users: Visual C++ Redistributable for Visual Studio 2019 for running the Model
For MAC users please check this Issue on how to build yourself, don't forget to read my comment!