-
Notifications
You must be signed in to change notification settings - Fork 46
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for external taggers #1062
Comments
Hello 👋 Thank you for taking the time to open this issue with recognize. I know it's frustrating when software I look forward to working with you on this issue |
For me, it would also be helpful to have an "incomming" API, that is setting the app's face and cluster information via a Rest API. This way, I can use my GPU to speed up the process, I can run whichever recognition stack I need and I can work with a nextcloud instance which is hosted by a thirdparty provider (who blocked the face recognition calls on their system to not impact the other tenants). WDYT, @marcelklehr? |
Describe the feature you'd like to request
Given how limiting the built-in AI models can be it would be nice if it was possible to add external taggers that could be used instead of the built-in ones.
Describe the solution you'd like
A possible solution is using web requests to communicate with external web servers where the image can be sent over and the server can respond with tags that match the image. This will allow to use different models that aren't implemented in the recognize app itself and also stronger models that may not work in docker setups or the host hardware.
For example the https://github.com/AUTOMATIC1111/stable-diffusion-webui project hosts a web server that can generate images locally. Using the extension https://github.com/picobyte/stable-diffusion-webui-wd14-tagger and --api option, a user can send a POST request with any image encoded in base64 and get a json response of all tags in it including weights on how much the image matches set tags.
One the external setup is complete the process is simple:
{"image": "data:image/<type>;base64,<image data>", "model": "<model name>", "threshold": 0.35}
)http://127.0.0.1:7860/tagger/v1/interrogate
")I don't know any other image tagging software that can be interacted using web requests but I think it's a nice start. Even if its only for object tagging.
I wish I could provide a pull request with this option but unfortunately I'm not skilled enough to write clean PHP code with the nextcloud API.
Describe alternatives you've considered
Implementing new models into the app itself is time consuming and slow. And making them work with the limited dependencies of the nextcloud environment and docker instances is even harder.
The text was updated successfully, but these errors were encountered: