Is Presidio Analyzer Thread Safe? #1213
AlanSwansonTR
started this conversation in
General
Replies: 1 comment 1 reply
-
|
Short answer: Yes. Long answer: Depends on the recognizers and NLP capabilities you use. Presidio relies on spaCy, transformers, stanza for named entity recognition. Last time I checked, spaCy was thread safe, but it's worth validating this. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
We already have some support for running Presidio in batch model, leveraging spacy's batch mode: https://spacy.io/api/language#pipe See more here: https://microsoft.github.io/presidio/samples/python/batch_processing/ |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Greetings.
My team would like to use Presidio in a multi-threaded process in order to help us increase throughput with parallelization. We have looked around to try and see if there was any documentation or topics on thread safety but had no luck.
Can you please let me know if the Analyzer is thread safe?
Thank you
Beta Was this translation helpful? Give feedback.
All reactions