Sanitizer Structure

[bodo-hugo-barwich]

To improve the module API a structure that holds important information about the request will be introduced with this development.

[bodo-hugo-barwich]

This development will introduce the TextSanitizer structure that holds data which is reusable in subsequent requests and possible can be initialized from the hosting application.

Important is that the current API that is already published must not break and will continue to be supported.

[bodo-hugo-barwich]

The TextSanitizer becomes more powerful with the "ConversionMap" which is constantly adjusted to improve the sanitizing capabilities.
So, an objective of this development is also to expose this to the application to improve its customisability and perhaps the data overhead for some use cases.

[bodo-hugo-barwich]

Another important improvement is also that runtime verbosity options are not any longer parsed as text but rather set as bool value and can be set at struct create time which is also a Micro Optimization.

[bodo-hugo-barwich]

To make the ConversionMap configurable the internal transliteration structure can be configured through the structures ConversionMap and LanguageMap.
These structures will be serializable through the serde and serde_derive crates.
The new TextSanitizer::new_with_conversion_map(), TextSanitizer::set_conversion_map() and TextSanitizter::set_language_map() methods are used to extend or replace the internal transliteration map.