v1.1.0
1.1.0 – 2024-02-13
Added
- add end_separator option in config
- support new content providers
Fixed
- update app_api auth middleware
- fix add ctransformers to supported models list
- update readme with new tips and tricks
- update Makefile
- update llama_cpp_python to fix inference on gpu machines
- use normal torch for arm builds