Release 0.1.2
Bugs and fixes
- Improved default generation parameters for all models
- Fixed issue of both INT8 and INT4 generation like #167. Added correct model weights mapping for INT4
- Bumped
transformers
version to 4.28.1 - Fix hub recursive downloads