This repository has been archived by the owner on Jul 7, 2023. It is now read-only.
v1.1.8
- Simplified mixture of experts code - breaks checkpoints that use them
- New models and attention functions
- Other cleanups and corrections