v1.7.0
We've implemented token counting for each message the bot processes. This new feature prevents the bot from sending messages that are too large, which could potentially overload the system. If a message exceeds the token limit, the bot will respond with an error message asking the user to try a shorter message.
What's Changed
- Implement token count limit by @justinh-rahb in #24
- Fix tokenizer encoding by @justinh-rahb in #25
- Fix tokenizer function by @justinh-rahb in #26
- Count system and user prompt by @justinh-rahb in #27
- Fix tokenizer (again) by @justinh-rahb in #28
- Fix argument count by @justinh-rahb in #29
Full Changelog: v1.6.1...v1.7.0