Skip to content

v0.1.5
Compare
Choose a tag to compare
@c0sogi c0sogi released this 22 Aug 12:43
· 41 commits to master since this release
v0.1.5
61385d4
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

🚀 Overview
This release introduces a series of improvements aimed at enhancing user experience and refining the codebase. Here's a breakdown of the changes:

⚡ 1. Optimized performance: llama.cpp & exllama

  • Made performance improvements by changing the text generation logic.

🌐 2. Tunnel through Cloudflare

  • Expose this API to the external network using the --tunnel option.

⚙️ 3. CLI args Refinement

  • Moved argparse.ArgumentParser to config.py.

🐞 4. Bugfix: niceness of process

  • Fixed a bug where the niceness of the process couldn't be modified in a docker environment.

🔜 5. Enhancement: required option in function call schema

  • The function call feature is not yet implemented. Stay tuned!
Assets 2
Loading