aid-on-libs

Here are 4 public repositories matching this topic...

Precise rate limiting for LLM APIs (RPM + TPM) with TypeScript support

typescript npm-package llm aid-on-libs

LLM Queue Dispatcher for LLM requests with advanced scoring algorithms and rate-limit awareness

npm-packages llm aid-on-libs

Fast and lightweight fuzzy token estimation library with CJK support

typescript npm-package llm token-estimation aid-on-libs

npm-package aid-on-libs

Add a description, image, and links to the aid-on-libs topic page so that developers can more easily learn about it.

To associate your repository with the aid-on-libs topic, visit your repo's landing page and select "manage topics."