Skip to content
@ModelCloud

ModelCloud.ai

Our mission is to give allow everyone, including bots, unlimited and free access to llm/ai models.

Pinned Loading

  1. GPTQModel GPTQModel Public

    Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

    Python 296 44

  2. Device-SMI Device-SMI Public

    Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it y…

    Python 10 1

Repositories

Showing 5 of 5 repositories
  • GPTQModel Public

    Production ready LLM model compression/quantization toolkit with accelerated inference support for both cpu/gpu via HF, vLLM, and SGLang.

    ModelCloud/GPTQModel’s past year of commit activity
    Python 296 Apache-2.0 44 11 9 Updated Feb 22, 2025
  • Tokenicer Public

    A (nicer) tokenizer you want to use for model inference and training: with all known peventable gotchas normalized or auto-fixed.

    ModelCloud/Tokenicer’s past year of commit activity
    Python 5 Apache-2.0 1 0 1 Updated Feb 21, 2025
  • transformers Public Forked from huggingface/transformers

    🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

    ModelCloud/transformers’s past year of commit activity
    Python 0 Apache-2.0 28,525 0 0 Updated Feb 12, 2025
  • optimum Public Forked from huggingface/optimum

    🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

    ModelCloud/optimum’s past year of commit activity
    Python 0 Apache-2.0 507 0 0 Updated Feb 7, 2025
  • Device-SMI Public

    Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separate tools such as nvidia-smi or /proc/cpuinfo and parsing it yourself.

    ModelCloud/Device-SMI’s past year of commit activity
    Python 10 Apache-2.0 1 1 2 Updated Jan 10, 2025

Top languages

Loading…

Most used topics

Loading…