gguf-quantization

Here are 4 public repositories matching this topic...

Análise Avançada de Dados com Causalidade e Aprendizado por Reforço

Auto GGUF Converter for HuggingFace Hub Models with Multiple Quantizations (GGUF Format)

machine-learning cmake ai tensorflow transformers huggingface ai-models huggingface-models bf16 safetensors llama-cpp gguf gguf-models gguf-quantization gguf-editor convert-gguf

Convert Hugging Face models to GGUF with xet support.

Quantize LLMs automatically.

python cli python3 quantization llm llms llamacpp gguf gguf-quantization

Add a description, image, and links to the gguf-quantization topic page so that developers can more easily learn about it.

To associate your repository with the gguf-quantization topic, visit your repo's landing page and select "manage topics."