Skip to content

Conversation

kylesayrs
Copy link
Contributor

@kylesayrs kylesayrs commented May 31, 2025

Purpose

  • Remove unused/ misleading code

Changes

  • Remove COMPRESSION_CONFIG_NAME and KV_CACHE_SCHEME_NAME definitions, which are no longer supported unused
grep -r -E 'COMPRESSION_CONFIG_NAME|KV_CACHE_SCHEME_NAME' src tests examples ../llm-compressor/src ../llm-compressor/tests/ ../llm-compressor/examples/

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

SPARSITY_CONFIG_NAME = "sparsity_config"
QUANTIZATION_CONFIG_NAME = "quantization_config"
COMPRESSION_CONFIG_NAME = "compression_config"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure if it matters, but this string is key-matched in vllm -- https://github.com/search?q=repo%3Avllm-project%2Fvllm+COMPRESSION_CONFIG&type=code

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oof, thanks for checking. Theoretically we killed the "compression_config" key a while ago, but seems like there are still vestiges in vLLM.

Since we no longer use this key, this should be save to kill anyways

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants