Skip to content

Conversation

brian-dellabetta
Copy link
Collaborator

SUMMARY:
Prerequisites:

This updates the CompressionLogger, used by GPTQ and other modifiers to log monitoring metrics during runtime. Previously, all GPUs were logged even if a subset were visible. This updates the logs to only log visible devices, and move helper functions into methods. If visible devices cannot be parsed, it will default to logging all of them like before

TEST PLAN:
logs for visible GPUS show correctly when CUDA_VISIBLE_DEVICES=0,1,2 or CUDA_VISIBLE_DEVICES=[0,1,2], and logs for all GPUs show when CUDA_VISIBLE_DEVICES=all or some invalid value.

Signed-off-by: Brian Dellabetta <bdellabe@redhat.com>
Signed-off-by: Brian Dellabetta <bdellabe@redhat.com>
Signed-off-by: Brian Dellabetta <bdellabe@redhat.com>
Base automatically changed from bdellabe/pynvml-remove to main September 24, 2025 14:00
@brian-dellabetta brian-dellabetta marked this pull request as ready for review September 24, 2025 20:02
@brian-dellabetta brian-dellabetta added the ready When a PR is ready for review label Sep 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready When a PR is ready for review
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant